Private Stanford Health Care MedHELM task: given a hematology note, answer yes or no on whether the patient later received a bone marrow or stem-cell transplant.
unassessed
| Category | domain |
|---|---|
| Subcategory | bone marrow transplant status from clinical notes |
| Page status | active |
| Metric | exact_match |
| Direction | higher_is_better |
| Unit | 0-1 scale |
| Dataset size | 220 |
| Publisher | Stanford Health Care and Stanford CRFM (MedHELM) |
BMT-Status tests whether a model can read an English clinical note from a hematology or oncology consultation and answer a binary question about bone marrow transplant (BMT), hematopoietic stem cell transplant (HSCT), or hematopoietic cell transplant (HCT) status. HELM's published goal is to decide whether the patient received a subsequent transplant from the documentation alone. The harness id is shc_bmt; the runnable HELM scenario is shc_bmt_med.
Joint multiple-choice generation. HELM wraps a CSV prompt and note as one English string and requires a single token, A for yes or B for no, with no extra text.
No model card in ModelSpec reports this benchmark yet.