Private MedHELM task from Stanford adolescent notes: say whether a visit note contains sensitive content that should be withheld from a parent portal view.
unassessed
| Category | domain |
|---|---|
| Subcategory | adolescent note confidentiality for parental access |
| Page status | active |
| Metric | exact_match |
| Direction | higher_is_better |
| Unit | 0-1 scale |
| Dataset size | 1000 |
| Publisher | Stanford University Department of Pediatrics, Stanford Health Care, and Stanford CRFM (MedHELM) |
MedConfInfo tests whether a model can read an English adolescent encounter note and decide if it contains sensitive protected health information that should be restricted from parental access under adolescent confidentiality rules. HELM's example mentions sexual activity, mental health, or substance use discussed in a private portion of a visit. The census id is shc_conf; the runnable HELM scenario is shc_conf_med.
Joint multiple-choice generation. HELM asks for A if the note contains sensitive content that should be restricted, or B if not, with no extra text.
No model card in ModelSpec reports this benchmark yet.