ProxySender

Private MedHELM task: decide whether a clinician-facing portal message was sent by the patient or by a proxy such as a parent or spouse.

Also known as: shc_proxy_med, ProxySender

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.

Category	domain
Subcategory	patient versus proxy sender of portal messages
Page status	active
Metric	exact_match
Direction	higher_is_better
Unit	0-1 scale
Dataset size	300
Publisher	Stanford University Department of Pediatrics, Stanford Health Care, and Stanford CRFM (MedHELM)

What it measures

ProxySender tests whether a model can read an English patient-portal message sent to a clinician and decide if a proxy user (parent, spouse, or other caregiver) sent it rather than the patient. HELM's example is a message that begins "Hi Dr. Lee, this is Jane's mom." The census id is shc_proxy; the runnable HELM scenario is shc_proxy_med.

Task format

Joint multiple-choice generation. The instance prompt still says A for yes (proxy) or B for no. After 16 October 2025 the adapter also names C as a legal letter, while the prompt text was not updated to define C.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub