MedHELM Configurable

MedHELM Configurable is a HELM scenario wrapper for configurable biomedical datasets, prompts, references, and metrics.

Also known as: MedHELM

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categorydomain
Subcategorybiomedical evaluation framework
Page statusactive
Directionhigher_is_better
PublisherStanford CRFM HELM

What it measures

This identifier names a configurable evaluation scenario rather than one fixed dataset. A benchmark configuration supplies a CSV dataset, prompt template, description, and one or more metrics.

Task format

Configuration-defined biomedical prompt with optional correct and incorrect answers.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub