NEJMAI / nephSAP nephrology benchmark

OpenCompass's NEJMAI wrapper evaluates zero-shot multiple-choice answering on 858 nephSAP nephrology questions.

Also known as: Nejmaibench, nephSAP

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.

Category	domain
Subcategory	medical knowledge
Page status	active
Metric	accuracy
Direction	higher_is_better
Unit	percent
Dataset size	858
Publisher	Nephrology Self-Assessment Program / OpenCompass

What it measures

The OpenCompass configuration identifies a medical question, answer options, subject, and prompt mode. The linked benchmark paper evaluates 858 Nephrology Self-Assessment Program questions, not a general NEJM exam.

Task format

Medical multiple-choice question with options A through E; output one option letter.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub