MMLU: Moral Disputes

Accuracy on MMLU's moral disputes questions, one of 57 subject tests of academic and professional knowledge.

Also known as: moral_disputes

unassessed

What it measures

Applied-ethics questions covering disputed moral issues, testing whether a model can identify and reason about the philosophical positions at stake rather than settle the disputes itself. Framed as four-option multiple-choice questions and scored zero-shot or few-shot by exact match against the labelled option, as one of the 57 subject subsets that make up the MMLU benchmark.

Task format

Four-option multiple-choice question answering (A-D), one correct answer, zero-shot or few-shot.

Models reporting this benchmark

Data

This page as JSON · Edit on GitHub