MMLU: US Foreign Policy

Accuracy on MMLU's us foreign policy questions, one of 57 subject tests of academic and professional knowledge.

Also known as: us_foreign_policy

unassessed

What it measures

The history and theory of US foreign policy: diplomacy, treaties, foreign-policy doctrines, and the institutions (the State Department, the National Security Council) that carry it out. Framed as four-option multiple-choice questions and scored zero-shot or few-shot by exact match against the labelled option, as one of the 57 subject subsets that make up the MMLU benchmark.

Task format

Four-option multiple-choice question answering (A-D), one correct answer, zero-shot or few-shot.

Models reporting this benchmark

Data

This page as JSON · Edit on GitHub