English Proverbs

A 34-item BIG-bench task that picks which English proverb best fits a short anecdote, with three to six choices.

Also known as: BIG-bench english_proverbs

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryreasoning
SubcategoryBIG-bench story-to-proverb multiple choice (34 items, 3–6 options)
Page statusunknown
Metricmultiple_choice_grade
Directionhigher_is_better
Unit%
Dataset size34
Dataset licenceApache-2.0
PublisherGoogle (BIG-bench collaboration)

What it measures

english_proverbs gives a short English story about people and outcomes, then asks which listed proverb best applies. Daniel Moseguí González is the listed author. Each input ends with "Which of the following proverbs best apply to this situation?" Options are conventional English sayings. Six of the 34 examples mark two or three gold proverbs. The skill is matching a narrative to a conventional figurative meaning, not writing a proverb and not [abstract_narrative_understanding](abstract_narrative_understanding.md), which maps crowdsourced stories onto a 100-proverb list with 4, 9, or 99 distractors.

Task format

Multiple choice with 3–6 options (28 four-way, four five-way, one three-way, one six-way), preferred metric multiple_choice_grade. No task_prefix in task.json; the question is inside each input. Canary GUID embedded.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub