A 70-item BIG-bench multiple-choice set of child-level and oddball English facts, scored as multiple_choice_grade.
unassessed
| Category | knowledge |
|---|---|
| Subcategory | short English common-sense and trivia multiple choice (BIG-bench) |
| Page status | unknown |
| Metric | multiple_choice_grade |
| Direction | higher_is_better |
| Unit | % |
| Dataset size | 70 |
| Dataset licence | Apache-2.0 |
| Publisher | Google (BIG-bench collaboration) |
general_knowledge asks short English questions that a child could often answer, plus a few absurd or slightly harder facts. The author, Evgenii Zheltonozhskii, groups items as "obvious" (how many legs a horse has), "absurd" (how many tails a human has), and ordinary trivia that is likely somewhere in pretraining. The point is coherent factual answering, not reading a passage. It is not [MMLU](mmlu.md) and not MMLU Global Facts.
Multiple choice, preferred metric multiple_choice_grade. append_choices_to_input is true. Option count varies: 4 to 13 choices (mean 7.57; 16 items have seven). Canary GUID embedded. Dummy-model header: 70 multiple-choice and 0 free-text queries. Redesigned from exact string match after reviewer discussion.
No model card in ModelSpec reports this benchmark yet.