BIG-bench multiple-choice task matching a Kiswahili proverb to its closest English-language equivalent among four options.
unassessed
| Category | translation |
|---|---|
| Subcategory | cross-lingual proverb/idiom matching, analogical reasoning, low-resource language (Swahili) |
| Page status | unknown |
| Metric | multiple_choice_grade |
| Direction | higher_is_better |
| Dataset size | 153 |
| Dataset licence | Apache-2.0 |
| Publisher | Google (BIG-bench collaboration) |
The model reads a proverb or idiom in Kiswahili (Swahili) and must pick, from four English-language proverbs, the one closest in meaning. Because proverbs encode figurative, culturally specific wisdom rather than literal statements, a correct choice requires recognizing the underlying idea behind the Swahili saying and matching it to an analogous (not literally translated) English saying. The task's own keywords describe it as testing "analogical reasoning" in a low-resource language pair, not word-for-word translation.
Multiple-choice: one Kiswahili proverb, four English-proverb answer options, exactly one scored correct.
No model card in ModelSpec reports this benchmark yet.