BIG-bench multiple-choice task: pick the German proverb closest in meaning to a given Swedish proverb, from four options.
unassessed
| Category | translation |
|---|---|
| Subcategory | cross-lingual proverb/idiom matching, analogical reasoning (Swedish to German) |
| Page status | unknown |
| Metric | multiple_choice_grade |
| Direction | higher_is_better |
| Dataset size | 72 |
| Dataset licence | Apache-2.0 |
| Publisher | Google (BIG-bench collaboration) |
The model is shown a proverb or saying in Swedish and must choose, from four German-language options, the proverb closest in meaning. As with other BIG-bench proverb-matching tasks, a correct answer requires recognizing the figurative lesson behind the Swedish saying and matching it to an analogous (not literally translated) German saying, exercising cross-lingual analogical reasoning rather than literal translation.
Multiple-choice: one Swedish proverb, four German-proverb answer options, exactly one scored correct.
No model card in ModelSpec reports this benchmark yet.