FewCLUE's Chinese idiom cloze task: pick the idiom that fits a masked slot from seven near-synonym candidates, learned from 42 labelled training examples.
unassessed
| Category | reasoning |
|---|---|
| Subcategory | Chinese idiom cloze test (multiple-choice fill-in-the-blank), few-shot |
| Page status | unknown |
| Metric | accuracy |
| Direction | higher_is_better |
| Unit | % |
| Dataset size | 2002 |
| Publisher | CLUE team |
A Chinese passage with one blank marked #idiom# and seven candidate idioms, several chosen as near-synonyms of the correct answer to block shallow pattern matching; the model selects the idiom that fits the context, learned few-shot from 42 labelled training examples.
Seven-way multiple-choice cloze, graded on the single correct candidate; evaluated from a 42-example few-shot training split (six examples for each of the seven blank positions), one of five parallel splits FewCLUE provides for this task.
No model card in ModelSpec reports this benchmark yet.