FewCLUE: CLUEWSC (Winograd Schema Coreference)

FewCLUE's Winograd Schema task: judge whether a marked pronoun refers to a marked noun phrase in a Chinese sentence, learned from 32 labelled training examples.

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryreasoning
SubcategoryChinese Winograd Schema pronoun coreference resolution, few-shot
Page statusunknown
Metricaccuracy
Directionhigher_is_better
Unit%
Dataset size976
PublisherCLUE team

What it measures

A Chinese sentence with a marked pronoun and a marked noun phrase, hand-picked from contemporary literary works; the model judges true or false whether the pronoun refers to that noun phrase, learned few-shot from 32 labelled training examples.

Task format

Binary coreference judgment (true / false), graded on the single correct label; evaluated from a 32-example few-shot training split, one of five parallel splits FewCLUE provides for this task.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub