Two model instances play Twenty Questions, communicating a hidden concept through yes-or-no answers.
unassessed
| Category | agentic |
|---|---|
| Subcategory | self-play concept identification |
| Page status | active |
| Metric | negative number of conversational rounds to the correct guess |
| Direction | higher_is_better |
| Unit | rounds |
| Publisher | BIG-bench collaboration |
Alice receives a hidden concept and answers yes or no. Bob asks questions and must identify it. The task tests constrained answering, targeted question selection, persistence and self-play.
Interactive two-agent text game with one question per turn and a maximum of 100 questions.
No model card in ModelSpec reports this benchmark yet.