38,431 grade-level math word problems that require reasoning over both a short question and an accompanying table, mixing free-text and multiple-choice answers.
unassessed
| Category | math |
|---|---|
| Subcategory | grade-level math word problems over tables |
| Page status | active |
| Metric | accuracy |
| Direction | higher_is_better |
| Unit | % |
| Dataset size | 38431 |
| Dataset licence | CC-BY-NC-SA-4.0 |
TabMWP (Tabular Math Word Problems) gives the model a table and a grade-school math question about that table. The table is available as an image, as semi-structured text, and as a structured grid. About three quarters of items need a free-text number; the rest are multiple-choice text spans. Each item also has a gold solution. The skill is reading the table and doing the arithmetic, not solving a table-free word problem.
English generation over a text table plus question. OpenCompass prompts `Table: {table}` then `Question: {question}` with no in-context examples and scores with `TabMWPEvaluator`, which normalises numeric answers and matches choice letters when options are present.
No model card in ModelSpec reports this benchmark yet.