A 30-item BIG-bench JSON template of one- to three-digit addition, written as an example for task authors rather than as a capability benchmark.
unassessed
| Category | math |
|---|---|
| Subcategory | BIG-bench JSON format template; one- to three-digit addition |
| Page status | unknown |
| Metric | exact_str_match |
| Direction | higher_is_better |
| Unit | % |
| Dataset size | 30 |
| Dataset licence | Apache-2.0 |
| Publisher | Google (BIG-bench organizers) |
simple_arithmetic_json shows a language model a short addition equation such as "1 + 4 =" or "635 + 613 =" and asks it to produce the numeric sum as free text. The 30 items are the same pool as the nested one_digit, two_digit and three_digit files (ten each). Some two_digit and three_digit lines mix addend widths (for example 47 + 8 and 76 + 812). The organizers state that its primary purpose is a JSON template for new task authors, not a test of arithmetic skill. BIG-bench tags it "example task". English-script, text-only, zero-shot.
Free-text numeric completion of an addition equation (for example '1 + 4 ='); scored by exact string match after extracting a number with a signed-integer regex.
No model card in ModelSpec reports this benchmark yet.