HRM8K evaluates Korean and English mathematical reasoning on 8,011 parallel bilingual problems.
unassessed
| Category | math |
|---|---|
| Subcategory | multilingual mathematical reasoning |
| Page status | active |
| Metric | accuracy |
| Direction | higher_is_better |
| Unit | percent |
| Dataset size | 8011 |
| Dataset licence | MIT |
| Publisher | HAERAE-HUB |
HRM8K tests mathematical problem solving when instructions and questions are presented in Korean, with aligned English versions. It combines translated problems from established benchmarks with original Korean exam problems.
Free-form mathematical solution generation in Korean or English.
No model card in ModelSpec reports this benchmark yet.