HRM8K

HRM8K evaluates Korean and English mathematical reasoning on 8,011 parallel bilingual problems.

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categorymath
Subcategorymultilingual mathematical reasoning
Page statusactive
Metricaccuracy
Directionhigher_is_better
Unitpercent
Dataset size8011
Dataset licenceMIT
PublisherHAERAE-HUB

What it measures

HRM8K tests mathematical problem solving when instructions and questions are presented in Korean, with aligned English versions. It combines translated problems from established benchmarks with original Korean exam problems.

Task format

Free-form mathematical solution generation in Korean or English.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub