A suite of Thai multiple-choice exams (ONET, IC, TGAT, TPAT-1, A-Level) used to test Thai knowledge in Typhoon and later as a HELM scenario.
unassessed
| Category | knowledge |
|---|---|
| Subcategory | Thai national and professional multiple-choice exams |
| Page status | active |
| Metric | exact_match |
| Direction | higher_is_better |
| Unit | % |
| Dataset size | 590 |
| Dataset licence | Apache-2.0 |
| Publisher | Typhoon / SCB 10X (typhoon-ai) |
ThaiExam asks a model to answer real Thai exam items by choosing among four or five lettered options. The suite mixes grade-12 academic tests (ONET, TGAT, TPAT-1, A-Level) with the Stock Exchange of Thailand's Investment Consultant licence exam (IC). Language is mostly Thai; HELM's metadata marks some slices as Thai and English. The Typhoon report built the set to measure Thai knowledge after continual pretraining, not as a general multilingual MMLU.
Multiple-choice question with options A-E (some items omit E). HELM's `ThaiExamScenario` builds a joint multiple-choice prompt with up to five in-context train items and scores exact match on the chosen letter.
No model card in ModelSpec reports this benchmark yet.