TMMLU+

TMMLU+ is an lm-evaluation-harness task family for Taiwanese Mandarin knowledge questions.

Also known as: TMMLU Plus

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.

Category	knowledge
Subcategory	Taiwanese Mandarin multiple-choice knowledge
Page status	active
Metric	accuracy
Direction	higher_is_better
Unit	percent
Dataset size	22160
Dataset licence	MIT
Publisher	iKala

What it measures

TMMLU+ evaluates subject knowledge through multiple-choice questions in Taiwanese Mandarin. It is a harness family with subject-level tasks rather than one homogeneous item set.

Task format

Subject-specific multiple-choice question with answer choices.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub