WMT 2016 (Romanian-English, T5 prompt)

The lm-evaluation-harness wmt2016 task scores Romanian-to-English translation from the WMT16 test set using a T5-style prompt.

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categorytranslation
Subcategorymachine translation
Page statusactive
MetricBLEU
Directionhigher_is_better
Unitpoints

What it measures

The lm-evaluation-harness wmt2016 task directory scores English-to-Romanian generation from the WMT16 shared-task data, prompted in the style used for T5.

Task format

Text generation; the model is prompted 'translate English to Romanian: {source}' and must generate the Romanian translation.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub