FLORES English-to-Chinese

BLEU score for English-to-Chinese translation on the FLORES-200 devtest set, as reported in this repository's model cards.

Also known as: flores200 eng_Latn-zho

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categorytranslation
Subcategoryen-zh
Page statusactive
MetricBLEU
Directionhigher_is_better
Unit%
Dataset size1012
Dataset licenceCC BY-SA 4.0
PublisherMeta AI (FAIR), NLLB Team; now maintained by the Open Language Data Initiative (OLDI)

What it measures

flores_en_zh scores how well a model translates the FLORES-200 devtest sentences from English into Chinese. FLORES-200 tracks Simplified and Traditional Chinese as distinct language codes (zho_Hans and zho_Hant); this repository's card data does not state which variant its flores_en_zh figures use.

Task format

Translate the 1012 FLORES-200 devtest sentences from English into Chinese; score against the human Chinese reference.

Models reporting this benchmark

These figures come from the model cards, which carry one collection date per card and no per-score attribution. They are shown as reported, not as verified evidence.
ModelProviderScoreCard as of
GPT-4OpenAI59.72026-04
GPT-4 TurboOpenAI59.72026-04
GPT-4oOpenAI59.72026-04
GPT-4o (2024-05-13)OpenAI59.72026-04
GPT-4o (2024-08-06)OpenAI59.72026-04
GPT-4o (2024-11-20)OpenAI59.72026-04
GPT-4o miniOpenAI59.72026-04
Claude Sonnet 3.5Anthropic59.22026-04
Claude Sonnet 3.5 v2Anthropic59.22026-04
Gemini 1.5 FlashGoogle DeepMind56.82026-04
Gemini 1.5 Flash-8BGoogle DeepMind56.82026-04
Gemini 1.5 ProGoogle DeepMind56.82026-04
Gemini 2.0 FlashGoogle DeepMind56.82026-04
Gemini 2.5 FlashGoogle DeepMind56.82026-04
Gemini 2.5 ProGoogle DeepMind56.82026-04

Data

This page as JSON · Edit on GitHub