FLORES English-to-Spanish

BLEU score for English-to-Spanish translation on the FLORES-200 devtest set, as reported in this repository's model cards.

Also known as: flores200 eng_Latn-spa_Latn

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categorytranslation
Subcategoryen-es
Page statusactive
MetricBLEU
Directionhigher_is_better
Unit%
Dataset size1012
Dataset licenceCC BY-SA 4.0
PublisherMeta AI (FAIR), NLLB Team; now maintained by the Open Language Data Initiative (OLDI)

What it measures

flores_en_es scores how well a model translates the FLORES-200 devtest sentences from English into Spanish, one of the highest-resource pairs in the benchmark and one of the most heavily represented languages in web training data.

Task format

Translate the 1012 FLORES-200 devtest sentences from English into Spanish; score against the human Spanish reference.

Models reporting this benchmark

These figures come from the model cards, which carry one collection date per card and no per-score attribution. They are shown as reported, not as verified evidence.
ModelProviderScoreCard as of
GPT-4OpenAI71.22026-04
GPT-4 TurboOpenAI71.22026-04
GPT-4oOpenAI71.22026-04
GPT-4o (2024-05-13)OpenAI71.22026-04
GPT-4o (2024-08-06)OpenAI71.22026-04
GPT-4o (2024-11-20)OpenAI71.22026-04
GPT-4o miniOpenAI71.22026-04
Claude Sonnet 3.5Anthropic70.82026-04
Claude Sonnet 3.5 v2Anthropic70.82026-04
Gemini 1.5 FlashGoogle DeepMind68.12026-04
Gemini 1.5 Flash-8BGoogle DeepMind68.12026-04
Gemini 1.5 ProGoogle DeepMind68.12026-04
Gemini 2.0 FlashGoogle DeepMind68.12026-04
Gemini 2.5 FlashGoogle DeepMind68.12026-04
Gemini 2.5 ProGoogle DeepMind68.12026-04

Data

This page as JSON · Edit on GitHub