FLORES English-to-Japanese

BLEU score for English-to-Japanese translation on the FLORES-200 devtest set, as reported in this repository's model cards.

Also known as: flores200 eng_Latn-jpn_Jpan

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categorytranslation
Subcategoryen-ja
Page statusactive
MetricBLEU
Directionhigher_is_better
Unit%
Dataset size1012
Dataset licenceCC BY-SA 4.0
PublisherMeta AI (FAIR), NLLB Team; now maintained by the Open Language Data Initiative (OLDI)

What it measures

flores_en_ja scores how well a model translates the FLORES-200 devtest sentences from English into Japanese. Japanese's subject-object-verb order, lack of whitespace-delimited words, and mixed kanji/kana/katakana script make it more distant from English than the benchmark's Romance-language pairs.

Task format

Translate the 1012 FLORES-200 devtest sentences from English into Japanese; score against the human Japanese reference.

Models reporting this benchmark

These figures come from the model cards, which carry one collection date per card and no per-score attribution. They are shown as reported, not as verified evidence.
ModelProviderScoreCard as of
GPT-4OpenAI61.42026-04
GPT-4 TurboOpenAI61.42026-04
GPT-4oOpenAI61.42026-04
GPT-4o (2024-05-13)OpenAI61.42026-04
GPT-4o (2024-08-06)OpenAI61.42026-04
GPT-4o (2024-11-20)OpenAI61.42026-04
GPT-4o miniOpenAI61.42026-04
Claude Sonnet 3.5Anthropic60.82026-04
Claude Sonnet 3.5 v2Anthropic60.82026-04
Gemini 1.5 FlashGoogle DeepMind58.12026-04
Gemini 1.5 Flash-8BGoogle DeepMind58.12026-04
Gemini 1.5 ProGoogle DeepMind58.12026-04
Gemini 2.0 FlashGoogle DeepMind58.12026-04
Gemini 2.5 FlashGoogle DeepMind58.12026-04
Gemini 2.5 ProGoogle DeepMind58.12026-04

Data

This page as JSON · Edit on GitHub