MTEB Reranking

Reorders a fixed candidate list of passages for a query by embedding similarity and scores the reordering by MAP, across 4 mostly-English datasets.

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryembedding
Subcategoryreranking
Page statusactive
MetricMAP
Directionhigher_is_better
Unit%
Dataset size4
Dataset licenceVaries by dataset.
PublisherHugging Face and Cohere (original authors); maintained today by the open embeddings-benchmark community

What it measures

Starting from a query and a pre-assembled list of candidate passages that mix relevant and irrelevant items, the model embeds the query and each candidate and the candidates are reordered by similarity to the query embedding.

Task format

Given a query and a fixed candidate list, embed query and candidates and reorder the list by cosine similarity; score with MAP.

Models reporting this benchmark

These figures come from the model cards, which carry one collection date per card and no per-score attribution. They are shown as reported, not as verified evidence.
ModelProviderScoreCard as of
Qwen3 Embedding 8BAlibaba / Qwen Team65.62026-04
Qwen3 VL Embedding 8BAlibaba / Qwen Team65.62026-04
Qwen3 Embedding 4BAlibaba / Qwen Team65.12026-04
NV Embed v2NVIDIA60.42026-04
e5 mistral 7B instructintfloat60.22026-04
Qwen3 Embedding 0.6BAlibaba / Qwen Team60.02026-04
Qwen3 VL Embedding 2BAlibaba / Qwen Team60.02026-04
Gemini Embedding 001Google DeepMind59.52026-04
jina embeddings v4Jina AI59.52026-04
jina embeddings v4 vllm retrievalJina AI59.52026-04
jina embeddings v5 text nanoJina AI59.52026-04
jina embeddings v5 text smallJina AI59.52026-04
jina embeddings v5 text small retrievalJina AI59.52026-04
text-embedding-3-largeOpenAI59.22026-04
Voyage 3Voyage AI59.02026-04
multilingual e5 large instructintfloat58.62026-04
SFR Embedding 2 RSalesforce58.52026-04
jina clip v2Jina AI58.12026-04
jina code embeddings 1.5BJina AI58.12026-04
jina embeddings v3Jina AI58.12026-04
bge multilingual gemma2BAAI58.02026-04
snowflake arctic embed l v2.0Snowflake58.02026-04
bge m3BAAI57.52026-04
e5 large v2intfloat57.02026-04
bge large en v1.5BAAI56.52026-04
colnomic embed multimodal 7BNomic AI56.52026-04
granite embedding english r2IBM56.52026-04
granite embedding small english r2IBM56.52026-04
multilingual e5 largeintfloat56.52026-04
nomic embed multimodal 7BNomic AI56.52026-04
nomic embed text v2 moeNomic AI56.52026-04
nomic embed text v2 moe GGUFNomic AI56.52026-04
snowflake arctic embed lSnowflake56.52026-04
Voyage Code 3Voyage AI56.52026-04
e5 largeintfloat56.02026-04
e5 large unsupervisedintfloat56.02026-04
snowflake arctic embed m v2.0Snowflake56.02026-04
Voyage Finance 2Voyage AI56.02026-04
Voyage Multilingual 2Voyage AI56.02026-04
Voyage Law 2Voyage AI55.82026-04
bge large enBAAI55.52026-04
Voyage 3 LiteVoyage AI55.52026-04
modernbert embed baseNomic AI55.22026-04
nomic embed text v1.5Nomic AI55.22026-04
nomic embed text v1.5 GGUFNomic AI55.22026-04
e5 base v2intfloat55.02026-04
granite embedding 278M multilingualIBM55.02026-04
snowflake arctic embed m v1.5Snowflake55.02026-04
text-embedding-3-smallOpenAI55.02026-04
bge base en v1.5BAAI54.82026-04
nomic embed text v1Nomic AI54.52026-04
snowflake arctic embed mSnowflake54.52026-04
multilingual e5 baseintfloat54.22026-04
snowflake arctic embed m longSnowflake54.22026-04
e5 baseintfloat54.02026-04
Mistral EmbedMistral AI54.02026-04
SFR Embedding Code 400M RSalesforce54.02026-04
bge base enBAAI53.82026-04
bge code v1BAAI53.02026-04
CodeRankEmbedNomic AI53.02026-04
e5 small v2intfloat53.02026-04
granite embedding 125M englishIBM53.02026-04
nomic embed codeNomic AI53.02026-04
text-embedding-ada-002OpenAI52.82026-04
bge small en v1.5BAAI52.52026-04
multilingual e5 smallintfloat52.52026-04
snowflake arctic embed sSnowflake52.52026-04
e5 smallintfloat52.02026-04
granite embedding 107M multilingualIBM52.02026-04
bge small enBAAI51.52026-04
all mpnet base v2Sentence Transformers50.82026-04
snowflake arctic embed xsSnowflake50.52026-04
all MiniLM L12 v2Sentence Transformers50.02026-04
granite embedding 30M englishIBM50.02026-04
granite embedding 30M sparseIBM50.02026-04
all MiniLM L6 v2Sentence Transformers49.52026-04
multi qa mpnet base dot v1Sentence Transformers49.52026-04
multi qa mpnet base cos v1Sentence Transformers49.22026-04
all roberta large v1Sentence Transformers49.02026-04
paraphrase mpnet base v2Sentence Transformers49.02026-04
all distilroberta v1Sentence Transformers48.52026-04
paraphrase multilingual mpnet base v2Sentence Transformers48.22026-04
multi qa MiniLM L6 cos v1Sentence Transformers48.02026-04
msmarco bert base dot v5Sentence Transformers47.52026-04
paraphrase multilingual MiniLM L12 v2Sentence Transformers47.02026-04
paraphrase MiniLM L12 v2Sentence Transformers46.82026-04
msmarco MiniLM L12 cos v5Sentence Transformers46.52026-04
paraphrase MiniLM L6 v2Sentence Transformers46.52026-04
msmarco MiniLM L6 v3Sentence Transformers46.02026-04
LaBSESentence Transformers45.02026-04
distiluse base multilingual cased v2Sentence Transformers44.02026-04
paraphrase MiniLM L3 v2Sentence Transformers44.02026-04
distiluse base multilingual cased v1Sentence Transformers43.02026-04

Data

This page as JSON · Edit on GitHub