MTEB-BR

MTEB-BR evaluates agents that modify repositories to resolve issues across Java, TypeScript, JavaScript, Go, Rust, C and C++.

Also known as: MTEB-BR: A Multilingual Benchmark for Issue Resolving

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryembedding
SubcategoryBrazilian-Portuguese text embeddings
Page statusactive
Metrictask score
Directionhigher_is_better
Unit%
Dataset size22
PublisherMTEB-BR authors

What it measures

Embedding quality on native Brazilian-Portuguese classification, similarity, clustering, retrieval and reranking tasks.

Task format

Text-embedding tasks with category-specific labels, similarities, retrieval and reranking judgments.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub