Arena Elo — Style Control

A style-adjusted Arena ranking that regresses out response length and markdown formatting so ratings lean more on substance than presentation.

Also known as: Chatbot Arena Style Control, LMArena Style Control, Arena Score, style-controlled

unassessed

What it measures

arena_elo_style_control applies a style adjustment to the same votes and the same Bradley-Terry fit used elsewhere in the arena_elo family, rather than drawing on a different vote pool. LMSYS adds response length and markdown formatting (header, bold and list counts, each expressed as a normalised difference between the two compared responses) as extra regressors in the logistic regression that produces Arena ratings, so the resulting model coefficients are adjusted for — controlled for — those style effects instead of reflecting them. It can be layered onto Overall or onto a category such as Hard Prompts.

Task format

Same anonymous, randomized side-by-side text chat as the underlying category; ratings are recomputed with response-length and markdown-count features included in the regression.

Models reporting this benchmark

Data

This page as JSON · Edit on GitHub