SWE-Bench-Verified-O1-reasoning-high-results

SWE-Bench-Verified-O1-reasoning-high-results is a benchmark task documented by its cited evaluation harness.

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryknowledge
Subcategorybenchmark task
Page statusactive
Metricaccuracy
Directionhigher_is_better
Unitpercent

What it measures

SWE-Bench-Verified-O1-reasoning-high-results is a benchmark task documented by the evaluation integration.

Task format

Text input with task-specific prediction or generation output.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub