Text Navigation Game

BIG-bench Text Navigation Game has a model issue free-text moves across turns to reach a target on an ASCII-grid maze.

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryreasoning
Subcategorynavigation
Page statusactive
Metrictargets_reached
Directionhigher_is_better
Unitfraction
PublisherGoogle BIG-bench

What it measures

The task evaluates whether a model can interpret a text/ASCII representation of a grid world, issue valid movement commands over repeated turns, and reach a target location. It is a small procedurally generated, multi-turn reasoning task, not a single-shot question.

Task format

Repeated interaction over up to 30 turns. The model receives the current ASCII-grid game state and issues a free-text move command each turn; the environment updates state and reports whether the target was reached.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub