Intersect Geometry

A 250,000-item BIG-bench task that counts intersections among templated circles, polygons and segments, scored as 41-way multiple_choice_grade.

Also known as: Intersection Points, BIG-bench intersect_geometry

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categorymath
Subcategorycount intersection points among 2–6 templated shapes (BIG-bench JSON)
Page statusunknown
Metricmultiple_choice_grade
Directionhigher_is_better
Unit%
Dataset size250000
Dataset licenceApache-2.0
PublisherGoogle (BIG-bench collaboration)

What it measures

intersect_geometry (README title: Intersection Points) gives English template sentences that place line segments, polygons or circles in the plane, then asks how many intersection points exist. Choices are the integers 0 through 40. Authors Paul Vicol and Jascha Sohl-Dickstein generated the items to test geometric counting, not fluent reading. Five subtasks use 2, 3, 4, 5 or 6 shapes. It is not [geometric_shapes](geometric_shapes.md), which names an SVG path, and it is not in [BIG-Bench Hard](bbh.md).

Task format

41-option multiple choice (0–40) with preferred metric multiple_choice_grade. append_choices_to_input is false. Canary GUID embedded. Root task.json holds metadata only; examples live in shapes_{2–6}/task.json. Dummy-model header reports 249,999 multiple-choice queries.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub