core/evals/dimensional/v1/cases.jsonl
Shay 96c1d4bcee feat: dimensional-reasoning lane — 3rd diversity-panel domain
The first non-GSM8K consumer of the binding-graph interlingua's unit algebra as a
load-bearing reasoner: given two units and an operation, decide the result's
dimension. SUT = generate.binding_graph.units; gold = evals/dimensional/oracle.py,
a genuinely INDEPENDENT dimensional reasoner (own unit->base-exponent table, own
exponent arithmetic, own canonical-string renderer; shares no code with the SUT).

12 cases (area / speed / wage / mass-density / dimensionless / 2 refused) gated by
SUT == oracle == gold (wrong=0). Registered in INV-25's INDEPENDENT_GOLD_LANES,
proving the independent-gold discipline generalizes to a SECOND oracle.

This is the 3rd structurally-distinct golded domain (logic / grounding / dimensional)
— the anti-overfit >=2-domain panel is now real, and the interlingua is load-bearing
beyond GSM8K.
2026-06-04 16:38:56 -07:00

12 lines
1.1 KiB
JSON

{"gold": "length^2", "id": "dim-v1-0001", "left": "meter", "op": "product", "right": "meter"}
{"gold": "length/time", "id": "dim-v1-0002", "left": "meter", "op": "quotient", "right": "second"}
{"gold": "length", "id": "dim-v1-0003", "left": "meter_per_second", "op": "product", "right": "second"}
{"gold": "money/time", "id": "dim-v1-0004", "left": "dollar", "op": "quotient", "right": "hour"}
{"gold": "time*money", "id": "dim-v1-0005", "left": "dollar", "op": "product", "right": "hour"}
{"gold": "mass/length", "id": "dim-v1-0006", "left": "kilogram", "op": "quotient", "right": "meter"}
{"gold": "length*time", "id": "dim-v1-0007", "left": "meter", "op": "product", "right": "second"}
{"gold": "length/time", "id": "dim-v1-0008", "left": "mile", "op": "quotient", "right": "hour"}
{"gold": "dimensionless", "id": "dim-v1-0009", "left": "foot", "op": "quotient", "right": "foot"}
{"gold": "length^2", "id": "dim-v1-0010", "left": "foot", "op": "product", "right": "foot"}
{"gold": "refused", "id": "dim-v1-0011", "left": "dollar", "op": "quotient", "right": "apple"}
{"gold": "refused", "id": "dim-v1-0012", "left": "gravitons", "op": "product", "right": "second"}