Shay
|
a13df6f370
|
feat: ADR-0119.8 — gsm8k_math overall lane gate (gsm8k_capability_shape)
Phase 5.8 of ADR-0119. Composes the per-sub-phase substrate
(5.1..5.6) into a single per-split lane verdict the eventual
ADR-0120 expert promotion contract can consume.
LANE_SHAPE_REGISTRY adds:
"gsm8k_math": "gsm8k_capability_shape"
_check_gsm8k_capability_shape refuses on any of:
- missing cases_total / correct / wrong / refused fields
- cases_total <= 0
- wrong != 0 (ADR-0114a Obligation #4)
- correct + refused != cases_total (accounting incomplete)
- overall_pass present and false
Accepts otherwise. Edge: all-refused passes the shape gate (runner
self-consistency). Capability bar (min correct-rate, depth-curve
ε) lives in ADR-0120.
Live measurement on main:
dev 50/50 correct, 0 wrong, 0 refused → gate ✓
public 150/150 correct, 0 wrong, 0 refused → gate ✓
21 invariant tests pin: registry mapping, shape checker presence,
live runner passes, nonzero wrong refuses, incomplete accounting
refuses, missing field refuses, clean metrics pass, all-refused
edge passes, all Phase 5.1..5.6 substrate artifacts exist on disk.
Phase 5 status: 5.1..5.6 + 5.8 ✓. Only 5.7 (sealed real GSM8K
test) remains before ADR-0120 (first expert promotion contract)
becomes feasible.
ADR-0114a roll-up unchanged: 10/10 obligations discharged on main
(modulo Phase 5.7's lane-specific GSM8K test sealing).
Tests: 21 new + 80 prior across Phase 5 + adjacent suites = 101
green; 67/67 smoke.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-05-22 19:45:44 -07:00 |
|