core-labs/core
core-labs/core
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
core/core/capability
History
Shay a13df6f370 feat: ADR-0119.8 — gsm8k_math overall lane gate (gsm8k_capability_shape) 
Phase 5.8 of ADR-0119. Composes the per-sub-phase substrate
(5.1..5.6) into a single per-split lane verdict the eventual
ADR-0120 expert promotion contract can consume.

LANE_SHAPE_REGISTRY adds:
  "gsm8k_math": "gsm8k_capability_shape"

_check_gsm8k_capability_shape refuses on any of:
  - missing cases_total / correct / wrong / refused fields
  - cases_total <= 0
  - wrong != 0                          (ADR-0114a Obligation #4)
  - correct + refused != cases_total    (accounting incomplete)
  - overall_pass present and false

Accepts otherwise. Edge: all-refused passes the shape gate (runner
self-consistency). Capability bar (min correct-rate, depth-curve
ε) lives in ADR-0120.

Live measurement on main:
  dev    50/50 correct, 0 wrong, 0 refused  → gate ✓
  public 150/150 correct, 0 wrong, 0 refused → gate ✓

21 invariant tests pin: registry mapping, shape checker presence,
live runner passes, nonzero wrong refuses, incomplete accounting
refuses, missing field refuses, clean metrics pass, all-refused
edge passes, all Phase 5.1..5.6 substrate artifacts exist on disk.

Phase 5 status: 5.1..5.6 + 5.8 ✓. Only 5.7 (sealed real GSM8K
test) remains before ADR-0120 (first expert promotion contract)
becomes feasible.

ADR-0114a roll-up unchanged: 10/10 obligations discharged on main
(modulo Phase 5.7's lane-specific GSM8K test sealing).

Tests: 21 new + 80 prior across Phase 5 + adjacent suites = 101
green; 67/67 smoke.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-22 19:45:44 -07:00
..
__init__.py feat(capability): implement ADR-0093 — Domain Pack Contract v1 wired in 2026-05-21 18:33:23 -07:00
domain_contract_predicates.py feat(packs): implement ADR-0097 — Mathematics-Logic Reasoning-Capable 2026-05-21 18:51:58 -07:00
domains.py Add chain-first capability ledger and domain seeds (#97) 2026-05-20 21:33:24 -07:00
expert_demo.py feat: ADR-0119.8 — gsm8k_math overall lane gate (gsm8k_capability_shape) 2026-05-22 19:45:44 -07:00
README.md feat: ADR-0113 rename expert-demo → audit-passed; reserve expert namespace (ADR-0114 GSM8K roadmap) 2026-05-22 15:36:10 -07:00
reporting.py feat: ADR-0113 rename expert-demo → audit-passed; reserve expert namespace (ADR-0114 GSM8K roadmap) 2026-05-22 15:36:10 -07:00
reviewers.py feat: ADR-0113 rename expert-demo → audit-passed; reserve expert namespace (ADR-0114 GSM8K roadmap) 2026-05-22 15:36:10 -07:00
sources.py Add chain-first capability ledger and domain seeds (#97) 2026-05-20 21:33:24 -07:00

README.md

Capability Reports

Phase A-C adds read-only capability reports. These commands do not mutate packs, execute dynamic validators, or flip dormant runtime flags.

Available commands:

  • core capability chains --json
  • core capability flags --json
  • core capability ledger --json
  • core capability artifact --lane cognition --split public --version v1 --json
  • core capability domain-contract --pack-id en_core_cognition_v1 --json
  • core capability evidence-plan --json

Day-1 output is expected to be low-status:

Domain Expected status Primary blocker
systems_software reasoning-capable audit-passed still gated by domain eval thresholds and replay/provenance evidence
mathematics_logic reasoning-capable audit-passed still gated by domain eval thresholds and replay/provenance evidence
physics reasoning-capable audit-passed still gated by domain eval thresholds and replay/provenance evidence
hebrew_greek_textual_reasoning reasoning-capable audit-passed still gated by eval thresholds and replay/provenance evidence
philosophy_theology reasoning-capable audit-passed still gated by eval thresholds and replay/provenance evidence

Status is generated from predicates. A blocked row lifts only when the named gap is closed and the next status predicate passes.