5cad0a4b72
First worked expert-demo promotion under the ADR-0106 + ADR-0109
contract. Math is now the first domain at expert_demo=true.
Signed claim (docs/reviewers.yaml):
domain_id: mathematics_logic
evidence_lanes: [elementary_mathematics_ood, inference_closure,
fabrication_control]
evidence_revision: adr-0110:reviewed:2026-05-22
signed_by: shay-j
claim_digest: 94d74781e103854230c1a71590e4df2287f5d2e87832f1c29b8ec4618853c04b
Evidence (all three lanes, public + holdout):
elementary_mathematics_ood: accuracy=1.0 (117/117 public, 39/39 holdout)
inference_closure: all_pass_rate=1.0, replay_determinism=1.0,
overall_pass=True (20 public, 12 holdout)
fabrication_control: by-class refusals 3/3/3, fabricated=0
(9 public, 9 holdout)
Infrastructure bridges (not contract changes):
- cases_plaintext.jsonl dev-mode fallback files for
elementary_mathematics_ood + inference_closure (ADR-0105 pattern)
- 9 new holdout cases for fabrication_control across all three
refusal classes (phantom_endpoint / cross_pack_non_bridge /
sibling_collapse)
- core/capability/reporting.py: _fetch_lane_split folds top-level
by_class into metrics so refusal_shape sees a canonical layout
Tests:
- tests/test_adr_0110_math_expert_demo.py: 4 invariant tests
(math_expert_demo_holds, signed_claim_present, replay_digest_
byte_equality, other_domains_unaffected)
- tests/test_adr_0107_deferral.py retired (deferral resolved)
- tests/test_expert_demo_contract.py: production-ledger test
rewritten as 'every promoted domain has signed claim' (load-
bearing invariant preserved)
- tests/test_capability_reports.py: math row asserted at
expert-demo (was reasoning-capable)
Ledger state:
systems_software: reasoning-capable
mathematics_logic: EXPERT-DEMO <- new
physics: reasoning-capable
hebrew_greek_textual_reasoning: reasoning-capable
philosophy_theology: reasoning-capable
README updated. ADR-0107 referenced as resolved by this ADR.
CLAIMS.md regenerated. ADR-0106 / ADR-0109 contract unchanged.
50 lines
3.1 KiB
Markdown
50 lines
3.1 KiB
Markdown
# CLAIMS
|
|
|
|
<!--
|
|
AUTO-GENERATED by scripts/generate_claims.py.
|
|
Do not hand-edit. Run `python3 scripts/generate_claims.py` to
|
|
regenerate after any change to the capability ledger or pinned
|
|
lane SHAs (scripts/verify_lane_shas.py).
|
|
-->
|
|
|
|
Every row below is mechanically derived from in-tree state and
|
|
verified by CI. Tier 1 rows come from `core.capability.ledger_report`;
|
|
Tier 2 rows come from `scripts/verify_lane_shas.py`'s pinned SHAs.
|
|
|
|
## Tier 1 — Ratified domains
|
|
|
|
Each row asserts: the domain's packs pass all nine ADR-0091 contract
|
|
predicates, declared operator chains meet the ≥8 / ≥3-intent floor,
|
|
the reviewer registry resolves the primary reviewer, and the ledger
|
|
status predicate evaluates to `reasoning-capable` with no open gaps.
|
|
|
|
| Domain | Status | ADR | Packs | Open gaps |
|
|
| --- | --- | --- | --- | --- |
|
|
| `philosophy_theology` | reasoning-capable | ADR-0085 | 2 | 0 |
|
|
| `mathematics_logic` | expert-demo | ADR-0097 | 1 | 0 |
|
|
| `physics` | reasoning-capable | ADR-0100 | 1 | 0 |
|
|
| `systems_software` | reasoning-capable | ADR-0101 | 1 | 0 |
|
|
| `hebrew_greek_textual_reasoning` | reasoning-capable | ADR-0102 | 4 | 0 |
|
|
|
|
## Tier 2 — Pinned lane reports
|
|
|
|
Each row asserts: running the lane's runner produces a JSON
|
|
report whose SHA-256 matches the pinned value below. Mismatch
|
|
is a CI failure (`.github/workflows/lane-shas.yml`).
|
|
|
|
| ADR | Lane | Purpose | Report path | Pinned SHA-256 |
|
|
| --- | --- | --- | --- | --- |
|
|
| ADR-0092 | `reviewer_registry` | Reviewer registry schema validates + bootstrap entry self-seals | `evals/reviewer_registry/results/v1_dev.json` | `681a2aab5aa4ffd58cd837ce5673c8b2a9545b570117aec3c02726a12f6876e6` |
|
|
| ADR-0093 | `domain_contract_validation` | All ratified packs satisfy the 9 ADR-0091 contract predicates | `evals/domain_contract_validation/results/v1_dev.json` | `f9c06cdeea8fb36a0d3c320007618c3afc92d67702ef31bd36ebd9ae9ced473f` |
|
|
| ADR-0095 | `miner_loop_closure` | Miner-sourced proposals route through single reviewed teaching path | `evals/miner_loop_closure/results/v1_dev.json` | `9f071733abe7dcacf759f928548ce738fb639af3fd6e4c621a651b306d7e77ce` |
|
|
| ADR-0096 | `fabrication_control_summary` | Phantom endpoints / cross-pack non-bridges / sibling collapses refuse | `evals/fabrication_control/results/v1_summary.json` | `01e1b6b711141f2b4a14551d7df3ea482d8d6dd7b364a25c509f4f8d08cda8a8` |
|
|
| ADR-0098 | `demo_composition` | Demos compose from shipped modules; no parallel mechanism | `evals/demo_composition/results/v1_dev.json` | `27d838241bf3ed9e15d0e918ec6d89a823494d7e17c2dab9777825af7188f20f` |
|
|
| ADR-0099 | `public_demo` | Public showcase runs deterministically under 30s; all claims supported | `evals/public_demo/results/v1_dev.json` | `4be6f47509435a24984713acfcebd88e61f4e1278096fa5dc88a09e8af2f87ba` |
|
|
| ADR-0104 | `curriculum_loop_closure` | Curriculum-sourced proposals route through single reviewed teaching path | `evals/curriculum_loop_closure/results/v1_dev.json` | `b46d56b2d209172cc3ffaf3776dc8dcfe55093f13587c5cb67372be6dfa23e8d` |
|
|
|
|
## Verification
|
|
|
|
```bash
|
|
python3 scripts/verify_lane_shas.py # verify all Tier 2 SHAs
|
|
core test --suite full -q # exercises Tier 1 invariants
|
|
```
|