38ee0854fc
Archaeology (six worktree measurements) shows public_demo's stale pin (7d8ba0db..., last set 2026-07-14) predates two commits that changed its content deterministically:e7d116c9(trace-hash format widening, benign) ande0d1b475(the register-axis regression's introduction, benign for this lane at that point). But starting at5a343b49(T13's back-stamp, 2026-07-22) public_demo's own all_claims_supported case genuinely FAILS and stays failing through5224b5e0(2026-07-24), fixed only as a side effect of PR #110's unrelated register-axis restoration (f95ac26e) — public_demo embeds the same register-tour scene demo_composition does. The standing "public_demo red = the env-timeout flake, ignore it" memory was true only for the runtime_under_budget case; it caused this real all_claims_supported regression to hide for two days behind the same label. Corrected the memory to triage by which case failed, not by lane name. Re-pinned to da7fad65... (current main, 4/4 passing, verified stable across three independent measurements) and regenerated CLAIMS.md.
54 lines
4.2 KiB
Markdown
54 lines
4.2 KiB
Markdown
# CLAIMS
|
|
|
|
<!--
|
|
AUTO-GENERATED by scripts/generate_claims.py.
|
|
Do not hand-edit. Run `python3 scripts/generate_claims.py` to
|
|
regenerate after any change to the capability ledger or pinned
|
|
lane SHAs (scripts/verify_lane_shas.py).
|
|
-->
|
|
|
|
Every row below is mechanically derived from in-tree state and
|
|
verified by CI. Tier 1 rows come from `core.capability.ledger_report`;
|
|
Tier 2 rows come from `scripts/verify_lane_shas.py`'s pinned SHAs.
|
|
|
|
## Tier 1 — Ratified domains
|
|
|
|
Each row asserts: the domain's packs pass all nine ADR-0091 contract
|
|
predicates, declared operator chains meet the ≥8 / ≥3-intent floor,
|
|
the reviewer registry resolves the primary reviewer, and the ledger
|
|
status predicate evaluates to `reasoning-capable` with no open gaps.
|
|
|
|
| Domain | Status | ADR | Packs | Open gaps |
|
|
| --- | --- | --- | --- | --- |
|
|
| `philosophy_theology` | reasoning-capable | ADR-0085 | 2 | 0 |
|
|
| `mathematics_logic` | audit-passed | ADR-0097 | 1 | 0 |
|
|
| `physics` | audit-passed | ADR-0100 | 1 | 0 |
|
|
| `systems_software` | audit-passed | ADR-0101 | 1 | 0 |
|
|
| `hebrew_greek_textual_reasoning` | reasoning-capable | ADR-0102 | 4 | 0 |
|
|
|
|
## Tier 2 — Pinned lane reports
|
|
|
|
Each row asserts: running the lane's runner produces a JSON
|
|
report whose SHA-256 matches the pinned value below. Mismatch
|
|
is a CI failure (`.github/workflows/lane-shas.yml`).
|
|
|
|
| ADR | Lane | Purpose | Report path | Pinned SHA-256 |
|
|
| --- | --- | --- | --- | --- |
|
|
| ADR-0092 | `reviewer_registry` | Reviewer registry schema validates + bootstrap entry self-seals | `evals/reviewer_registry/results/v1_dev.json` | `681a2aab5aa4ffd58cd837ce5673c8b2a9545b570117aec3c02726a12f6876e6` |
|
|
| ADR-0093 | `domain_contract_validation` | All ratified packs satisfy the 9 ADR-0091 contract predicates | `evals/domain_contract_validation/results/v1_dev.json` | `98ace04e3f02bbc5a8ad655bb6593c3f1ee64cb67014f1122fe6c3c85f48d22f` |
|
|
| ADR-0095 | `miner_loop_closure` | Miner-sourced proposals route through single reviewed teaching path | `evals/miner_loop_closure/results/v1_dev.json` | `537094fe21d7e6cfbaf42bfc32b82d669fa9bb05a132d2bc93c72b3ceb7762a6` |
|
|
| ADR-0096 | `fabrication_control_summary` | Phantom endpoints / cross-pack non-bridges / sibling collapses refuse | `evals/fabrication_control/results/v1_summary.json` | `01e1b6b711141f2b4a14551d7df3ea482d8d6dd7b364a25c509f4f8d08cda8a8` |
|
|
| ADR-0098 | `demo_composition` | Demos compose from shipped modules; no parallel mechanism | `evals/demo_composition/results/v1_dev.json` | `f0611a2ce41721dd40767fc6a83a08470d3c7fd7fc8f1ae8ba003abf8a25ec97` |
|
|
| ADR-0099 | `public_demo` | Public showcase runs deterministically under 30s; all claims supported | `evals/public_demo/results/v1_dev.json` | `da7fad654e77aac4573a6fcf6e9eaaf84540be8e135d2e033d9cfd15119df3fc` |
|
|
| ADR-0104 | `curriculum_loop_closure` | Curriculum-sourced proposals route through single reviewed teaching path | `evals/curriculum_loop_closure/results/v1_dev.json` | `cb94ca0042d78ec2624129ff6493d52e767b69feea32d2997b85d88f1c0883af` |
|
|
| ADR-0131 | `math_teaching_corpus_v1` | Math teaching corpus replays deterministically; all chains pass exit criterion (correct_rate=1.0, wrong=0) | `evals/math_teaching_corpus/v1/report.json` | `eaf160d145da29f9050ede8d58bf111b0f651dd40aeae9201857d0b97e014dd4` |
|
|
| ADR-0206 | `deductive_logic_v1` | Propositional entailment scored against an independent truth-table oracle; dev+holdout+external 716/716 correct, wrong=0, refused=0 | `evals/deductive_logic/report.json` | `97a230949016e38d5e3f37a69e4245b320575ee70e5af92ff7607f7b05f74b5f` |
|
|
| ADR-0256 | `deduction_serve_v1` | Flag-gated deduction serving decides real English/member/fused/verb/existential arguments end-to-end under earned SERVE licenses; wrong=0 across all splits | `evals/deduction_serve/report.json` | `0b461a5a49c8f8260ca87d0c9c9f9a17232bd1fdedd982e34649eedf9cca30b5` |
|
|
| ADR-0262 | `curriculum_serve_v1` | Flag-gated curriculum serving answers exam questions from a subject's RATIFIED chain corpus only; untaught facts return UNKNOWN (anti-recall probes enforced), wrong=0 | `evals/curriculum_serve/report.json` | `d9e7ba500f040b865870413a940ee9a49910ac22e1a89c9feec1a60bdd2513f1` |
|
|
|
|
## Verification
|
|
|
|
```bash
|
|
python3 scripts/verify_lane_shas.py # verify all Tier 2 SHAs
|
|
core test --suite full -q # exercises Tier 1 invariants
|
|
```
|