7f6c497a21
Root cause of demo_composition pin thrash was not cancelled CI runs: verify_no_global_state_mutation dumped full env_subset before/after tuples into the lane report, embedding CORE_ENGINE_STATE_DIR temp paths (and any ambient CORE_* host values). Each hermetic run then produced a different report SHA. Fix for good: - Report key-level env deltas only (+/- / changed), with path-like CORE_* values redacted to <path> in the message text. - Detection still uses raw snapshots (mutations are not ignored). - Hermetic CORE_ENGINE_STATE_DIR for demo_composition and all verify_lane_shas invocations. - Dual-run-stable re-pin: demo_composition e2ba2314…, public_demo 7d8ba0db… (matches CI-observed soft-budget SHA). - Drop dead CORE_SHOWCASE_SKIP_BUDGET workflow env (soft is default). - Tests pin the delta format and hermetic-path stability. Lane: python scripts/verify_lane_shas.py → 9/9 match.
3.6 KiB
3.6 KiB
CLAIMS
Every row below is mechanically derived from in-tree state and
verified by CI. Tier 1 rows come from core.capability.ledger_report;
Tier 2 rows come from scripts/verify_lane_shas.py's pinned SHAs.
Tier 1 — Ratified domains
Each row asserts: the domain's packs pass all nine ADR-0091 contract
predicates, declared operator chains meet the ≥8 / ≥3-intent floor,
the reviewer registry resolves the primary reviewer, and the ledger
status predicate evaluates to reasoning-capable with no open gaps.
| Domain | Status | ADR | Packs | Open gaps |
|---|---|---|---|---|
philosophy_theology |
reasoning-capable | ADR-0085 | 2 | 0 |
mathematics_logic |
audit-passed | ADR-0097 | 1 | 0 |
physics |
audit-passed | ADR-0100 | 1 | 0 |
systems_software |
audit-passed | ADR-0101 | 1 | 0 |
hebrew_greek_textual_reasoning |
reasoning-capable | ADR-0102 | 4 | 0 |
Tier 2 — Pinned lane reports
Each row asserts: running the lane's runner produces a JSON
report whose SHA-256 matches the pinned value below. Mismatch
is a CI failure (.github/workflows/lane-shas.yml).
| ADR | Lane | Purpose | Report path | Pinned SHA-256 |
|---|---|---|---|---|
| ADR-0092 | reviewer_registry |
Reviewer registry schema validates + bootstrap entry self-seals | evals/reviewer_registry/results/v1_dev.json |
681a2aab5aa4ffd58cd837ce5673c8b2a9545b570117aec3c02726a12f6876e6 |
| ADR-0093 | domain_contract_validation |
All ratified packs satisfy the 9 ADR-0091 contract predicates | evals/domain_contract_validation/results/v1_dev.json |
98ace04e3f02bbc5a8ad655bb6593c3f1ee64cb67014f1122fe6c3c85f48d22f |
| ADR-0095 | miner_loop_closure |
Miner-sourced proposals route through single reviewed teaching path | evals/miner_loop_closure/results/v1_dev.json |
9f071733abe7dcacf759f928548ce738fb639af3fd6e4c621a651b306d7e77ce |
| ADR-0096 | fabrication_control_summary |
Phantom endpoints / cross-pack non-bridges / sibling collapses refuse | evals/fabrication_control/results/v1_summary.json |
01e1b6b711141f2b4a14551d7df3ea482d8d6dd7b364a25c509f4f8d08cda8a8 |
| ADR-0098 | demo_composition |
Demos compose from shipped modules; no parallel mechanism | evals/demo_composition/results/v1_dev.json |
e2ba2314d8768459fb6a8db082a4bbcf4107b5161d869804a4b2a33c3724081a |
| ADR-0099 | public_demo |
Public showcase runs deterministically under 30s; all claims supported | evals/public_demo/results/v1_dev.json |
7d8ba0dbae9287cfe0bf15d231fa78a75abc627121c14900439293e01e1cc1d3 |
| ADR-0104 | curriculum_loop_closure |
Curriculum-sourced proposals route through single reviewed teaching path | evals/curriculum_loop_closure/results/v1_dev.json |
b46d56b2d209172cc3ffaf3776dc8dcfe55093f13587c5cb67372be6dfa23e8d |
| ADR-0131 | math_teaching_corpus_v1 |
Math teaching corpus replays deterministically; all chains pass exit criterion (correct_rate=1.0, wrong=0) | evals/math_teaching_corpus/v1/report.json |
eaf160d145da29f9050ede8d58bf111b0f651dd40aeae9201857d0b97e014dd4 |
| ADR-0206 | deductive_logic_v1 |
Propositional entailment scored against an independent truth-table oracle; dev+holdout+external 716/716 correct, wrong=0, refused=0 | evals/deductive_logic/report.json |
97a230949016e38d5e3f37a69e4245b320575ee70e5af92ff7607f7b05f74b5f |
Verification
python3 scripts/verify_lane_shas.py # verify all Tier 2 SHAs
core test --suite full -q # exercises Tier 1 invariants