Shay 684481910b audit(ADR-0136.S.2): refusal rescan v2 — barrier-shift ledger, subsumption directive pinned (#205) ... Measurement-only branch. Re-runs parse_and_solve on all 50 GSM8K train-sample cases against the current parser (post-S.1/S.2) and produces a barrier-shift ledger comparing v1 taxonomy to current behavior. Results: admitted=3/50 (0014, 0018, 0042), wrong=0, barrier_shifted=27/50. Context-filler dominance collapsed from 23→3 cases; compound_statement (6) and novel_initial_form (5) are now the largest buckets. Subsumption directive pinned: ADR-0137 SHALL re-derive all short-circuit admissions as (DeferredCandidate, evidence, BindingProof) triples.		2026-05-23 21:43:25 -07:00
..
adversarial_identity
anchor_lens_tour	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
anti_regression	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
articulation	feat(demo): core demo articulation — discourse-planner spine, end-to-end	2026-05-19 13:41:24 -07:00
articulation_of_status
audit_tour
calibration
classical_literature_ood
cognition	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
cold_start_grounding	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
compositionality
compound_intent_decomposition	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
contradiction_detection
conversation	feat(demo): humanise teaching-grounded surface for layperson display	2026-05-19 14:14:02 -07:00
conversational_thread_coherence	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
cross_domain_transfer
curriculum_loop_closure	feat(evals): ADR-0105 — sealed holdout encryption via age (#108)	2026-05-22 10:09:43 -07:00
demo_composition	feat(demos): implement ADR-0098 — Demo Composition Contract	2026-05-21 19:02:29 -07:00
deterministic_fluency
discourse_paragraph
domain_contract_validation	feat(capability): implement ADR-0093 — Domain Pack Contract v1 wired in	2026-05-21 18:33:23 -07:00
elementary_mathematics_ood	feat(capability): ADR-0110 promote mathematics_logic to expert_demo (#118)	2026-05-22 12:59:23 -07:00
english_fluency_ood
fabrication_control	feat: ADR-0119.1 — seal fabrication_control holdout with age encryption (Obligation #1)	2026-05-22 17:22:46 -07:00
forward_semantic_control
foundational_biology_ood
foundational_physics_ood	feat: ADR-0111 physics expert-demo promotion (second successful)	2026-05-22 14:37:36 -07:00
frontier_compare	feat(contemplation): land ADR-0080 phase 1 (#119)	2026-05-22 13:10:03 -07:00
grammatical_coverage
gsm8k_math	audit(ADR-0136.S.2): refusal rescan v2 — barrier-shift ledger, subsumption directive pinned (#205)	2026-05-23 21:43:25 -07:00
gsm8k_parser_dev	feat: add ADR-0125 perturbation suite	2026-05-22 17:12:33 -07:00
hebrew_fluency	feat(packs): ADR-0103 — attach hebrew_fluency + koine_greek_fluency lanes to ADR-0102 (#106)	2026-05-22 09:43:46 -07:00
identity_divergence
industry_demos	evals/industry_demos: add run_all.py suite runner	2026-05-21 08:23:29 -07:00
inference_closure	feat: ADR-0122 systems_software audit-passed deferred (lane-shape mismatch)	2026-05-22 16:31:59 -07:00
introspection
koine_greek_fluency	feat(packs): ADR-0103 — attach hebrew_fluency + koine_greek_fluency lanes to ADR-0102 (#106)	2026-05-22 09:43:46 -07:00
lab	research(evals): phi separation probe for ADR-0081 follow-up (#57)	2026-05-20 12:34:59 -07:00
learning_loop	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
long_context_cost	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
math_bounded_grammar/v1	feat(ADR-0131.3): bounded-grammar word-problem benchmark — lane PASSED 50/50 (#180)	2026-05-23 11:27:04 -07:00
math_capability_axes	feat(ADR-0136.S.1): rate/event statement parsing — capacity + earnings shapes, axis lane 20/20, wrong==0, gsm8k-0014 admits (#201)	2026-05-23 20:36:01 -07:00
math_expert_claims/v1	feat(ADR-0120 math, ledger flip): mathematics_logic → expert tier (first-ever) (#195)	2026-05-23 18:55:34 -07:00
math_symbolic_equivalence	feat(ADR-0131.1.F): frontier-baseline comparison harness for B1 (#178)	2026-05-23 12:14:06 -07:00
math_teaching_corpus/v1	feat(ADR-0131.2.B): B2 teaching-corpus enrichment — load-bearing gate (#177)	2026-05-23 11:29:48 -07:00
miner_loop_closure	feat(teaching): implement ADR-0095 — Miner-Sourced Teaching Proposals	2026-05-21 18:18:51 -07:00
monotonic_learning
multi_agent_composition
multi_sentence_response	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
multi_step_reasoning
obligation_2_ood_ratio	feat(ADR-0114a.2): OOD-ratio auditor — Obligation #2 wired for B3, ratio=1.00 (#193)	2026-05-23 16:25:28 -07:00
obligation_5_perturbation	feat(ADR-0114a.5): reasoning-isolation perturbation suite — Obligation #5 wired for B3, PASSING 130/130 preserving, 68/68 breaking (#191)	2026-05-23 16:07:59 -07:00
obligation_6_depth_curve	feat(ADR-0114a.6): depth-curve auditor — Obligation #6 wired for B3 (assertion holds, coverage gap named) (#190)	2026-05-23 16:19:58 -07:00
obligation_8_adversarial	feat(ADR-0114a.8): adversarial auditor — Obligation #8 wired, PASSING; surfaces 2 known parser-layer gaps (#192)	2026-05-23 16:11:37 -07:00
obligation_10_pack_provenance	feat(ADR-0114a.10): pack-provenance auditor — Obligation #10 wired for B3, PASSING	2026-05-23 15:44:53 -07:00
orthogonality_tour	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
prompt_diversity	feat(adr-0085): gloss-aware CAUSE composer — explanation frame from glosses (#70)	2026-05-20 15:55:08 -07:00
provenance
public_demo	feat: ADR-0111 physics expert-demo promotion (second successful)	2026-05-22 14:37:36 -07:00
realizer_guard	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
refusal_calibration
register_diagnostics	feat(evals): per-intent register-firing diagnostic + CI gate + tests (#103)	2026-05-21 07:05:23 -07:00
register_tour	feat(register): ADR-0077 — substantive register knobs + layering boundary (R6)	2026-05-19 23:39:11 -07:00
reports
results	feat: ADR-0086 + ADR-0087 + 100-register catalog — cognition lane closure	2026-05-21 00:08:12 -07:00
reviewer_registry	feat(capability): implement ADR-0092 — Reviewer Registry v1	2026-05-21 18:01:24 -07:00
sample_efficiency
self_consistency_over_time
symbolic_logic	feat: ADR-0122 systems_software audit-passed deferred (lane-shape mismatch)	2026-05-22 16:31:59 -07:00
teaching_injection_resistance
walkthrough_chain	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
warmed_session_consistency	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
zero_code_domain_acquisition
__init__.py
_parallel.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
baseline_runner.py
CLAIMS.md	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
cognition_cases.jsonl
framework.py	feat(evals): ADR-0105 — sealed holdout encryption via age (#108)	2026-05-22 10:09:43 -07:00
holdout_runner.py	feat(evals): ADR-0105 — sealed holdout encryption via age (#108)	2026-05-22 10:09:43 -07:00
metrics.py
parallel.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
run_cognition_eval.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00