Shay 53573263cb feat(adr-0181-p4): audio compiler eval gate lane (sensorium/audio) (#470) ... PR-4 of ADR-0181. The acceptance-gate lane that decides whether audio_core_v1's gate may open. Deterministic synthesis-spec fixtures (no .wav blobs) with predicted parses, so the gates grade parser semantics as well as determinism. evals/audio_sensorium/: - synth.py deterministic fixture synthesis (PCG64 + float32-at-boundary) - fixtures.json 5 specs: silence, rising-pitch question, falling statement, noise burst, speech-then-pause - generate_expected.py reproducible pin generator (uv run -m ...) - expected_ir.jsonl frozen canonical_sha256 + ir_sha256 + event_type_counts - expected_projection.json frozen projection_sha256 + reference versor tests/test_audio_eval_gates.py (12): the gate table per fixture — shape/dtype, versor_condition<1e-6, within-run replay, canonical-checksum stability (hard int/cast-stable pin), IR-replay + frozen ir_sha256, semantic event_type_counts (parser-accuracy gate), and cross-platform versor stability within atol=1e-6 of the reference (float-safe per eval plan); plus trace hygiene and gate-closure refusal. Verified semantics: rise→prosody.rise, fall→prosody.fall, silence→pause.long+ turn.boundary, noise→nonspeech.noise, speech_then_pause→all three. Cross-platform note: int/quantized-derived hashes are pinned hard; the float versor is compared within tolerance rather than hash-pinned, since cos/sin/ geometric_product can differ by a ULP across arches. This is the eval-plan's "equal within declared numeric tolerance" reading — keeps CI stable. All audio 44 + arch-invariants 40 + smoke 67 green. No core mutation.		2026-05-29 11:20:31 -07:00
..
adversarial_identity	docs(identity): empirical finding — fix #3 needs upstream ingest-gate work	2026-05-16 14:23:20 -07:00
anchor_lens_tour	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
anti_regression	feat(epistemic): Phase 3 state tagging spine (#220)	2026-05-24 11:26:06 -07:00
articulation	feat(demo): core demo articulation — discourse-planner spine, end-to-end	2026-05-19 13:41:24 -07:00
articulation_of_status	feat(epistemic): realizer-side closure — refusal_calibration + articulation_of_status graduate	2026-05-17 10:12:59 -07:00
audio_sensorium	feat(adr-0181-p4): audio compiler eval gate lane (sensorium/audio) (#470)	2026-05-29 11:20:31 -07:00
audit_tour	feat(adr-0042): audit-tour demo — pack-layer story in four scenes	2026-05-17 22:06:45 -07:00
calibration	fix(gaps): close G1+G2+G3 + identity vocab + pipeline safety-stub honour	2026-05-16 21:21:06 -07:00
classical_literature_ood	fix(gaps): close G1+G2+G3 + identity vocab + pipeline safety-stub honour	2026-05-16 21:21:06 -07:00
cognition	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
cold_start_grounding	fix(quarantine): drain all 60 quarantined tests — QUARANTINE=∅ (#267)	2026-05-25 11:22:12 -07:00
compositionality	feat(compositionality): compose_relations operator lifts lane 68.8% → 100%	2026-05-16 22:44:06 -07:00
compound_intent_decomposition	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
contemplation_quality	feat(W-025): contemplation quality eval lane (ADR-0159) (#286)	2026-05-25 20:38:52 -07:00
contradiction_detection	feat(epistemic): contradiction coherence checker — CONTESTED transitions wired, last Tier 4.5 row closes	2026-05-17 10:36:48 -07:00
conversation	feat(demo): humanise teaching-grounded surface for layperson display	2026-05-19 14:14:02 -07:00
conversational_thread_coherence	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
cross_domain_transfer	feat(algebra): null-preserving versor_apply path + un-skip 2 invariant tests	2026-05-16 21:40:37 -07:00
curriculum_loop_closure	feat(evals): ADR-0105 — sealed holdout encryption via age (#108)	2026-05-22 10:09:43 -07:00
demo_composition	fix(W-015): replace _slerp_toward with rotor-geodesic anchor pull (#255)	2026-05-24 20:05:25 -07:00
deterministic_fluency	feat(evals): deterministic_fluency lane — six structural predicates	2026-05-19 07:16:44 -07:00
discourse_paragraph	feat(compositionality): compose_relations operator lifts lane 68.8% → 100%	2026-05-16 22:44:06 -07:00
domain_contract_validation	chore(ci): re-pin drifted lane SHAs + refresh canonical reports (#229)	2026-05-24 14:25:11 -07:00
elementary_mathematics_ood	feat(capability): ADR-0110 promote mathematics_logic to expert_demo (#118)	2026-05-22 12:59:23 -07:00
english_fluency_ood	fix(gaps): close G1+G2+G3 + identity vocab + pipeline safety-stub honour	2026-05-16 21:21:06 -07:00
fabrication_control	chore(ci): re-pin drifted lane SHAs + refresh canonical reports (#229)	2026-05-24 14:25:11 -07:00
flywheel_demo	feat(demo): core demo flywheel — public-proof reproduction of the loop	2026-05-27 21:33:54 -07:00
forward_semantic_control	docs(cli): self-explanatory demos — preambles + per-directory READMEs	2026-05-17 16:39:50 -07:00
foundational_biology_ood	fix(gaps): close G1+G2+G3 + identity vocab + pipeline safety-stub honour	2026-05-16 21:21:06 -07:00
foundational_physics_ood	feat: ADR-0111 physics expert-demo promotion (second successful)	2026-05-22 14:37:36 -07:00
frontier_compare	feat(contemplation): land ADR-0080 phase 1 (#119)	2026-05-22 13:10:03 -07:00
grammatical_coverage	fix(gaps): close G1+G2+G3 + identity vocab + pipeline safety-stub honour	2026-05-16 21:21:06 -07:00
gsm8k_math	feat(adr-0163-f2): confuser corpus v1 + discrimination-probe runner (#471)	2026-05-29 11:13:49 -07:00
gsm8k_parser_dev	feat: add ADR-0125 perturbation suite	2026-05-22 17:12:33 -07:00
hebrew_fluency	feat(packs): ADR-0103 — attach hebrew_fluency + koine_greek_fluency lanes to ADR-0102 (#106)	2026-05-22 09:43:46 -07:00
identity_divergence	feat(adr-0043): Phase-2 pack measurements — claims → numbers	2026-05-17 22:19:24 -07:00
industry_demos	evals/industry_demos: add run_all.py suite runner	2026-05-21 08:23:29 -07:00
inference_closure	feat: ADR-0122 systems_software audit-passed deferred (lane-shape mismatch)	2026-05-22 16:31:59 -07:00
introspection	feat(phase3): core/cognition/explain.py — close Gap 3 introspection	2026-05-16 15:09:48 -07:00
koine_greek_fluency	feat(packs): ADR-0103 — attach hebrew_fluency + koine_greek_fluency lanes to ADR-0102 (#106)	2026-05-22 09:43:46 -07:00
lab	research(evals): phi separation probe for ADR-0081 follow-up (#57)	2026-05-20 12:34:59 -07:00
learning_arc	fix(W-025): polish contemplation-quality eval lane follow-ups (#290)	2026-05-26 09:39:18 -07:00
learning_loop	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
long_context_cost	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
math_bounded_grammar/v1	feat(ADR-0131.3): bounded-grammar word-problem benchmark — lane PASSED 50/50 (#180)	2026-05-23 11:27:04 -07:00
math_capability_axes	feat(ADR-0163.D.4): question grammar extension — mass nouns, comparatives, pronoun-entity resolution (#310)	2026-05-26 16:19:37 -07:00
math_expert_claims/v1	fix(quarantine): drain all 60 quarantined tests — QUARANTINE=∅ (#267)	2026-05-25 11:22:12 -07:00
math_symbolic_equivalence	feat(ADR-0131.1.F): frontier-baseline comparison harness for B1 (#178)	2026-05-23 12:14:06 -07:00
math_teaching_corpus/v1	feat(ADR-0131.2.B): B2 teaching-corpus enrichment — load-bearing gate (#177)	2026-05-23 11:29:48 -07:00
miner_loop_closure	feat(teaching): implement ADR-0095 — Miner-Sourced Teaching Proposals	2026-05-21 18:18:51 -07:00
monotonic_learning	feat(evals): v3 lanes — monotonic-learning passes, adversarial-identity reveals gap	2026-05-16 13:42:47 -07:00
multi_agent_composition	fix(gaps): close G1+G2+G3 + identity vocab + pipeline safety-stub honour	2026-05-16 21:21:06 -07:00
multi_sentence_response	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
multi_step_reasoning	feat(algebra): null-preserving versor_apply path + un-skip 2 invariant tests	2026-05-16 21:40:37 -07:00
obligation_2_ood_ratio	feat(ADR-0114a.2): OOD-ratio auditor — Obligation #2 wired for B3, ratio=1.00 (#193)	2026-05-23 16:25:28 -07:00
obligation_5_perturbation	feat(ADR-0114a.5): reasoning-isolation perturbation suite — Obligation #5 wired for B3, PASSING 130/130 preserving, 68/68 breaking (#191)	2026-05-23 16:07:59 -07:00
obligation_6_depth_curve	feat(ADR-0114a.6): depth-curve auditor — Obligation #6 wired for B3 (assertion holds, coverage gap named) (#190)	2026-05-23 16:19:58 -07:00
obligation_8_adversarial	feat(ADR-0114a.8): adversarial auditor — Obligation #8 wired, PASSING; surfaces 2 known parser-layer gaps (#192)	2026-05-23 16:11:37 -07:00
obligation_10_pack_provenance	feat(ADR-0114a.10): pack-provenance auditor — Obligation #10 wired for B3, PASSING	2026-05-23 15:44:53 -07:00
orthogonality_tour	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
prompt_diversity	feat(adr-0085): gloss-aware CAUSE composer — explanation frame from glosses (#70)	2026-05-20 15:55:08 -07:00
provenance	feat(evals): parallel runner + adversarial-identity v2	2026-05-16 13:10:26 -07:00
public_demo	chore(ratify): accept four Phase C round-2 recognizers (round 2) (#309)	2026-05-26 16:03:01 -07:00
realizer_guard	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
refusal_calibration	feat(adr-0043): Phase-2 pack measurements — claims → numbers	2026-05-17 22:19:24 -07:00
refusal_taxonomy	feat(ADR-0163.B.2): four new exemplar corpora — discrete_count_statement, multiplicative_aggregation, currency_amount, plus temporal_aggregation v2 widening (#306)	2026-05-26 14:36:59 -07:00
register_diagnostics	feat(evals): per-intent register-firing diagnostic + CI gate + tests (#103)	2026-05-21 07:05:23 -07:00
register_tour	feat(register): ADR-0077 — substantive register knobs + layering boundary (R6)	2026-05-19 23:39:11 -07:00
reports	feat(adr-0023): Forward Semantic Control proof evidence — Accepted	2026-05-17 12:55:19 -07:00
results	feat: ADR-0086 + ADR-0087 + 100-register catalog — cognition lane closure	2026-05-21 00:08:12 -07:00
reviewer_registry	feat(capability): implement ADR-0092 — Reviewer Registry v1	2026-05-21 18:01:24 -07:00
sample_efficiency	feat(phase4): sample-efficiency v1 — first quantitative-curve lane	2026-05-16 15:39:28 -07:00
self_consistency_over_time	feat(runtime+evals): warm-path pack grounding + three long-span lanes	2026-05-19 08:26:38 -07:00
symbolic_logic	feat: ADR-0122 systems_software audit-passed deferred (lane-shape mismatch)	2026-05-22 16:31:59 -07:00
teaching_injection_resistance	feat(epistemic): truth-seeking schema audit — 3 leaks closed, 4 new lanes, 3 new invariants	2026-05-17 07:27:41 -07:00
walkthrough_chain	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
warmed_session_consistency	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
zero_code_domain_acquisition	feat began creation of zero code domain acquisition. did not complete yet.	2026-05-16 06:31:01 -07:00
__init__.py
_parallel.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
baseline_runner.py	feat(evals): frontier structural-zero baselines for Phase 2 v1 lanes	2026-05-16 12:45:28 -07:00
CLAIMS.md	chore(evals): contracts + bench json + Lane B viewer + chart + audit + demo schema (#62)	2026-05-20 13:53:13 -07:00
cognition_cases.jsonl
framework.py	feat(evals): ADR-0105 — sealed holdout encryption via age (#108)	2026-05-22 10:09:43 -07:00
holdout_runner.py	feat(evals): ADR-0105 — sealed holdout encryption via age (#108)	2026-05-22 10:09:43 -07:00
metrics.py
parallel.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
run_cognition_eval.py	feat(W-008): L10 Shape B hybrid engine-state persistence (#271)	2026-05-25 11:45:54 -07:00