c2e74fe2fd
The result that should have been visible for weeks. Measured on the new holdout_dev lane (500 real held-out cases) + sealed test: - real capability 0% (train_sample's 4 correct generalize to 0/500 held-out) - resolve_pooled (the composition substrate) commits 17.4% WRONG on held-out - NO structural gate (step/pool/op) separates its 2 correct from 87 wrong -> the composer cannot tell right readings from wrong; gating it is overfitting - the only wrong=0 policy on real GSM8K is refusal (current serving 0/0/500) Real lift needs a verifiable reading mechanism, not composer tuning. Non-serving (docs). |
||
|---|---|---|
| .. | ||
| adr | ||
| analysis | ||
| architecture | ||
| audit | ||
| brief | ||
| briefs | ||
| curriculum | ||
| decisions | ||
| evals | ||
| handoff | ||
| handoffs | ||
| implementation | ||
| plans | ||
| research | ||
| sessions | ||
| workbench | ||
| zig | ||
| admissibility-exemplars.md | ||
| audio_pipeline_overview.md | ||
| capability_roadmap.md | ||
| claims_ledger.md | ||
| ethics_packs.md | ||
| EVAL_AUDIT_2026-05-20.md | ||
| eval_methodology.md | ||
| formation_pipeline_plan.md | ||
| frontier_baselines.md | ||
| gaps.md | ||
| hitl-backpressure.md | ||
| holdout_recipients.txt | ||
| identity_packs.md | ||
| master-plan-post-substrate-audit.md | ||
| model_dependency_size_tally.md | ||
| pack_inventory_2026-05-21.md | ||
| position_paper.md | ||
| PROGRESS.md | ||
| recognizer-registry.md | ||
| refusal-taxonomy.md | ||
| reviewers.yaml | ||
| runtime_contracts.md | ||
| RUST.md | ||
| safety_packs.md | ||
| teaching_order.md | ||
| test-debt-quarantine.md | ||
| truth_seeking_schema.md | ||
| Whitepaper.md | ||
| Yellowpaper.md | ||