47a406b590
A confuser's `expected: refuse` does not mean unanswerable. Every confuser carries its true gold (`answer_numeric`) and is a solvable coverage target; `refuse` means "the reader can't yet comprehend this category, so refusing is the honest outcome — committing a WRONG value is the defect." Example: 0001 "buys a toy for 30 coins … how many left?" is plain 50-30=20; it is refuse only because today's reader takes `buys` as a gain. Adds §2.1 (graduation protocol): when a general mechanism reads a category correctly (validated on train_sample + the category, wrong=0 preserved), those cases graduate refuse -> solve and committing their gold becomes a win. Reframes the `spurious` verdict as "solved-before-graduation" (a graduation signal, with pair-consistency as the genuine-reading-vs-surface-match discriminator), not automatically a defect. Notes that no v1 category is degenerate, and how a truly-unanswerable case would be labelled (answer_numeric: null + degenerate: true) so the two senses of "refuse" stay distinguishable. Spec only; no corpus/runner change (today's commits are wrong-reading, so spurious stays flagged until a category genuinely graduates). |
||
|---|---|---|
| .. | ||
| adr | ||
| architecture | ||
| audit | ||
| briefs | ||
| curriculum | ||
| decisions | ||
| evals | ||
| handoff | ||
| handoffs | ||
| implementation | ||
| plans | ||
| research | ||
| sessions | ||
| workbench | ||
| admissibility-exemplars.md | ||
| capability_roadmap.md | ||
| ethics_packs.md | ||
| EVAL_AUDIT_2026-05-20.md | ||
| eval_methodology.md | ||
| formation_pipeline_plan.md | ||
| frontier_baselines.md | ||
| gaps.md | ||
| hitl-backpressure.md | ||
| holdout_recipients.txt | ||
| identity_packs.md | ||
| master-plan-post-substrate-audit.md | ||
| pack_inventory_2026-05-21.md | ||
| position_paper.md | ||
| PROGRESS.md | ||
| recognizer-registry.md | ||
| refusal-taxonomy.md | ||
| reviewers.yaml | ||
| runtime_contracts.md | ||
| RUST.md | ||
| safety_packs.md | ||
| teaching_order.md | ||
| test-debt-quarantine.md | ||
| truth_seeking_schema.md | ||
| Whitepaper.md | ||
| Yellowpaper.md | ||