diff --git a/docs/analysis/gsm8k-workstream-a-increment-1-lookback-2026-06-17.md b/docs/analysis/gsm8k-workstream-a-increment-1-lookback-2026-06-17.md index 690b3463..757b9fc1 100644 --- a/docs/analysis/gsm8k-workstream-a-increment-1-lookback-2026-06-17.md +++ b/docs/analysis/gsm8k-workstream-a-increment-1-lookback-2026-06-17.md @@ -29,7 +29,7 @@ - Architectural invariants (relevant INV-21/22/23/24/29/30/31 + derivation scans): 98+ passed in the run (no new violations; .claude excluded per maintained discipline). - gsm8k train_sample proxy runner (x2, pre/post hygiene): 6/44/0, exit 1 per gate (correct <10), wrong=0. Reproducible. - Sealed SHA verifier: executed (proxy edits do not touch pinned practice lanes; full audit would be in the sealed PR sequence). -- Git surface (this PR's diff vs main): Limited to the scoped Workstream A files only: generate/derivation/extract.py, the teaching/admissibility_exemplars/*_v1.jsonl (after cleanup of pollution and dups), evals/gsm8k_math/train_sample/v1/report.json, and the three analysis docs for this increment (deep-dive ratif, Workstream A ratif, this lookback). Explicitly excludes CLOSE posture ratification MDs and runtime_contracts.md edits (prior work). Branch prepared for clean diff matching the honest PR body. +- Git surface (this PR's diff vs main): generate/derivation/extract.py, teaching/admissibility_exemplars/*_v1.jsonl (cleaned), tests/test_adr_0179_extract.py (new TestWorkstreamAReaderLexemeOnly class), evals/gsm8k_math/train_sample/v1/report.json (current run: 6/44/0), docs/analysis/gsm8k-derivation-reader-recognizer-lift-workstream-a-ratification-2026-06-17.md, docs/analysis/gsm8k-workstream-a-increment-1-lookback-2026-06-17.md, and docs/analysis/problem-solving-lift-strategic-deep-dive-ratification-2026-06-16.md (the two ratifs + lookback). The head after this commit matches the claims below. No conflict markers. Excludes unrelated posture/runtime_contracts files. ## Gaps / Follow-on (Honest Accounting, No Debt) - Proxy correct at 6 (lift from 4 cited in ratif); further movement requires the Phase C synthesis pass over the new 30+ seeds (or targeted injector extensions for rate_with_currency etc. in recognizer_anchor_inject.py). This is explicitly "subsequent increment" per the 2026-06-17 ratif. diff --git a/evals/gsm8k_math/train_sample/v1/report.json b/evals/gsm8k_math/train_sample/v1/report.json index 3f9409d3..a672dc9f 100644 --- a/evals/gsm8k_math/train_sample/v1/report.json +++ b/evals/gsm8k_math/train_sample/v1/report.json @@ -1,8 +1,8 @@ { "adr": "0126", "counts": { - "correct": 4, - "refused": 46, + "correct": 6, + "refused": 44, "wrong": 0 }, "exit_criterion": { @@ -153,8 +153,8 @@ }, { "case_id": "gsm8k-train-sample-v1-0029", - "reason": "candidate_graph: recognizer matched but produced no injection for statement: 'The cost of the keyboard was three times greater than the cost of the mouse.' (category=discrete_count_statement)", - "verdict": "refused" + "reason": "", + "verdict": "correct" }, { "case_id": "gsm8k-train-sample-v1-0030", @@ -198,8 +198,8 @@ }, { "case_id": "gsm8k-train-sample-v1-0038", - "reason": "candidate_graph: recognizer matched but produced no injection for statement: 'There are three times that many girls at a party being held on the second floor of the building.' (category=discrete_count_statement)", - "verdict": "refused" + "reason": "", + "verdict": "correct" }, { "case_id": "gsm8k-train-sample-v1-0039",