core/docs/analysis
Shay 80240ea9b8
feat(derivation): Workstream A inc 1 — lexeme reader + cleaned exemplars + proxy rebaseline (#796)
* feat(derivation): Workstream A inc 1 — lexeme-only reader components for fractions/comparatives + cleaned Phase B exemplars + proxy rebaseline (ratified, post-review fixes)

- generate/derivation/extract.py: lexeme-only passes (surface tokens only; no synthesized values or non-surface source_tokens for "half of", "X/Y of", "X more/less than"). Composition deferred per module contract (ADR-0165). Hygiene and EX-6 preserved. Docstring updated.
- teaching/admissibility_exemplars/*_v1.jsonl: grown + cleaned (removed category-polluted seeds, deduplicated ma IDs, fixed comparative exemplar to surface tokens per lexeme rule).
- evals/gsm8k_math/train_sample/v1/report.json: rebaselined after fixes (runner executed; wrong=0 held).
- docs/analysis/*-2026-06-1[6-7].md + lookback: ratif + honest post-review lookback (local paths removed, scope claims match actual clean diff, extractor/exemplar fixes documented).

Governing: the two 2026-06-16/17 ratifications (included; local session path replaced with stable ref). Scope per ratif: reader (lexeme) + exemplar growth (clean) + rebaseline + tests + lookback. No sealed, no CLOSE (deferred), 0 wrong.

Added tests in test_adr_0179_extract.py for new lexeme paths + grounding.

Branch prepared clean from origin/main; diff limited to scoped files only (no posture ratif, no runtime_contracts drift).

See updated lookback and PR body for full evidence (6/44/0 or current post-fix,  tests green, etc.).

(Addresses review: Semantic Rigor restored, branch hygiene, exemplar quality, tests, docs.)

* fix(review): resolve all verifiability blockers

- generate/derivation/extract.py: conflict markers removed (was from stash); lexeme-only implementation confirmed clean.
- tests/test_adr_0179_extract.py: added TestWorkstreamAReaderLexemeOnly class with direct tests for half-of, fraction-of, more/less components, source_token grounding, no-synthesis invariants.
- evals/gsm8k_math/train_sample/v1/report.json: fresh rebaseline via runner with fixed code (6/44/0, wrong=0).
- docs/analysis/gsm8k-workstream-a-increment-1-lookback-2026-06-17.md: updated to exactly match the actual diff and actual report numbers on this head.
- No conflict markers remain in extract, tests, lookback, ratifs, or exemplars (verified by grep).
- Branch head now clean and matches all claims in PR body/lookback.

This is the verifiable head for the lead engineer review.

* fix(test): make lexeme-only half test case-insensitive on source_token to match actual extraction (preserves input casing like other EX tests)

* fix(review): commit current report.json (6/44/0 from runner) and updated lookback so they appear in branch diff; lookback now exactly matches actual files in git diff --name-only and actual test count (29) and report numbers.

* fix(review): precise fractional doc in extract contract (normalizes factors while preserving source_token; comparative deferred); remove stale comparative sum/diff comments; lookback exact reality (29/29 tests, no deep-dive in diff, no sum/diff claim); mark remaining exemplars REVIEW-REQUIRED/ambiguous with explicit notes. Small final patch.

* fix(exemplars): remove three REVIEW-REQUIRED ambiguous-but-machine-admissible seeds (rwc-v1-0022, rwc-v1-0023, ma-v1-0024) from ingested JSONL to eliminate synthesis-poisoning risk per final review. Update lookback wording for actual seed count and rationale. Small final patch.

* docs(lookback): align exemplar category list with actual diff (only dcs/rwc/ma touched in this increment; no ca/ta/dsnq changes)
2026-06-16 21:57:05 -07:00
..
adr-0184-replay-provenance-equivalence-harness-2026-06-10.md test(derivation): add ADR-0184 semantic replay equivalence harness 2026-06-10 14:35:22 -07:00
adr-0184-s3-s5-candidate-source-boundary-2026-06-10.md feat(derivation): define semantic-ledger candidate source boundary 2026-06-10 13:17:53 -07:00
afferent-field-ingest-scope-2026-06-15.md feat(l10): autonomous idle frontier-contemplation — the always-on life learns on its own (#758) 2026-06-14 23:59:49 -07:00
AGI-candidacy-autonomous-improvement-roadmap-2026-06-05.md docs(design): L10/L11 lived-spine design records + AGI-candidacy roadmap 2026-06-05 15:11:08 -07:00
AGI-spine-refined-sequencing-2026-06-06.md work done towards furthering comprehension, contemplation, learning, and also began working on fixing some failing tests 2026-06-16 12:27:59 -07:00
ask-runtime-wiring-missing-boundary-2026-06-10.md docs(ask): document missing runtime ASK provider boundary 2026-06-10 09:23:04 -07:00
ask-serving-integration-scoping-2026-06-08.md docs(epistemic): scope ASK and VERIFIED serving gates 2026-06-08 22:22:35 -07:00
ask-serving-integration-scoping-2026-06-09.md docs(epistemic): tighten pass_manager scoping wording and use relative links 2026-06-09 09:26:49 -07:00
b4-frameverdict-implementation-lookback-2026-06-15.md feat(frame-verdict): closed-world FrameVerdict substrate — PR-1..4 + hardening (ADR-0222 B4) (#787) 2026-06-16 06:23:03 -07:00
close-derived-climb-yardstick-claim-b-ratification-2026-06-16.md feat(eval): harden close-derived-climb yardstick to full Claim B (#791) 2026-06-16 17:10:11 -07:00
close-derived-facts-frameverdict-posture-ratification-2026-06-16.md docs: define CLOSE/FrameVerdict posture 2026-06-16 21:43:13 -07:00
close-derived-proposal-bridge-2026-06-16.md feat(proposals): bridge derived CLOSE facts into review proposals (#789) 2026-06-16 15:39:46 -07:00
close-flywheel-dedicated-regression-surface-ratification-2026-06-16.md feat: create dedicated CLOSE Flywheel Regression Surface (Claim-B Level) (#793) 2026-06-16 19:05:05 -07:00
close-flywheel-proposal-review-visibility-ratification-2026-06-16.md feat: strengthen visibility and measurement of CLOSE flywheel proposal review/ratification side (#794) 2026-06-16 19:33:25 -07:00
close-relational-transitive-pr1-2026-06-16.md feat(determine): consolidate declared relational transitive CLOSE facts (#788) 2026-06-16 15:15:59 -07:00
cmb-a-combined-rate-ruler-2026-06-08.md feat(combined-rate): CMB-a — combined-rate setup ruler (model + gold + oracle) 2026-06-08 06:58:17 -07:00
cmb-lookback-review-2026-06-08.md docs(cmb): lookback review + fix single-agent-attribution hygiene hazard (H3) 2026-06-08 13:27:17 -07:00
combined-rate-capability-ledger-2026-06-08.md docs(comprehension): freeze combined-rate (R4) v1 — capability ledger + non-claims (CMB-e) 2026-06-08 14:13:39 -07:00
composition-capability-scope.md
composition-wall-execution-plan-2026-06-03.md
comprehension-capability-ledger-2026-06-07.md docs(comprehension): whole-system organ capability ledger + fix ADR-0211 number collision 2026-06-08 06:15:51 -07:00
comprehension-coverage-wall-map-2026-06-14.md docs(analysis): wall map — the recognizer/coverage wall is COMPOSITION 2026-06-14 15:10:30 -07:00
comprehension-organ-capability-ledger-2026-06-08.md docs(comprehension): freeze combined-rate (R4) v1 — capability ledger + non-claims (CMB-e) 2026-06-08 14:13:39 -07:00
comprehension-primitive-inventory.md
D-close-consolidation-design-2026-06-06.md feat(determine): idle deductive consolidation — the loop learns from determined facts (Step D) 2026-06-06 12:28:09 -07:00
deductive-logic-phase-2-benchmark-runway-2026-06-04.md
E-estimation-design-2026-06-06.md feat(determine): calibrated disclosed estimation — the engine earns the right to guess (Step E) 2026-06-06 13:49:07 -07:00
epistemic-coherence-architecture-2026-06-14.md docs(analysis): finding — speculative epistemic ceiling does NOT blunt learning 2026-06-14 14:58:10 -07:00
extraction-richness-audit-2026-06-03.md
field-reasoner-wedge-design-and-falsification-2026-06-04.md
field-wedge-ablation-result-2026-06-04.md
gsm8k-derivation-reader-recognizer-lift-workstream-a-ratification-2026-06-17.md feat(derivation): Workstream A inc 1 — lexeme reader + cleaned exemplars + proxy rebaseline (#796) 2026-06-16 21:57:05 -07:00
gsm8k-lift-program-strategy-2026-06-04.md
gsm8k-workstream-a-increment-1-lookback-2026-06-17.md feat(derivation): Workstream A inc 1 — lexeme reader + cleaned exemplars + proxy rebaseline (#796) 2026-06-16 21:57:05 -07:00
holonomy-resonance-proof-not-robust-2026-06-14.md fix(holonomy): downgrade non-robust resonance proof to honest tripwires + record finding 2026-06-14 14:06:51 -07:00
integrate-hardened-close-yardstick-determinism-teaching-regression-ratification-2026-06-16.md feat: integrate hardened CLOSE yardstick into determinism & teaching regression surfaces (#792) 2026-06-16 17:36:25 -07:00
L10-continuity-spike-design-2026-06-05.md docs(design): L10/L11 lived-spine design records + AGI-candidacy roadmap 2026-06-05 15:11:08 -07:00
L10-runtime-scoping-2026-06-05.md docs(design): L10/L11 lived-spine design records + AGI-candidacy roadmap 2026-06-05 15:11:08 -07:00
L10-shapeBplus-persistence-scope-2026-06-05.md docs(design): L10/L11 lived-spine design records + AGI-candidacy roadmap 2026-06-05 15:11:08 -07:00
math-serving-seam-design-2026-06-06.md feat(derivation): math-serving reach seam — select_self_verified is policy-aware (ADR-0206 §5) 2026-06-06 15:46:14 -07:00
oov-grounding-determinism-morphology-affinity-collapse.md fix: derive oov grounding from token content 2026-06-06 05:46:01 -07:00
phase2-general-comprehension-organ-scope-2026-06-05.md docs(analysis): Phase 2 spike — syntax pack is not a parser; structural-decode fork 2026-06-05 15:41:36 -07:00
pivot-to-deductive-logic-2026-06-04.md
proposal-review-idle-integration-2026-06-08.md docs(proposal-review): idle-integration boundary ledger (IT-c) 2026-06-07 22:33:17 -07:00
proposal-review-reporter-2026-06-07.md docs(proposal-review): boundary ledger — read-only reporter, not idle_tick, not L10 (RPT-d) 2026-06-07 21:44:07 -07:00
q1-d-ask-bus-delivery-scoping-2026-06-08.md docs(epistemic): record accepted Q1-D delivery decisions 2026-06-09 09:16:24 -07:00
q1-epistemic-question-articulation-v1-scoping-2026-06-08.md docs(scoping): epistemic disclosure bus (Stage 2 / VERIFIED v1) + Q1 question-articulation briefs 2026-06-08 14:53:47 -07:00
question-layer-gap-survey.md
r1-inventory-ledger-2026-06-07.md feat(comprehension): inverse reader frame — base of a more/fewer-than (PR-7b / R2 C0) 2026-06-07 07:06:26 -07:00
r2-inventory-ledger-2026-06-07.md docs(comprehension): whole-system organ capability ledger + fix ADR-0211 number collision 2026-06-08 06:15:51 -07:00
r3-1-router-integration-2026-06-08.md feat(contemplation): wire R3 into the multi-organ router + pass manager (R3.1) 2026-06-08 02:05:34 -07:00
r3-2-unit-conversion-2026-06-08.md feat(rate): exact time-unit conversion for single-rate (R3.2b-e) 2026-06-08 05:43:51 -07:00
r3-rate-inventory-ledger-2026-06-08.md feat(rate): R3 inventory ledger + failure-family wiring (R3e) 2026-06-07 23:12:23 -07:00
real-gsm8k-capability-measurement-2026-06-04.md
REALIZE-R1-DETERMINE-scope-2026-06-06.md fix(realize): lookback hardening — defensive admissibility re-assertion + coverage 2026-06-06 06:31:54 -07:00
REALIZE-scope-2026-06-06.md docs(analysis): REALIZE phase scope (Step 3) — verified against the real substrate 2026-06-06 01:48:19 -07:00
relational-grounding-extension-2026-06-04.md
replay-moment-backend-scoping-2026-06-12.md feat(workbench): sealed single-turn replay backend — GET /replay/{turn_id} (Wave R3) 2026-06-12 17:15:39 -07:00
router-organ-hygiene-invariant-2026-06-08.md test(contemplation): standing router-organ-hygiene invariant 2026-06-08 05:28:06 -07:00
solver-operation-coverage.md
stage2-disclosure-bus-implementation-map-2026-06-09.md docs(stage2): map disclosure-bus implementation state and next slices 2026-06-09 11:32:00 -07:00
stage2-epistemic-disclosure-bus-verified-v1-scoping-2026-06-08.md docs(scoping): lock VERIFIED as a distinct disclosure mode, not APPROXIMATE (review fix) 2026-06-08 15:00:38 -07:00
step3-relational-surface-lookback-2026-06-15.md docs(analysis): Step-3 relational-surface lookback (#775 + #781 + #783) (#784) 2026-06-15 16:56:03 -07:00
universal-structure-and-field-symbol-coherence-gate-2026-06-04.md
VERIFIED-canonical-comparison-scoping-2026-06-06.md docs(analysis): VERIFIED producer — validate-first verdict is DO NOT BUILD (comprehension-bound) 2026-06-06 16:09:41 -07:00
verified-serving-wiring-scoping-2026-06-08.md docs(epistemic): scope ASK and VERIFIED serving gates 2026-06-08 22:22:35 -07:00
verified-serving-wiring-scoping-2026-06-09.md docs(verified): scope serving-time verification gate 2026-06-09 09:41:34 -07:00
wiring-promotion-gate-brief-2026-06-03.md