Wave M takes the workbench to mastery and closes its biggest design gap: it surfaces the teaching/ratification loop but is blind to the calibrated-learning / serving-discipline loop (gold-tether arena, reliability gate, Wilson floor vs θ ceiling, 'the engine earns the right to guess') and to cognition itself (pipeline stages, field substrate, identity continuity). Lens: Anthropic + xAI as target users who'd WANT to use it. - wave-M-worthiness.md: full plan, Phases A–E, the missing-surfaces table, the backend-reader-first / never-re-implement-engine-math disciplines, execution order (B→C→D, A parallel). - wave-M-phaseB-calibration-briefs: executable Phase B pack grounded in the real core/reliability_gate shapes (ClassTally / conservative_floor / license_for / Action θ) and the committed report.json evidence — B1 readers (GATING, Python), B2 Calibration route, B3 wrong=0 global frame, B4 leeway wiring. Dependency DAG + STOP gates + no-theater rules.
10 KiB
Wave M — CORE Workbench: Mastery & Worthiness
Date: 2026-06-13
Status: approved plan (Shay, 2026-06-13). Predecessor: Wave R complete
(#702–#723; 11 routes real, Replay Moment, trace integrity, DAG/Demo/wrong=0).
Execution: committed brief packs in docs/handoff/, parallel-safe DAGs,
dispatched between Fable 5 and GPT5.5 — the same production line that
shipped R2 + R3.
Thesis
Two asks, one lens.
- Mastery — take the shipped surface from very good to best-in-class.
- Worthiness — add what's missing so the workbench is undeniably worthy of the deterministic cognitive engine beneath it.
The lens: Anthropic and xAI as target users who would want to use it. They build the opaque transformer this engine defines itself against. What impresses them is not prettier charts — it is a UI that makes determinism, refusal-discipline, and geometric coherence inspectable and felt. Standard: ADR-0160's three pillars — audit-native (not analytics theater), calm default / infinite depth, replay before persuasion.
Diagnosis — the two blind spots
The workbench today is excellent at evidence browsing: every route projects an evidence manifold, the Evidence Chain Rail threads provenance, the Replay Moment makes hash-equality felt. But it is blind to the two most distinctive parts of the organism:
- It shows the teaching/ratification loop and is blind to the calibrated-learning / serving-discipline loop. You can ratify a proposal, but you cannot see the gold-tether arena, the reliability gate, the Wilson floor vs the θ ceiling, or the moment "the engine earns the right to guess." That discipline — the engine refuses rather than guesses wrong — is the single most impressive idea in the project, and it is invisible.
- It shows outputs and evidence but not cognition itself. The
CognitiveTurnPipelinestages, the contemplation process, the CL(4,1) field substrate,versor_condition, identity continuity — none are legible. For an audience that lives inside opaque models, legible deterministic cognition is the wow.
Everything below closes those two gaps on top of a mastery polish.
Non-negotiable disciplines (bind every phase)
- Backend-reader-first, no theater. Every new surface reads real engine data through a new read-only reader; no dashboard over invented or recomputed numbers. The calibration and field readers do not exist yet — that gating work is Python, not React.
- Never re-implement engine math in the workbench. The calibration
reader imports and uses
core.reliability_gate(conservative_floor,license_for,Ceilings,Action); the field reader uses the engine's realversor_condition/cga_inner. The workbench computes nothing the engine owns. - Read-only doctrine holds. No new mutation endpoints; execution stays
the existing allowlisted set (
/evals/run, ratify,/demos/{id}/run). A calibration view never changes a license. - Determinism in the UI too. No force-directed / nondeterministic layout, no decorative motion-as-cognition. Golden-file layout tests for every new visualizer (like the DAG). The honesty is the impressiveness.
- Doctrine gates extend to every new surface: schema mirrored, enums covered, route conformant, readers SHA-pinned where they assert a metric.
Phases (priority-ordered)
Phase A — Mastery polish of the shipped surface (scope: M; parallel)
No new concepts; make the 11 routes undeniable.
- Design-system full expression: semantic token roles, elevation, density
modes actually wired (the deferred Settings density pref),
tabular-numson all numerics,[text-wrap:balance]on all statements, motion-discipline audit (only state-transition affordances). - Cross-route consistency sweep: every list =
VirtualizedList+useListNavigation+SearchInput+ selection tokens; every detail =Panel+TabBar; calm-honest prose audit on every state. - DAG viewer: finish its consumers. It shipped wired only to proposal chains; wire the PCCP proof-promotion 8 scenarios and entailment traces (the other two the brief named). A primitive with one consumer is half-built.
- Command/keyboard completeness: a palette verb for every route action; registry-driven help stays the exhaustive contract.
- Accessibility pass: focus-visible audit, SR labels on every evidence badge, reduced-motion honored.
Phase B — Calibrated-Learning / Serving-Discipline surfaces (scope: L) ← the heart
The "worthy of the model" core. Backend-reader-first (none exist; data lives
in core/reliability_gate/ + the committed evals/gsm8k_math/*/report.json).
Detailed brief pack: docs/handoff/wave-M-phaseB-calibration-briefs-2026-06-13.md.
- B1 (Python): read-only readers/endpoints over the real ledger —
GET /calibration/classes(per-classClassTallycounts + the Wilsonconservative_floorreliability + PROPOSE/SERVElicense_forverdicts via the realcore.reliability_gate),GET /serving/metrics(the committedtrain_sample/v1/report.jsonnumbers — read the artifact, never re-run an unsafe lane). Schema mirrors + snapshots + drift gate. - B2 — Calibration / Gold-Tether route: per class, a coverage-vs-Wilson-floor bar, the θ ceiling, and a plain-language "earned PROPOSE / SERVE / neither" verdict. Failures-first. Where you see "the engine earns the right to guess."
- B3 — wrong=0 as a felt global presence: an always-present invariant element (N correct / N refused / 0 wrong, the zero load-bearing), elevating the per-run Evals ledger to the project's thesis made constant.
- B4 — the leeway story: wire the calibration verdict into the Proposals
/ Replay rails so a reviewer sees why a turn was granted latitude (which
class license, which θ, the
[approximate]disclosure) — connecting the HITL ratification you already have to the calibration that grants it.
Phase C — Make cognition legible (scope: L) ← the wow for Anthropic/xAI
- C1 — Cognitive Pipeline visualizer: for a selected turn, render the
real
CognitiveTurnPipelinestages (intent → PropositionGraph → ArticulationTarget → realizer → walk telemetry → trace hash) as a deterministic staged view (reuse the DAG primitive). The "real, replayable path, not animated fake cognition" surface. Reader-first over existing trace/walk telemetry. - C2 — Contemplation as a process, not just outputs: the contemplation loop (attempt → gold-tether → ClassTally → propose), connecting Demos/Proposals/Calibration into one story.
- C3 — Field substrate (honest, read-only, hard):
GET /field/stateover realFieldState+versor_conditionfor a turn, rendered as inspectable exact numbers and invariant status —versor_condition < 1e-6as a live "field is valid" assertion,cga_innercoherence as exact values. NOT a decorative 3D blob; no force-directed/nondeterministic motion. The honesty is the impressiveness: "this is the geometry, it's exact, it can't fake coherence." - C4 — Identity continuity (L10/L11): surface the engine-identity hash, lineage chain, reboot-verification status — "the same continuous life across restart," the deepest telos, currently invisible.
Phase D — The "they'd want to use it" layer (scope: M)
- Guided Determinism Tour — elevate Demo Theater into a first-run narrative: pick a demo, watch the proposer get disciplined, see hash-to-hash replay, see a wrong answer refused. "What this proves / what this does not prove" honesty cards on every scenario.
- Provider-agnostic framing — the pitch for Anthropic and xAI: "bring your own model's claim; watch the deterministic engine decide, refuse, and replay it." The Tool-Authority / Hybrid-Verification demos already embody this; make it the tour's spine.
- Shareable evidence bundles — deterministic export of a turn + its trace + replay + calibration verdict as a single citable artifact. Reproducibility as a deliverable.
Phase E — Robustness pillars (scope: S; continuous)
- Extend doctrine gates to every new surface; SHA-pin the calibration/field readers where they assert a metric.
- Performance budget (resolve the Vite chunk-size warning via route code-split), error-boundary discipline, golden-file regime for the pipeline/field visualizers.
What's missing in the design (the second ask, distilled)
| Missing surface | Why it matters for worthiness | Reader exists? |
|---|---|---|
| Calibration / gold-tether arena | Makes wrong=0 earned, not asserted — the most distinctive idea, invisible | No — build first |
| Serving-vs-learning regime frame | Names the two-regime architecture; without it the UI reads as a chatbot | No |
| wrong=0 as a felt global presence | The thesis itself; today only per-eval-run | Partial (ledger) |
| Cognitive pipeline visualizer | "Real replayable cognition" vs animated fake — the core wow | Trace exists; needs staging reader |
| Contemplation-as-process | The learning flywheel, today only its outputs | Partial |
| Field substrate / versor_condition | The geometry that can't fake coherence — honest, exact | No — build first |
| Identity continuity (L10/L11) | "One continuous life" — the deepest telos | No |
| Serving metrics reachable | The actual capability numbers (gsm8k) aren't viewable | No |
Risks
- Theater is risk #1 — mitigated by backend-reader-first + never re-implementing engine math. The gating work (B1, C1, C3 readers) is Python and parallel-safe.
- The field surface must stay honest — read-only over real
versor_condition/cga_inner, no decorative geometry, no motion theater. - Scope is large — several PR trains. Sequences as readers → routes → cross-wiring → tour. Phase A runs in parallel as polish.
- No timelines — phases/priorities/scope-sizes; sequencing is the dependency DAG, not a clock.
Execution order
B → C → D, with A in parallel. The worthiness gap is widest at B; the tour (D) lands hardest once B and C exist to show off. Phase B brief pack is authored first (this commit); subsequent phase packs follow as each lands.