core/workbench
Shay 1fe56e9b6f feat(workbench): calibration + serving-metrics readers — the gold-tether loop, visible (Wave M B1)
First Wave M / Phase B piece (GATING): read-only backend that makes the
calibrated-learning / serving-discipline loop inspectable — 'the engine
earns the right to guess', ADR-0175.

The workbench computes NONE of these numbers:
- GET /calibration/classes — per-class gold-tether view from the persisted
  practice arena ledger (evals/gsm8k_math/practice/v1/report.json per_class).
  Each class's reliability_floor is the engine's own one-sided Wilson
  conservative_floor (via ClassTally.reliability); PROPOSE (θ=0.85) / SERVE
  (θ=0.99) license verdicts come from core.reliability_gate.license_for.
  Failures-first ordering. A test proves the reader's floor equals a direct
  conservative_floor() call — no re-implementation.
- GET /serving/metrics — the live correct/refused/wrong counts read unchanged
  from the committed train_sample + holdout_dev report.json (currently
  4/46/0 and 5/495/0 — wrong=0). Never re-runs a lane.

Honest current state: the committed practice ledger's three classes
(additive/divisive/multiplicative) are all below N_MIN=10, so none has
earned a license yet — the reader shows exactly that, no fake green light.

- workbench/calibration.py: pure readers; imports core.reliability_gate;
  EvidenceUnavailableError -> 501 (fail-closed) when the artifact is absent.
- schemas + TS mirrors (CalibrationClass, ServingMetrics); both snapshots
  regenerated (deterministic); both drift gates pass.
- trust boundary: read-only over committed artifacts + engine-owned
  derivation; no execution, no mutation, no license ever changed.

Verified: 30 Python tests (incl. the no-reimplementation proof + fail-closed),
390 vitest, both schema drift gates, snapshots deterministic.
2026-06-13 00:38:16 -07:00
..
__init__.py feat(W-026): read-only workbench API (ADR-0160 Phase 1) (#292) 2026-05-26 10:16:35 -07:00
api.py feat(workbench): calibration + serving-metrics readers — the gold-tether loop, visible (Wave M B1) 2026-06-13 00:38:16 -07:00
calibration.py feat(workbench): calibration + serving-metrics readers — the gold-tether loop, visible (Wave M B1) 2026-06-13 00:38:16 -07:00
journal.py finish wave r3 ui and trace integrity 2026-06-12 23:25:24 -07:00
readers.py finish wave r3 ui and trace integrity 2026-06-12 23:25:24 -07:00
replay.py finish wave r3 ui and trace integrity 2026-06-12 23:25:24 -07:00
schemas.py feat(workbench): calibration + serving-metrics readers — the gold-tether loop, visible (Wave M B1) 2026-06-13 00:38:16 -07:00
server.py feat: implement CORE Workbench W3 Ratification Corridor 2026-06-03 20:13:36 -07:00