core-labs/core
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions
core/docs/workbench
History
Shay 5061a0804b feat(workbench): Wave M D3 — shareable evidence bundles (reproducibility as a deliverable) 
The "they'd want to use it" deliverable: a turn's evidence exported as ONE
deterministic, content-addressed, citable artifact — composing the Phase-C
evidence (pipeline + field) with the trace and the calibration leeway verdict.

Backend (read-only, no engine execution):
  - schemas.py: EvidenceBundle.
  - workbench/evidence_bundle.py: build_evidence_bundle(entry) assembles a turn
    journal entry into the bundle and computes bundle_digest. The digest
    content-addresses the DETERMINISTIC cognitive evidence only — journal
    position + wall-clock (turn_id, journal_digest, replay_reproducer,
    generated_from) are carried for provenance but EXCLUDED, so the same turn
    content reproduces the same digest regardless of journal position.
  - api.py: GET /trace/{turn_id}/bundle. schema-snapshot.json regenerated.

The bundle carries a replay *reproducer* command (how to verify) rather than a
live-run replay, so the artifact itself stays deterministic — verification is
the consumer's step: re-run the prompt sealed, confirm trace_hash, recompute the
bundle, check the digest.

Frontend:
  - types/api.ts EvidenceBundle; client/query hook; Trace route **Bundle** tab —
    citable digest, "what this proves / does not prove" honesty note, the
    reproducer, and a deterministic JSON download (Blob anchor, leak-safe).

Validation: 135 workbench Python tests incl. non-vacuous bundle guards (digest
reproducible, journal-position/wall-clock excluded, any evidence change flips
the digest, missing Phase-C evidence honest); 468/468 frontend incl. schemaDrift
+ the citable-download bundle test; pnpm build clean; git diff --check clean. No
serving-path imports.
2026-06-13 17:26:26 -07:00
..
acceptance-gates.md docs(workbench): reconcile mutation doctrine with admitted corridors 2026-06-12 06:50:26 -07:00
api-contract-v1.md feat(workbench): Wave M Phase C legibility — pipeline record, contemplation, identity continuity 2026-06-13 15:44:31 -07:00
b4-leeway-feasibility-gate.md feat(workbench): land B3.5-b/c/d/e — calibration evidence subject, B4a leeway gate, docs; runner-reproducible practice artifact 2026-06-13 07:36:44 -07:00
core-logos-studio-plan.md docs(workbench): capture CORE-Logos Studio plan 2026-06-13 03:41:10 -07:00
core-workbench-v1-blueprint.md
data-shapes-v1.md feat(workbench): Wave M D3 — shareable evidence bundles (reproducibility as a deliverable) 2026-06-13 17:26:26 -07:00
design-system.md
implementation-plan.md docs(workbench): reconcile mutation doctrine with admitted corridors 2026-06-12 06:50:26 -07:00
phase-a-residue-ledger.md feat(workbench): Wave M Phase C legibility — pipeline record, contemplation, identity continuity 2026-06-13 15:44:31 -07:00
proposal-artifact-substrate-v1.md docs(workbench): define proposal artifact substrate v1 2026-06-13 03:38:06 -07:00
README.md feat(workbench): land B3.5-b/c/d/e — calibration evidence subject, B4a leeway gate, docs; runner-reproducible practice artifact 2026-06-13 07:36:44 -07:00
ui-component-map.md
UI-UX-GUIDE.md feat(workbench): Wave M Phase C legibility — pipeline record, contemplation, identity continuity 2026-06-13 15:44:31 -07:00
wave-1-evidence-spine.md docs(workbench): Wave R mastery revamp plan + R0/R1 dispatch brief pack 2026-06-12 10:02:46 -07:00
wave-m-consolidation-b3.5.md docs(workbench): strengthen B3.5 D2 to runner-reproducibility; record C1-a persistence-first constraint 2026-06-13 07:20:23 -07:00
wave-M-worthiness.md feat(workbench): Wave M D3 — shareable evidence bundles (reproducibility as a deliverable) 2026-06-13 17:26:26 -07:00
wave-R-mastery-revamp.md docs(workbench): R0a CI path filter includes the workflow file itself 2026-06-12 10:29:29 -07:00

README.md

CORE Workbench v1

CORE Workbench is the first dedicated operator/auditor UI for CORE.

It is intentionally designed as:

  • a cognition observatory,
  • replay debugger,
  • proposal review workstation,
  • deterministic eval console,
  • and audit surface.

It is NOT intended to be a generic chatbot shell.

Document Index

Doctrine

  • ../decisions/ADR-0160-core-workbench-v1.md

Defines:

  • product doctrine
  • trust boundaries
  • architecture direction
  • module scope
  • acceptance criteria

UX Blueprint

  • core-workbench-v1-blueprint.md

Defines:

  • visual philosophy
  • interaction model
  • module behavior
  • navigation
  • replay/proposal/eval UX

Implementation Plan

  • implementation-plan.md

Defines:

  • W-026 through W-031
  • phase sequencing
  • backend/frontend constraints
  • release criteria

API Contract

  • api-contract-v1.md

Defines:

  • read-only endpoint surface
  • request/response envelopes
  • mutation boundaries
  • runtime/trace/proposal/eval/replay routes

Data Shapes

  • data-shapes-v1.md

Defines:

  • typed UI-facing shapes
  • proposal structures
  • replay structures
  • artifact references
  • trust badges

Proposal Artifact Substrate

  • proposal-artifact-substrate-v1.md

Defines:

  • the universal proposal artifact envelope
  • subject-specific proposal adapters
  • proposal-only vs ratification-enabled capability levels
  • safety, validation, affected-artifact, and checksum-impact report shapes
  • the migration path for math, cognition, CORE-Logos, packs, and future modalities

Wave M Consolidation / B3.5

  • wave-m-consolidation-b3.5.md

Defines:

  • the route-registry unification plan
  • calibration as a first-class evidence subject
  • the B4 leeway-feasibility gate
  • the UI/UX guide requirement
  • the Phase A residue ledger before further complexity

Supporting B3.5 deliverables:

  • UI-UX-GUIDE.md — operator/evaluator route map, evidence grammar, route proofs, boundaries, and absences.
  • b4-leeway-feasibility-gate.md — B4 source-tuple audit and B4a nullable read model.
  • phase-a-residue-ledger.md — implemented/deferred/blocked residue before Phase C.

CORE-Logos Studio

  • core-logos-studio-plan.md

Defines:

  • the /logos Studio route concept
  • pack identity, lexicon, glosses, morphology, alignment, holonomy, safety, and patch-forge tabs
  • CORE-Logos evidence subjects
  • read-only readers and proposal-only draft endpoint direction
  • the handler-family admission sequence for future ratification

UI Component Map

  • ui-component-map.md

Defines:

  • page layout
  • navigation structure
  • shared components
  • trace drawer structure
  • proposal/eval/replay modules

Acceptance Gates

  • acceptance-gates.md

Defines:

  • implementation gates
  • red flags
  • release conditions
  • mutation restrictions

Core Principles

Replay before persuasion

The UI should make replay evidence more important than aesthetic persuasion.

Calm by default

The interface should remain quiet and precise.

Progressive disclosure

The system should become more transparent the deeper an operator inspects.

Proposal is not ratification

The UI must preserve ADR-0057 review doctrine.

Read-only first

The first workbench phases prioritize visibility and auditability before any mutation capability.

Current Status

The planning package is merged on main via 404e694 (docs(workbench): CORE Workbench v1 planning architecture (ADR-0160)).

The prototype branch feat/w026-workbench-readonly-api is superseded and must not be used as the implementation base. It mixed W-026 with frontend and trace work, added auth and web-framework dependencies before the local read-only boundary was proven, and included placeholder replay/trace behavior that could be mistaken for evidence.

The next accepted implementation starts clean from main with W-026 only: dataclass schemas, repo-root-constrained readers, a standard-library local HTTP API, and route/read-model tests. W-027 and later phases build on that boundary after it is accepted.

W-026 Local Runbook

Start the read-only local API:

core workbench api

Verify liveness:

curl http://127.0.0.1:8765/health

Inspect each W-026 endpoint family:

curl http://127.0.0.1:8765/runtime/status
curl http://127.0.0.1:8765/artifacts
curl http://127.0.0.1:8765/artifacts/evals/contemplation_quality/contract.md
curl http://127.0.0.1:8765/proposals
curl http://127.0.0.1:8765/evals
curl http://127.0.0.1:8765/evals/contemplation_quality
curl -X POST http://127.0.0.1:8765/evals/run \
  -H 'Content-Type: application/json' \
  -d '{"lane":"contemplation_quality","version":"v1","split":"public"}'

Bind to a different local port:

core workbench api --port 9000

Non-local binds require an explicit operator flag:

core workbench api --host 0.0.0.0 --allow-nonlocal-bind

Initial Work Queue

Work Item Goal
W-026 Read-only API
W-027 Frontend shell
W-028 Chat + trace drawer
W-029 Proposal queue
W-030 Eval center
W-031 Replay theater

Guiding Question

The correct operator reaction to the workbench should be:

“Wait… I can actually inspect and replay the cognition.”

not:

“Cool chatbot.”