Implements the 4-phase documentation reorganization master plan. - Consolidation: Merged brief/, handoff/, planning/, and decisions/ into briefs/, handoffs/, plans/, and adr/ respectively (101 ADRs relocated) - Root Cleanup: Relocated HANDOFF-gpt55-*.md and key top-level docs (runtime_contracts.md, etc.) to canonical folders. Added superseded alerts. - Indices & Navigation: Created docs/README.md navigation document, docs/sessions/README.md index, docs/adr/README.md index - Note: Also includes prior commit adding ADR-0200+ corpus hygiene governance (ADR-0225, dependency map, backfilled cross-references)
2.5 KiB
ADR-0159 — Contemplation Quality Eval Lane (W-025)
Status: Accepted
Context
ADR-0152 introduced the learning-arc demo proving that CORE can:
- discover an engine-authored chain
- enrich it through contemplation
- emit a reviewable proposal
- replay-check the proposal
- ratify it through operator review
- observe a grounded downstream change
ADR-0155 then added CI contemplation report generation.
Those ADRs proved the contemplation loop exists, but they did not create a formal evaluation lane for judging the quality of contemplation artifacts.
Without a dedicated lane, the system could produce reports indefinitely without measuring:
- replay integrity
- provenance correctness
- mutation-boundary preservation
- downstream usefulness
- review-boundary preservation
Decision
Add a new eval lane:
core eval contemplation-quality
The lane evaluates the structured report emitted by:
core demo learning-arc --json
The lane is strictly read-only.
It MUST NOT:
- accept proposals
- mutate corpora
- mutate packs
- mutate engine_state
- bypass operator review
- upgrade epistemic status
Replay-equivalence remains a prerequisite for proposal review eligibility only. It is never treated as permission for automatic acceptance.
Metrics
The lane currently scores:
- scene_contract
- deterministic_replay_integrity
- typed_contemplation_provenance
- engine_authored_specificity
- grounding_transition
- downstream_gain_observed
- active_corpus_boundary
- pending_not_auto_accepted
- stable_proposal_identity_present
Compatibility with prior ADRs
ADR-0056
Contemplation remains enrichment-only and does not mutate active truth state.
ADR-0057
Replay-equivalence is measured separately from operator acceptance. The lane explicitly verifies that proposals remain pending before review.
ADR-0152
The learning-arc demo remains the canonical contemplation-quality source. Transient/tempdir semantics remain unchanged.
ADR-0155
CI contemplation reports remain audit artifacts. This lane scores those artifacts but does not ratify them.
ADR-0157
Revision-warning/reboot discipline remains orthogonal. The eval lane adds no persistence or recovery semantics.
Consequences
CORE now has a measurable contemplation-quality corridor rather than relying on subjective review of contemplation reports.
The lane strengthens the distinction between:
- autonomous proposal discovery
- and autonomous proposal acceptance
The latter remains forbidden.