core/docs/adr/ADR-0124-systems-software-audit-passed-promotion.md
Shay 54e6bfc0d0
docs: reorganize docs landscape
Implements the 4-phase documentation reorganization master plan.

- Consolidation: Merged brief/, handoff/, planning/, and decisions/ into briefs/, handoffs/, plans/, and adr/ respectively (101 ADRs relocated)
- Root Cleanup: Relocated HANDOFF-gpt55-*.md and key top-level docs (runtime_contracts.md, etc.) to canonical folders. Added superseded alerts.
- Indices & Navigation: Created docs/README.md navigation document, docs/sessions/README.md index, docs/adr/README.md index
- Note: Also includes prior commit adding ADR-0200+ corpus hygiene governance (ADR-0225, dependency map, backfilled cross-references)
2026-06-30 16:59:36 -07:00

4.8 KiB

ADR-0124 — systems_software Audit-Passed Promotion

Status: Accepted Date: 2026-05-22 Author: CORE agents + reviewers Depends on: ADR-0091, ADR-0092, ADR-0101, ADR-0106, ADR-0109, ADR-0122, ADR-0123


Context

ADR-0122 attempted the third promotion on systems_software but deferred it due to a lane-shape mismatch on the symbolic_logic lane (mapped to accuracy-shape but producing inference-shape metrics). ADR-0123 resolved this blocker by re-mapping symbolic_logic to inference_shape in the LANE_SHAPE_REGISTRY.

With the registry correct, the only remaining blocker is signing the claim. This ADR closes the arc: ADR-0101 (ratification) → ADR-0122 (deferral) → ADR-0123 (registry remap) → ADR-0124 (promotion).

It is the third successful promotion, following mathematics_logic (ADR-0110) and physics (ADR-0111).


Evidence

The systems_software domain attaches three lanes via the en_systems_software_v1 pack manifest:

Lane Shape Public Holdout
symbolic_logic inference_shape all_three_pass_rate=1.0, replay_determinism=1.0, overall_pass=True (18 cases) same (12 cases)
inference_closure inference_shape all_pass_rate=1.0, replay_determinism=1.0, overall_pass=True (20 cases) same (12 cases)
fabrication_control refusal_shape by-class refusals 3/3/3, fabricated=0 across all classes same (9 holdout cases)

All thresholds documented in ADR-0109 §2 (and as amended by ADR-0123 for symbolic_logic) are met on both public and holdout splits for every attached lane.

inference_closure and fabrication_control results are shared infrastructure across all domains that attach them; the digest distinguishes systems_software from math and physics via domain_id + evidence_revision, not via lane-result divergence (per ADR-0106 §1).


Decision

systems_software is promoted to audit-passed=true (formerly expert_demo=true).

The signed claim entered into docs/reviewers.yaml is:

audit_passed_claims:
  - domain_id: systems_software
    evidence_lanes:
      - symbolic_logic
      - inference_closure
      - fabrication_control
    evidence_revision: "adr-0124:reviewed:2026-05-22"
    signed_by: shay-j
    claim_digest: "17e24436b6875b89f6d1a5c2992557413c7ef456250f549d463159f54438c407"

The evidence_revision follows the labeled form established by ADR-0110 (adr-<id>:reviewed:<date>); the load-bearing invariant remains replay byte-equality per ADR-0106 §1.5.


Invariants

row_is_audit_passed

ledger_report() must report systems_software with predicates.audit_passed == true and status == "audit-passed" so long as the signed claim in docs/reviewers.yaml resolves and the lane results on disk continue to produce the claimed digest.

replay_digest_byte_equality

Re-deriving the evidence-bundle digest from the lane result files at this commit must reproduce 17e24436b6875b89f6d1a5c2992557413c7ef456250f549d463159f54438c407.

other_domains_unaffected

ADR-0124 promotes exactly one domain. mathematics_logic and physics continue at audit-passed; hebrew_greek_textual_reasoning and philosophy_theology continue at reasoning-capable with audit_passed=false.

distinct_digest_from_adr_0110_and_0111

The systems_software digest must differ from both mathematics_logic (ADR-0110) and physics (ADR-0111), proving that distinct domains sharing evidence lanes still produce distinct signed claims.


Acceptance evidence

Accepted when:

  • docs/reviewers.yaml carries the signed audit_passed_claims entry for systems_software
  • evals/symbolic_logic/holdouts/v1/cases_plaintext.jsonl exists (dev-mode fallback per ADR-0105)
  • evals/symbolic_logic/results/v1_public_*.json and v1_holdout_*.json exist with compliant metrics
  • tests/test_adr_0124_systems_software_audit_passed.py pins the four invariants above
  • ledger_report() confirms systems_software row at audit_passed=true / status="audit-passed"
  • README "Accepted reasoning-capable domains" table updated to note systems_software at audit-passed

Consequences

  • Third audit-passed promotion lands. The domain contract has now succeeded against three distinct domains.
  • The deferral in ADR-0122 is resolved, confirming that registry/contract updates are the correct path to resolve mismatched lane shapes.
  • The remaining reasoning-capable domains are next in line.

Out of scope

  • This ADR does not amend ADR-0106, ADR-0109, or ADR-0123.
  • This ADR does not promote any other domain.
  • Sealing the systems_software holdout under a real age recipient (ADR-0105's eventual design) remains future work. The dev-mode plaintext fallback is acceptable per ADR-0105's own §"Dev-mode fallback preserved" clause.
  • Tightening evidence_revision to a raw git sha remains a candidate future amendment.