819c8b81ac
Spreads the four remaining Phase 3 lanes to map the full reasoning-
depth surface alongside inference-closure (already landed at e509e0d).
Each lane is a v1 honest probe per the roadmap; engineering work
follows once the full surface is visible.
Results across all five Phase 3 lanes:
lane split primary signal foundation
inference-closure public/v1 0.0 1.0 / 1.0
inference-closure holdouts/v1 0.0 1.0 / 1.0
compositionality public/v1 0.0625 (1/16) 1.0 / 1.0
compositionality holdouts/v1 0.0 1.0 / 1.0
multi-step-reasoning public/v1 0.0 1.0 / 1.0
multi-step-reasoning holdouts/v1 0.0 1.0 / 1.0
introspection public/v1 0.0 (no api) n/a
introspection holdouts/v1 0.0 n/a
cross-domain-transfer public/v1 0.0 1.0 / 1.0
cross-domain-transfer holdouts/v1 0.0 1.0 / 1.0
Foundation guarantees (storage + replay) intact across every lane
that has them. The reasoning-depth signal is uniformly zero. The
five lanes triangulate four architectural gaps:
Gap 1. generate/graph_planner.py has no transitive composition.
Gap 2. field/propagate.py has no derivable-but-not-asserted recall.
Gap 3. core/cognition/explain.py module does not exist.
Gap 4. no structural-pattern recogniser (cross-subdomain transfer).
Gaps 1, 2, 4 cluster on the same code surface and may close together
as a single bounded PR. Gap 3 is independent module-creation work.
Lane scaffolding mirrors inference-closure (contract.md, runner.py,
dev + public/v1 + holdouts/v1 cases.jsonl, baselines/v1_structural_zero.json,
gaps.md). All runners are parallel-safe and use the standard
run_lane(cases, *, config, workers) interface.
Per-lane gaps.md records the engineering shape for v2 plus future
directions worth not forgetting:
- compositionality/gaps.md: metaphor is compositionality with
selective property transfer; building it is correctly downstream
of closing this lane.
- cross-domain-transfer/gaps.md: metaphor + narrative as
cross-domain operators; narrative requires the Agency open-scope
decision to pin first.
- introspection/gaps.md: explain API is also the substrate for
first-person narrative self-account.
Recommended v2 sequence in docs/PROGRESS.md:
1. Pin Agency + Tool-use open-scope decisions (deadline: before
Phase 3 engineering).
2. Engineer Gaps 1 + 2 as one bounded PR.
3. Engineer Gap 3 independently.
4. Re-author cross-domain-transfer v2 with matched-control
contract refinement.
Phase 3 v1 exit: 0/5 lanes passing, which is the expected v1 floor.
CLI suites smoke / cognition / teaching pass; no regression on
Phase 2.
10 lines
2.9 KiB
JSON
10 lines
2.9 KiB
JSON
{"id":"CMP-V1-HLD-001","pattern":"composed_predicate","premises":["What is being?","Actually being is presence.","What is presence?","Actually presence precedes reality."],"probe":"What does being precede?","expected_entailment_tokens":["reality"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-002","pattern":"composed_predicate","premises":["What is distinction?","Actually distinction is comparison.","What is comparison?","Actually comparison causes definition."],"probe":"What does distinction cause?","expected_entailment_tokens":["definition"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-003","pattern":"composed_predicate","premises":["What is concept?","Actually concept is structure.","What is structure?","Actually structure grounds meaning."],"probe":"What does concept ground?","expected_entailment_tokens":["meaning"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-004","pattern":"novel_pair_under_seen_relation","premises":["What is life?","Actually life causes movement.","What is being?","Actually being causes presence."],"probe":"What does life cause in being?","expected_entailment_tokens":["presence","movement"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-005","pattern":"novel_pair_under_seen_relation","premises":["What is procedure?","Actually procedure belongs_to method.","What is method?","Actually method belongs_to inquiry."],"probe":"Where does procedure belong in method?","expected_entailment_tokens":["inquiry"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-006","pattern":"novel_pair_under_seen_relation","premises":["What is verification?","Actually verification grounds evidence.","What is comparison?","Actually comparison grounds distinction."],"probe":"What does verification ground in comparison?","expected_entailment_tokens":["distinction","evidence"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-007","pattern":"novel_relation_on_seen_pair","premises":["What is intention?","Actually intention is direction.","What is spirit?","Actually spirit grounds intention."],"probe":"What does spirit direct?","expected_entailment_tokens":["direction","intention"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-008","pattern":"novel_relation_on_seen_pair","premises":["What is recall?","Actually recall is recognition.","What is memory?","Actually memory grounds recall."],"probe":"What does memory recognise?","expected_entailment_tokens":["recognition","recall"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-009","pattern":"novel_relation_on_seen_pair","premises":["What is judgment?","Actually judgment is conclusion.","What is reason?","Actually reason precedes judgment."],"probe":"What does reason conclude?","expected_entailment_tokens":["conclusion","judgment"],"expected_proposals":2}
|
|
{"id":"CMP-V1-HLD-010","pattern":"composed_predicate","premises":["What is correction?","Actually correction is learning.","What is learning?","Actually learning precedes mastery."],"probe":"What does correction precede?","expected_entailment_tokens":["mastery"],"expected_proposals":2}
|