core/tests/test_deduction_serve_e2e.py
Shay ab6da7765e feat(deduction-serve): Band v4-CM — conditional-membership fusion, decided (ADR-0259)
Composes v2-EN's connective grammar (if/then, or, and, either) with
v3-MEM's singular-membership sentence reading over one shared
per-individual atom space, so "If Socrates is a man then Socrates is
mortal. Socrates is a man. Therefore Socrates is mortal." decides — the
exact gap ADR-0258 §6.1 reserved. Genuinely fuses the two mechanisms: a
bare universal's instantiated atom can unify (via the same closed
morphology relation) with a connective leaf's atom, deciding arguments
neither band alone could.

- generate/proof_chain/cond_member.py: new reader. A sentence is checked
  for a connective token BEFORE the universal-lead check (so a stray
  connective can never leak into an opaque name/class run); reuses v3-MEM's
  own _parse_singular/_parse_universal verbatim (already negation-aware,
  so no separate negation layer is needed, unlike v2-EN's opaque minter).
  Four new shape-bands (fused/disjunctive/chain/conditional), each earning
  its own SERVE license.
- chat/deduction_surface.py: new fallback tier tried strictly after v3-MEM
  — pure widening, every previously-served argument stays byte-identical.
- evals/deduction_serve/practice/gold.py: 4 new synthetic template groups
  (20 templates), reusing the v3-MEM case generator; intended formulas
  cross-checked against the independent oracle (INV-25).
- evals/deduction_serve/v2_condmem/: 26 hand-authored real-English cases,
  content-disjoint from the synthetic corpus.
- ds-mem-0024 promoted declined -> unknown (not entailed — the antecedent
  is never asserted in that text; this is the first promotion in the
  corpus that doesn't land on entailed).
- Ledger re-sealed to 17 bands; deduction_serve_v1 lane SHA re-pinned
  (surgical single-line edit, not a blanket --update).

Verification: core test --suite deductive 160 passed (31 new reader
tests); practice arena 17 bands x 720 wrong=0, all SERVE-licensed; lane
splits v1 28/28, v2_en 26/26, v2_member 26/26, v2_condmem 26/26; smoke 180
passed; warmed_session 10 passed. Flag deduction_serving_enabled stays
default-off.
2026-07-24 10:14:00 -07:00

168 lines
7.1 KiB
Python

"""Deduction-serve arc, Phase 5 — end-to-end workflow through the real REPL path.
The arc's original goal, pinned against the ACTUAL serving spine (``ChatRuntime``,
the driver ``core chat`` constructs) rather than the composer in isolation:
a user asks a basic logic question -> CORE decides -> an articulated,
deterministic, telemetered response comes back.
Also pins the peripheral-systems wiring (Phase 5): deduction turns are
well-formed ``TurnEvent``s tagged ``grounding_source="deduction"``, they advance
the served-turn counter (so ADR-0255 discovery-yield counts them), and they
carry an observable ``DispatchAttempt`` — with the whole thing byte-identical
when the flag is off.
"""
from __future__ import annotations
from chat.runtime import ChatRuntime
from core.config import RuntimeConfig
def _runtime(enabled: bool) -> ChatRuntime:
return ChatRuntime(
config=RuntimeConfig(deduction_serving_enabled=enabled), no_load_state=True,
)
def test_end_to_end_propositional_and_categorical_workflow() -> None:
rt = _runtime(True)
prop = rt.chat("If p then q. p. Therefore q.")
assert prop.grounding_source == "deduction"
assert "Your premises entail: q" in prop.surface
cat = rt.chat(
"All mammals are animals. All whales are mammals. "
"Therefore all whales are animals."
)
assert cat.grounding_source == "deduction"
assert "valid" in cat.surface and "follows" in cat.surface
def test_deduction_turns_are_well_formed_served_turns() -> None:
"""turn_log grows and the served-turn counter advances — so a deduction
conversation is real served traffic (ADR-0255 discovery-yield denominator)."""
rt = _runtime(True)
before = rt._context.turn
rt.chat("p or q. Not p. Therefore q.")
rt.chat("If a then b. If b then c. a. Therefore c.")
assert len(rt.turn_log) == 2
assert rt._context.turn == before + 2
last = rt.turn_log[-1]
assert last.grounding_source == "deduction"
def test_dispatch_trace_records_deduction_commit() -> None:
rt = _runtime(True)
resp = rt.chat("If p then q. p. Therefore q.")
assert resp.dispatch_trace is not None
assert resp.dispatch_trace.selected == "deduction"
committed = [
a for a in resp.dispatch_trace.attempts
if a.source == "deduction" and a.outcome == "admitted"
]
assert committed, "a committed deduction turn must record an admitted DispatchAttempt"
def test_flag_off_is_byte_identical_across_bands() -> None:
"""With the flag off, both a propositional and a categorical argument fall
through to the pre-arc pack-token-gloss surface, unchanged."""
rt = _runtime(False)
for text in [
"If p then q. p. Therefore q.",
"All mammals are animals. All whales are mammals. Therefore all whales are animals.",
]:
resp = rt.chat(text)
assert resp.grounding_source == "pack"
assert "Pack-resident tokens" in resp.surface
def test_natural_english_argument_is_decided_end_to_end() -> None:
"""The Band v1 boundary case is now the Band v2-EN (ADR-0257) flagship:
a natural-English argument decided through the real REPL spine, with the
verdict rendered over the user's own clauses."""
rt = _runtime(True)
resp = rt.chat("If it rains then the ground is wet. It rains. Therefore the ground is wet.")
assert resp.grounding_source == "deduction"
assert "Your premises entail: the ground is wet" in resp.surface
tollens = rt.chat(
"If the seal is broken then the tank is empty. If the tank is empty then "
"the pump is dry. The pump is not dry. Therefore the seal is not broken."
)
assert tollens.grounding_source == "deduction"
assert "Your premises entail: the seal is not broken" in tollens.surface
def test_quoted_clause_surface_is_exempt_from_realizer_guard() -> None:
"""Regression (ADR-0257): the C1 slot-type guard must not reject a
deduction surface for quoting the user's own clause. The pack lists
``open`` as VERB (its composed sense), which made R3 fire on the honest
quoted copular "the door is not open" and silently replace a CORRECT
entailment with the disclosure fallback. Deduction surfaces are exempt
(quoted template, not slot composition) — pinned cold AND warm, since the
guard runs on both dispatch paths."""
text = (
"Either the door is open or the window is open. The door isn't open. "
"Therefore the window is open."
)
cold = _runtime(True)
resp = cold.chat(text)
assert resp.grounding_source == "deduction"
assert "Your premises entail: the window is open" in resp.surface
warm = _runtime(True)
warm.chat("If p then q. p. Therefore q.") # advance past the cold turn
resp_warm = warm.chat(text)
assert resp_warm.grounding_source == "deduction"
assert "Your premises entail: the window is open" in resp_warm.surface
def test_member_argument_is_decided_end_to_end() -> None:
"""The ADR-0258 flagship: the classic instantiation syllogism ("Socrates
is a man…"), decided through the real REPL spine via per-individual
lowering, rendered over the user's own sentences — including the A-chain
into an E-form."""
rt = _runtime(True)
resp = rt.chat("Socrates is a man. All men are mortal. Therefore Socrates is mortal.")
assert resp.grounding_source == "deduction"
assert "Your premises entail: socrates is mortal" in resp.surface
negative = rt.chat(
"Tweety is a canary. All canaries are birds. No birds are reptiles. "
"Therefore Tweety is not a reptile."
)
assert negative.grounding_source == "deduction"
assert "Your premises entail: tweety is not a reptile" in negative.surface
def test_conditional_membership_fusion_is_decided_end_to_end() -> None:
"""The ADR-0259 flagship: a conditional whose clauses are membership
facts, decided through the real REPL spine — including the genuine
fusion case where a bare universal's instantiated atom unifies with a
connective leaf's atom."""
rt = _runtime(True)
resp = rt.chat(
"If Socrates is a man then Socrates is mortal. Socrates is a man. "
"Therefore Socrates is mortal."
)
assert resp.grounding_source == "deduction"
assert "Your premises entail: socrates is mortal" in resp.surface
fused = rt.chat(
"All men are mortal. If Socrates is a philosopher then Socrates is a man. "
"Socrates is a philosopher. Therefore Socrates is mortal."
)
assert fused.grounding_source == "deduction"
assert "Your premises entail: socrates is mortal" in fused.surface
def test_out_of_regime_argument_refuses_honestly() -> None:
"""A 'therefore' argument NO band can read (verb-phrase negation —
ADR-0257 scope-out #2, morphology work reserved for a future band) gets an
honest committed refusal surface, never a fluent-but-ungrounded answer or
a silent fall-through (INV-34 fail-closed)."""
rt = _runtime(True)
resp = rt.chat("The engine doesn't start. Therefore the engine is broken.")
assert resp.grounding_source == "deduction"
assert "can't parse" in resp.surface # honest reader-refusal disclosure