core-labs/core
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions

test: promote identity-falsifiability eval into the pre-merge smoke gate

Browse source 
test_pack_measurements_phase2.py (ADR-0043) was reachable only under
`--suite full` and post-merge full-pytest.yml — outside the blocking PR
smoke gate. A regression flipping identity falsifiability (ratified packs
must diverge directionally), the pack-invariant grounding/refusal floor,
or the zero-fabrication invariant therefore cleared the PR gate and
surfaced only post-merge on main (the smoke blind spot for dedicated
test files).

Add the file to both the `smoke` suite tuple (core/cli.py) and the
smoke.yml CI gate so the falsifiability claim blocks-on-regression
rather than detect-after-merge. Adds ~4 min to the PR gate.

Verified: modified smoke gate green on the main base via the
CI-equivalent invocation (140 passed).
This commit is contained in:
Shay 2026-06-03 10:31:56 -07:00
parent 4c095c3621
commit 0c467ba3b6
2 changed files with 15 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
.github/workflows/smoke.yml vendored
View file

@ -1,8 +1,11 @@
name: smoke name: smoke
# Fast PR gate — runs the smoke suite (~2-3 min) on every PR push. # Fast PR gate — runs the smoke suite on every PR push.
# Covers: chat runtime, pipeline, architectural invariants, audio sensorium # Covers: chat runtime, pipeline, architectural invariants, audio sensorium
# (tests/test_audio_*.py — compiler/eval-gates/mount/CRDT-merge/teachers, ~3s). # (tests/test_audio_*.py — compiler/eval-gates/mount/CRDT-merge/teachers, ~3s),
# and identity falsifiability (tests/test_pack_measurements_phase2.py, ADR-0043
# — ratified packs diverge directionally; pack-invariant refusal floor; no
# fabrication). The falsifiability lane adds ~4 min but blocks-on-regression.
# #
# Full pytest runs post-merge to main (see full-pytest.yml). # Full pytest runs post-merge to main (see full-pytest.yml).
# Regressions caught here block the PR; anything outside the smoke # Regressions caught here block the PR; anything outside the smoke
@ -51,4 +54,5 @@ jobs:
tests/test_runtime_config.py \ tests/test_runtime_config.py \
tests/test_cognitive_turn_pipeline.py \ tests/test_cognitive_turn_pipeline.py \
tests/test_architectural_invariants.py \ tests/test_architectural_invariants.py \
tests/test_audio_*.py tests/test_audio_*.py \
tests/test_pack_measurements_phase2.py

8
core/cli.py
View file

@ -41,6 +41,14 @@ _TEST_SUITES: dict[str, tuple[str, ...]] = {
"tests/test_runtime_config.py", "tests/test_runtime_config.py",
"tests/test_cognitive_turn_pipeline.py", "tests/test_cognitive_turn_pipeline.py",
"tests/test_architectural_invariants.py", "tests/test_architectural_invariants.py",
# ADR-0043 — identity falsifiability: ratified identity packs must
# produce distinct, directionally-correct articulations, with a
# pack-invariant grounding/refusal floor and zero fabrication. Lives
# only under ``full`` historically, so a divergence regression cleared
# the PR gate and surfaced only post-merge. Promoted into smoke so
# the falsifiability claim blocks-on-regression rather than
# detect-after-merge.
"tests/test_pack_measurements_phase2.py",
), ),
"runtime": ( "runtime": (
"tests/test_chat_runtime.py", "tests/test_chat_runtime.py",