9736dcc03f
- Makefile: new 'test-close-flywheel' target (clearly named heavy surface; runs full Claim-B yardstick + anti embedding; explicitly not in fast/slow/full). - docs/testing-lanes.md: new prominent 'Dedicated CLOSE Flywheel Regression Surface (Claim-B Level)' section with purpose, invocation (make primary), full Claim-B capabilities list, runtime (~60s+ heavy), hermeticity guarantees, Engineering Pillars alignment (Mechanical Sympathy / Semantic Rigor / Third Door per Whitepaper), and all cross-refs (ratifs, contract, anti demo, etc.). - Cleanly embed / polish (additive, hermetic, building on #792): anti_regression/run_demo.py (comments + RESULT label the surface + make target), test_anti_regression_demo.py (updated docstring), docs/evals/anti_regression_demo.md (how-to + complementary section updated for surface participation). - Supporting: contract.md (dedicated surface note + ratif links), runtime_contracts.md (tightened ref). Ratified first (docs/analysis/close-flywheel-dedicated-regression-surface-ratification-2026-06-16.md). Strictly in scope. Preserves all invariants (wrong_total=0, determinism, proposal-only, etc.). No core, no CLI additions, no fast/CI inclusion, no teaching logic changes. See ratification for pillars justification and 'why only correct path'.
45 lines
2.3 KiB
Makefile
45 lines
2.3 KiB
Makefile
# Test lanes — see docs/testing-lanes.md.
|
|
#
|
|
# Slow tests are classified in conftest.py (SLOW_FILES / SLOW_TESTS), not via
|
|
# in-file decorators. Classification adds the `slow` marker only; it never
|
|
# skips, so the lanes below are selected explicitly by marker expression.
|
|
#
|
|
# These run serially. Parallel (`-n auto`) is intentionally NOT the default
|
|
# until the suite is xdist-hermetic (shared repo engine_state/ + report.json +
|
|
# teaching/proposals writers race under parallel workers). See
|
|
# docs/testing-lanes.md "Follow-up: xdist".
|
|
#
|
|
# CLOSE flywheel Claim-B determinism (post-#791 hardening): after any
|
|
# CLOSE/idle_tick/realize_derived/consolidate/vault/determine change, also run
|
|
# uv run python -m evals.close_derived_climb
|
|
# uv run python -m pytest tests/test_derived_close_proposals.py tests/test_architectural_invariants.py -q
|
|
# See docs/testing-lanes.md "Recommended determinism / teaching regression invocation".
|
|
|
|
.PHONY: test-fast test-slow test-full test-close-flywheel
|
|
|
|
# Fast dev lane — excludes the slow soak/bench/proof/eval-matrix registry.
|
|
test-fast:
|
|
uv run pytest -m "not quarantine and not slow" -q
|
|
|
|
# Slow lane — only the heavyweight registry tests.
|
|
test-slow:
|
|
uv run pytest -m "slow and not quarantine" -q
|
|
|
|
# Full lane — everything except known-failing quarantine (what CI runs).
|
|
test-full:
|
|
uv run pytest -m "not quarantine" -q
|
|
|
|
# Dedicated CLOSE Flywheel Regression Surface (Claim-B Level)
|
|
# High-signal, intentional regression target for heavier determinism
|
|
# regressions and teaching/anti-regression verification flows (not fast
|
|
# local dev or CI). Exercises the full hardened Claim-B yardstick:
|
|
# - lived ChatRuntime.idle_tick() + IdleTickResult.derived_close_proposals_emitted
|
|
# - semantic determine() + Determined(..., rule='direct') asserts
|
|
# - content_replay_checksum (canonical closures + proposal bodies)
|
|
# - wrong_total=0, 1/5/8 growth, full determinism, hermeticity
|
|
# See docs/testing-lanes.md "Dedicated CLOSE Flywheel Regression Surface..."
|
|
# Explicitly heavy (real runtimes; ~60s+); composable via make; respects
|
|
# Mechanical Sympathy / Semantic Rigor / Third Door.
|
|
test-close-flywheel:
|
|
uv run python -m evals.close_derived_climb
|
|
uv run python -m pytest tests/test_derived_close_proposals.py tests/test_architectural_invariants.py tests/test_anti_regression_demo.py -q
|