core-labs/core - Forgejo: Beyond coding. We forge.

core-labs/core

Fork 0

Commit graph

Author	SHA1	Message	Date
Shay	f03979f025	feat: integrate hardened CLOSE yardstick into determinism & teaching regression surfaces - docs/testing-lanes.md + Makefile: recommended determinism regression invocation (uv run python -m evals.close_derived_climb + contract pytest) as part of standard verification story / rerun flows. - evals/anti_regression/run_demo.py + tests/test_anti_regression_demo.py: hermetic embedding of the yardstick (lived IdleTickResult flag, semantic determine rule=direct, content_replay_checksum) into the core anti-regression / teaching demo flow (core demo anti-regression now carries + reports the Claim-B signals; active corpus remains untouched). - Supporting docs: contract.md (uv + refs), anti_regression_demo.md (complementary note), runtime_contracts.md (determination surface cross-ref). - New ratification artifact (pre-impl) + all success criteria met. See ratification for chosen approach + why only correct path. All existing tests/invariants green; hermeticity preserved; no core/engine changes.	2026-06-16 17:25:05 -07:00
Shay	7a20356ab6	feat(eval): harden close-derived-climb yardstick to full Claim B (#791 ) - Semantic: determine() asserts (rule=direct) on positives post-FP in climbs - Lived flag: _proposal_flag_effect now uses real idle_tick + IdleTickResult.derived_close_proposals_emitted (temp sink isolation) - Checksum: added content_replay_checksum (canonical closures + proposal bodies) - Docs: contract.md + module docstrings updated for accuracy Ratification artifact created before impl (see docs/analysis/...-ratification-...md). All original metrics, wrong_total=0, invariants preserved. Closes the 3 gaps from post-merge audit for Claim B.	2026-06-16 17:10:11 -07:00
Shay	cf1e73716c	feat(eval): yardstick for CLOSE derived climb (#790 ) * feat(eval): add yardstick lane for CLOSE derived climb (is-a + relational + flag + wrong=0) * fix(eval): correct proposal flag measurement in yardstick (direct emit for isolation; runner now reports True) * fix(eval): measure CLOSE climb from live queries * fix(eval): require strict CLOSE climb growth	2026-06-16 16:09:56 -07:00

Author

SHA1

Message

Date

Shay

f03979f025

feat: integrate hardened CLOSE yardstick into determinism & teaching regression surfaces

- docs/testing-lanes.md + Makefile: recommended determinism regression invocation (uv run python -m evals.close_derived_climb + contract pytest) as part of standard verification story / rerun flows.
- evals/anti_regression/run_demo.py + tests/test_anti_regression_demo.py: hermetic embedding of the yardstick (lived IdleTickResult flag, semantic determine rule=direct, content_replay_checksum) into the core anti-regression / teaching demo flow (core demo anti-regression now carries + reports the Claim-B signals; active corpus remains untouched).
- Supporting docs: contract.md (uv + refs), anti_regression_demo.md (complementary note), runtime_contracts.md (determination surface cross-ref).
- New ratification artifact (pre-impl) + all success criteria met.

See ratification for chosen approach + why only correct path.
All existing tests/invariants green; hermeticity preserved; no core/engine changes.

2026-06-16 17:25:05 -07:00

Shay

7a20356ab6

feat(eval): harden close-derived-climb yardstick to full Claim B (#791 )

- Semantic: determine() asserts (rule=direct) on positives post-FP in climbs
- Lived flag: _proposal_flag_effect now uses real idle_tick + IdleTickResult.derived_close_proposals_emitted (temp sink isolation)
- Checksum: added content_replay_checksum (canonical closures + proposal bodies)
- Docs: contract.md + module docstrings updated for accuracy

Ratification artifact created before impl (see docs/analysis/...-ratification-...md).
All original metrics, wrong_total=0, invariants preserved.
Closes the 3 gaps from post-merge audit for Claim B.

2026-06-16 17:10:11 -07:00

Shay

cf1e73716c

feat(eval): yardstick for CLOSE derived climb (#790 )

* feat(eval): add yardstick lane for CLOSE derived climb (is-a + relational + flag + wrong=0)

* fix(eval): correct proposal flag measurement in yardstick (direct emit for isolation; runner now reports True)

* fix(eval): measure CLOSE climb from live queries

* fix(eval): require strict CLOSE climb growth

2026-06-16 16:09:56 -07:00

3 commits