core/evals
Shay 075169c33c feat(evals): v2 lanes — monotonic-learning + provenance
monotonic-learning v2:
  public/v2  — 5 domains × 3-4 probes × 20 cycles (377 ops)
                domains: truth, light, wisdom, order, memory
                max_regression=0.0, floor_score=1.0
  holdouts/v2 — 4 distinct domains × 3-4 probes × 18 cycles (284 ops)
                domains: creation, knowledge, reason, spirit
                max_regression=0.0, floor_score=1.0

  Demonstrates the structural claim (zero regression on prior domains
  as new ones accumulate) at substantially deeper cycle count and
  broader domain breadth than v1.

provenance v2:
  public/v2  — 30 cases across pack_axiom, vault_recall, teaching, mixed
                deeper priming (3-5 turns), mixed-kind cases combining
                pack + vault + teaching sources in one probe
                source_attribution=1.0, source_validity=1.0,
                replay_determinism=1.0, input_sensitivity=1.0
  holdouts/v2 — 20 cases on distinct vocabulary
                all sub-metrics 1.0

Generator: scripts/generate_monotonic_cases.py extended with three
extra domain probe sets (order, memory, reason, spirit) and split
definitions for v2.
2026-05-16 13:03:28 -07:00
..
adversarial_identity feat(evals): frontier structural-zero baselines for Phase 2 v1 lanes 2026-05-16 12:45:28 -07:00
calibration feat(evals): frontier structural-zero baselines for Phase 2 v1 lanes 2026-05-16 12:45:28 -07:00
cognition feat(evals): Phase 0 — benchmark methodology lock-in and eval framework 2026-05-15 22:36:53 -07:00
grammatical_coverage feat(evals): grammatical-coverage v2 cases - 36 cases with deeper nesting and rarer vocabulary (100% pass) 2026-05-16 06:40:55 -07:00
identity_divergence feat(evals): identity-divergence lane v1 - 93 curriculum events, two axis profiles (Precision/Generosity), divergence/coherence/causal metrics (all pass) 2026-05-16 06:48:13 -07:00
monotonic_learning feat(evals): v2 lanes — monotonic-learning + provenance 2026-05-16 13:03:28 -07:00
provenance feat(evals): v2 lanes — monotonic-learning + provenance 2026-05-16 13:03:28 -07:00
reports Add cognitive eval harness and calibration replay (#30) 2026-05-15 07:41:36 -07:00
symbolic_logic feat(evals): frontier structural-zero baselines for Phase 2 v1 lanes 2026-05-16 12:45:28 -07:00
zero_code_domain_acquisition feat began creation of zero code domain acquisition. did not complete yet. 2026-05-16 06:31:01 -07:00
__init__.py Add cognitive eval harness and calibration replay (#30) 2026-05-15 07:41:36 -07:00
baseline_runner.py feat(evals): frontier structural-zero baselines for Phase 2 v1 lanes 2026-05-16 12:45:28 -07:00
cognition_cases.jsonl feat: vault recall index, Rust versor parity, cognitive pack expansion 2026-05-15 15:34:39 -07:00
framework.py feat(evals): Phase 0 — benchmark methodology lock-in and eval framework 2026-05-15 22:36:53 -07:00
holdout_runner.py feat(evals): Phase 0 — benchmark methodology lock-in and eval framework 2026-05-15 22:36:53 -07:00
metrics.py Add cognitive eval harness and calibration replay (#30) 2026-05-15 07:41:36 -07:00
run_cognition_eval.py Add cognitive eval harness and calibration replay (#30) 2026-05-15 07:41:36 -07:00