Shay e64ec578eb feat(evals): frontier comparison benchmark wave 1 (#52) ... * feat(evals): add frontier comparison benchmark wave one scaffold * feat(evals): add frontier comparison runner package * feat(evals): implement frontier comparison wave one suites * feat(evals): add frontier comparison CLI entrypoint * feat(evals): add static frontier benchmark report viewer * test(evals): cover frontier comparison wave one benchmarks * fix(evals): record runtime observation failures instead of aborting suites * docs(evals): document frontier comparison recording UI		2026-05-20 06:27:32 -07:00
..
adversarial_identity
anchor_lens_tour	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
anti_regression
articulation	feat(demo): core demo articulation — discourse-planner spine, end-to-end	2026-05-19 13:41:24 -07:00
articulation_of_status
audit_tour
calibration
classical_literature_ood
cognition	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
cold_start_grounding	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
compositionality
compound_intent_decomposition	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
contradiction_detection
conversation	feat(demo): humanise teaching-grounded surface for layperson display	2026-05-19 14:14:02 -07:00
conversational_thread_coherence	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
cross_domain_transfer
deterministic_fluency
discourse_paragraph
elementary_mathematics_ood
english_fluency_ood
forward_semantic_control
foundational_biology_ood
foundational_physics_ood
frontier_compare	feat(evals): frontier comparison benchmark wave 1 (#52)	2026-05-20 06:27:32 -07:00
grammatical_coverage
hebrew_fluency
identity_divergence
industry_demos
inference_closure
introspection
koine_greek_fluency
lab	lab: teaching layer deep trace + identity config explorer + hardware benchmark (#44)	2026-05-19 23:51:24 -07:00
learning_loop
long_context_cost
monotonic_learning
multi_agent_composition
multi_sentence_response	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
multi_step_reasoning
orthogonality_tour	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
provenance
realizer_guard	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
refusal_calibration
register_tour	feat(register): ADR-0077 — substantive register knobs + layering boundary (R6)	2026-05-19 23:39:11 -07:00
reports
results	chore(evals): refresh pack-measurements artifact to current runtime	2026-05-19 19:16:33 -07:00
sample_efficiency
self_consistency_over_time
symbolic_logic
teaching_injection_resistance
walkthrough_chain	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
warmed_session_consistency	feat(evals+bench): isolation lanes, holdouts, planner-on bench sub-bench	2026-05-19 12:42:55 -07:00
zero_code_domain_acquisition
__init__.py
_parallel.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
baseline_runner.py
CLAIMS.md
cognition_cases.jsonl
framework.py	fix(evals): introspect run_lane signature before passing workers kwarg	2026-05-20 05:59:51 -07:00
holdout_runner.py
metrics.py
parallel.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00
run_cognition_eval.py	parallel eval runner (#46)	2026-05-19 23:51:59 -07:00