core/evals
Shay 2dc1462b40
chore(evals): ratify GSM8K train proxy rebaseline 6/44/0 → 30/20/0 (#848)
- evals/gsm8k_math/train_sample/v1/report.json: rebaselined from
  correct=6/refused=44/wrong=0 to correct=30/refused=20/wrong=0.
  wrong_ids == []. exit_criterion.passed: false → true.
  Written deterministically by the canonical runner (write_report /
  json.dumps sort_keys=True).

- docs/sessions/gsm8k-train-proxy-rebaseline-2026-06-20.md: new audit
  note documenting why #846's report update was unauthorized, why #847
  restored the pin, and why this PR is the explicit authorization
  boundary for the committed rebaseline.

- HANDOFF-gpt55-2026-06-20.md: small factual note appended to the
  'Latest continuity pointer' section recording this rebaseline status.

Authorization chain:
  ADR-0126 (exit criterion) →
  #846 kernel changes (produce 30/20/0) →
  #847 reconciliation (restores pin, delegates to this PR) →
  this PR (explicit rebaseline authorization)

Non-goals: no runtime, serving, teaching, capability, or kernel change.
No quantity-entity work. No new eval artifacts. No teaching proposals.
2026-06-20 19:54:21 -07:00
..
adversarial_identity
anchor_lens_tour
anti_regression
articulation
articulation_of_status
audio_sensorium
audit_tour
calibration
capability_index
classical_literature_ood
close_derived_climb
cognition
cold_start_grounding
combined_rate_oracle
compositionality
compound_intent_decomposition
comprehension
constraint_oracle
contemplation_quality
contradiction_detection
conversation
conversational_thread_coherence
cross_domain_transfer
curriculum_loop_closure
deductive_logic
demo_composition
determination_closure
determination_estimation
deterministic_fluency
dimensional
discourse_paragraph
domain_contract_validation
edge_budget
elementary_mathematics_ood
english_fluency_ood
environment_falsification
event_vision_sensorium
fabrication_control
field_incidence
flywheel_demo
forward_semantic_control
foundational_biology_ood
foundational_physics_ood
frame_verdict_text_cwa
frontier_compare
grammatical_coverage
gsm8k_math chore(evals): ratify GSM8K train proxy rebaseline 6/44/0 → 30/20/0 (#848) 2026-06-20 19:54:21 -07:00
gsm8k_parser_dev
hebrew_fluency
identity_divergence
industry_demos
inference_closure
introspection
koine_greek_fluency
l10_always_on
l10_continuity
lab
learning_arc
learning_loop fix(ci): re-pin public_demo lane SHA after showcase content drift (#807) 2026-06-17 15:42:40 -07:00
long_context_cost
math_bounded_grammar/v1
math_capability_axes
math_expert_claims/v1
math_symbolic_equivalence
math_teaching_corpus/v1
miner_loop_closure
monotonic_learning
multi_agent_composition
multi_sentence_response
multi_step_reasoning
obligation_2_ood_ratio
obligation_5_perturbation
obligation_6_depth_curve
obligation_8_adversarial
obligation_10_pack_provenance
orthogonality_tour
prompt_diversity
proofwriter_owa
propositional_logic
provenance
public_demo fix(ci): re-pin public_demo lane SHA after showcase content drift (#807) 2026-06-17 15:42:40 -07:00
rate_oracle
realizer_guard
refusal_calibration
refusal_taxonomy
register_diagnostics
register_tour fix(ci): re-pin public_demo lane SHA after showcase content drift (#807) 2026-06-17 15:42:40 -07:00
relational
relational_inference/v1
relational_metric
relational_transitive
reports
results
reviewer_registry
sample_efficiency
self_consistency_over_time
sensorimotor_sensorium
sensorium
set_membership
setup_oracle
syllogism
symbolic_logic
teaching_injection_resistance
total_ordering
vision_sensorium
walkthrough_chain
warmed_session_consistency
zero_code_domain_acquisition
__init__.py
_parallel.py
baseline_runner.py
CLAIMS.md
cognition_cases.jsonl
framework.py
holdout_runner.py
metrics.py
parallel.py
run_cognition_eval.py