core/evals
Shay 2dc1462b40
chore(evals): ratify GSM8K train proxy rebaseline 6/44/0 → 30/20/0 (#848)
- evals/gsm8k_math/train_sample/v1/report.json: rebaselined from
  correct=6/refused=44/wrong=0 to correct=30/refused=20/wrong=0.
  wrong_ids == []. exit_criterion.passed: false → true.
  Written deterministically by the canonical runner (write_report /
  json.dumps sort_keys=True).

- docs/sessions/gsm8k-train-proxy-rebaseline-2026-06-20.md: new audit
  note documenting why #846's report update was unauthorized, why #847
  restored the pin, and why this PR is the explicit authorization
  boundary for the committed rebaseline.

- HANDOFF-gpt55-2026-06-20.md: small factual note appended to the
  'Latest continuity pointer' section recording this rebaseline status.

Authorization chain:
  ADR-0126 (exit criterion) →
  #846 kernel changes (produce 30/20/0) →
  #847 reconciliation (restores pin, delegates to this PR) →
  this PR (explicit rebaseline authorization)

Non-goals: no runtime, serving, teaching, capability, or kernel change.
No quantity-entity work. No new eval artifacts. No teaching proposals.
2026-06-20 19:54:21 -07:00
..
adversarial_identity
anchor_lens_tour
anti_regression feat: strengthen visibility and measurement of CLOSE flywheel proposal review/ratification side (#794) 2026-06-16 19:33:25 -07:00
articulation
articulation_of_status
audio_sensorium
audit_tour
calibration
capability_index feat(reader): add overlaps_event finite-verb reader surface (B3) (#783) 2026-06-15 14:56:09 -07:00
classical_literature_ood
close_derived_climb feat: strengthen visibility and measurement of CLOSE flywheel proposal review/ratification side (#794) 2026-06-16 19:33:25 -07:00
cognition
cold_start_grounding
combined_rate_oracle
compositionality
compound_intent_decomposition
comprehension
constraint_oracle
contemplation_quality
contradiction_detection
conversation
conversational_thread_coherence
cross_domain_transfer
curriculum_loop_closure
deductive_logic
demo_composition
determination_closure
determination_estimation
deterministic_fluency
dimensional
discourse_paragraph
domain_contract_validation
edge_budget
elementary_mathematics_ood
english_fluency_ood
environment_falsification
event_vision_sensorium
fabrication_control
field_incidence work done towards furthering comprehension, contemplation, learning, and also began working on fixing some failing tests 2026-06-16 12:27:59 -07:00
flywheel_demo
forward_semantic_control
foundational_biology_ood
foundational_physics_ood
frame_verdict_text_cwa feat(frame-verdict): closed-world FrameVerdict substrate — PR-1..4 + hardening (ADR-0222 B4) (#787) 2026-06-16 06:23:03 -07:00
frontier_compare
grammatical_coverage
gsm8k_math chore(evals): ratify GSM8K train proxy rebaseline 6/44/0 → 30/20/0 (#848) 2026-06-20 19:54:21 -07:00
gsm8k_parser_dev
hebrew_fluency
identity_divergence
industry_demos
inference_closure
introspection
koine_greek_fluency
l10_always_on
l10_continuity
lab
learning_arc
learning_loop fix(ci): re-pin public_demo lane SHA after showcase content drift (#807) 2026-06-17 15:42:40 -07:00
long_context_cost
math_bounded_grammar/v1
math_capability_axes
math_expert_claims/v1
math_symbolic_equivalence
math_teaching_corpus/v1
miner_loop_closure
monotonic_learning
multi_agent_composition
multi_sentence_response
multi_step_reasoning
obligation_2_ood_ratio
obligation_5_perturbation
obligation_6_depth_curve
obligation_8_adversarial
obligation_10_pack_provenance
orthogonality_tour
prompt_diversity
proofwriter_owa feat(eval): ProofWriter-OWA refusal-floor lane (B1) — independent oracle, measure-only (#779) 2026-06-15 12:28:20 -07:00
propositional_logic
provenance
public_demo fix(ci): re-pin public_demo lane SHA after showcase content drift (#807) 2026-06-17 15:42:40 -07:00
rate_oracle
realizer_guard
refusal_calibration
refusal_taxonomy
register_diagnostics
register_tour fix(ci): re-pin public_demo lane SHA after showcase content drift (#807) 2026-06-17 15:42:40 -07:00
relational feat(reader): add overlaps_event finite-verb reader surface (B3) (#783) 2026-06-15 14:56:09 -07:00
relational_inference/v1 feat(reader): add overlaps_event finite-verb reader surface (B3) (#783) 2026-06-15 14:56:09 -07:00
relational_metric
relational_transitive feat(determine): add transitive strict-order relational inference (#781) 2026-06-15 14:20:30 -07:00
reports
results
reviewer_registry
sample_efficiency
self_consistency_over_time
sensorimotor_sensorium
sensorium
set_membership
setup_oracle
syllogism
symbolic_logic
teaching_injection_resistance
total_ordering
vision_sensorium
walkthrough_chain
warmed_session_consistency
zero_code_domain_acquisition
__init__.py
_parallel.py
baseline_runner.py
CLAIMS.md
cognition_cases.jsonl
framework.py
holdout_runner.py
metrics.py
parallel.py
run_cognition_eval.py