a4d0c4ebf3
The mandatory lookback before CMB-d (3+ PRs on one surface; next-phase boundary). A 5-dimension
read-only fan-out audit over the 10-item checklist found the CMB-a/b/c substrate composes cleanly:
25 solid / 4 drift / 8 gap / 1 reader hazard. Doc:
docs/analysis/cmb-lookback-review-2026-06-08.md.
Fixes the one real hazard (H3): a query attributing the answer to a SINGLE agent ('how many words
does Alice type' with a distractor second rate) wrongly claimed the substantive
combine_mode_ambiguous — a hygiene over-claim that would corrupt the shared router in CMB-d. The
combined-query gate now excludes single-agent 'does <Agent>' attribution (_SINGLE_AGENT_QUERY) and
steps aside as not_combined_rate_shaped; the genuinely-combined forms ('do they' / 'are produced' /
'does it') still yield combine_mode_ambiguous. Pinned by gold cmb-16 + a reader test.
The review also resolves the CMB-d failure-family classification (input_shape:
not_combined_rate_shaped; must_remain_refused incl. rate_unit_mismatch — DECISIVELY, the reader has
no dimension representation so it cannot tell convertible from incompatible units; proposal_allowed:
combine_mode_ambiguous, missing_second_rate) and enumerates the live CMB-d registry preconditions
(not_combined_rate_shaped mapping, rate_unit_mismatch/non_integer_solution string collisions,
non_positive_net_rate family, Organ/ALL_REASONS extension). Provenance false-alarm (stale local main
checkout) noted + verified against origin/main.
gold 19/19 (6/5/8); reader 11/0/0 + 8 refused-correct; solver 6/0 + 5/0; 0 hygiene breaches; 123
tests; serving + R1/R2/R3 unchanged.
|
||
|---|---|---|
| .. | ||
| adversarial_identity | ||
| anchor_lens_tour | ||
| anti_regression | ||
| articulation | ||
| articulation_of_status | ||
| audio_sensorium | ||
| audit_tour | ||
| calibration | ||
| capability_index | ||
| classical_literature_ood | ||
| cognition | ||
| cold_start_grounding | ||
| combined_rate_oracle | ||
| compositionality | ||
| compound_intent_decomposition | ||
| comprehension | ||
| constraint_oracle | ||
| contemplation_quality | ||
| contradiction_detection | ||
| conversation | ||
| conversational_thread_coherence | ||
| cross_domain_transfer | ||
| curriculum_loop_closure | ||
| deductive_logic | ||
| demo_composition | ||
| determination_closure | ||
| determination_estimation | ||
| deterministic_fluency | ||
| dimensional | ||
| discourse_paragraph | ||
| domain_contract_validation | ||
| edge_budget | ||
| elementary_mathematics_ood | ||
| english_fluency_ood | ||
| environment_falsification | ||
| event_vision_sensorium | ||
| fabrication_control | ||
| flywheel_demo | ||
| forward_semantic_control | ||
| foundational_biology_ood | ||
| foundational_physics_ood | ||
| frontier_compare | ||
| grammatical_coverage | ||
| gsm8k_math | ||
| gsm8k_parser_dev | ||
| hebrew_fluency | ||
| identity_divergence | ||
| industry_demos | ||
| inference_closure | ||
| introspection | ||
| koine_greek_fluency | ||
| l10_continuity | ||
| lab | ||
| learning_arc | ||
| learning_loop | ||
| long_context_cost | ||
| math_bounded_grammar/v1 | ||
| math_capability_axes | ||
| math_expert_claims/v1 | ||
| math_symbolic_equivalence | ||
| math_teaching_corpus/v1 | ||
| miner_loop_closure | ||
| monotonic_learning | ||
| multi_agent_composition | ||
| multi_sentence_response | ||
| multi_step_reasoning | ||
| obligation_2_ood_ratio | ||
| obligation_5_perturbation | ||
| obligation_6_depth_curve | ||
| obligation_8_adversarial | ||
| obligation_10_pack_provenance | ||
| orthogonality_tour | ||
| prompt_diversity | ||
| propositional_logic | ||
| provenance | ||
| public_demo | ||
| rate_oracle | ||
| realizer_guard | ||
| refusal_calibration | ||
| refusal_taxonomy | ||
| register_diagnostics | ||
| register_tour | ||
| relational | ||
| relational_metric | ||
| reports | ||
| results | ||
| reviewer_registry | ||
| sample_efficiency | ||
| self_consistency_over_time | ||
| sensorimotor_sensorium | ||
| sensorium | ||
| set_membership | ||
| setup_oracle | ||
| syllogism | ||
| symbolic_logic | ||
| teaching_injection_resistance | ||
| total_ordering | ||
| vision_sensorium | ||
| walkthrough_chain | ||
| warmed_session_consistency | ||
| zero_code_domain_acquisition | ||
| __init__.py | ||
| _parallel.py | ||
| baseline_runner.py | ||
| CLAIMS.md | ||
| cognition_cases.jsonl | ||
| framework.py | ||
| holdout_runner.py | ||
| metrics.py | ||
| parallel.py | ||
| run_cognition_eval.py | ||