e9b7eb0b1f
* chore(ADR-0163.C): land three Phase C pending proposals in live log Phase C (#301) shipped the CLI but its PR dry-run wrote to a tmp log path. This commit moves the three Phase C proposals into the live teaching/proposals/proposals.jsonl so the Phase B→C audit trail is visible in the proposal log and the proposals are ready for the operator to ratify after Phase D ships. Proposals (all state=pending, kind="exemplar_corpus"): - 59223f13722f906a1cf9b65d9b01c990 — descriptive_setup_no_quantity - 46ce297f797ff16da12db5de422ca3c9 — rate_with_currency - a3b892546977c5f0f64c578d6052adbd — temporal_aggregation Produced by `core teaching propose-from-exemplars --all` against the live Phase B corpora. No ratification (ADR-0161 §5 — only the repo owner ratifies). The Phase D admissibility-replay gate confirmed replay_equivalent=true, wrong_count_delta=0 for all three. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> * feat(ADR-0163.D): wire ratified RecognizerSpecs into math_candidate_graph admissibility surface Phase D is the first PR to extend the math admission surface. The audit (#294) said the gap was admission, not operators, algebra, substrate, or packs. Phase A measured the refusal taxonomy. Phase B authored seeds. Phase C synthesized recognizers. Phase D wires those recognizers into generate/math_candidate_graph.py. Modules - generate/recognizer_registry.py — pure projection over the proposal log. Only proposals with source.kind="exemplar_corpus" AND review_state="accepted" enter the tuple. Sorted by (review_date, proposal_id). In-process cache keyed on log (mtime, sha256) — no filesystem cache (ADR-0161 §1). Malformed accepted specs raise RegistryLoadError citing the offending proposal_id; silent drops are forbidden. - generate/recognizer_match.py — per-category rules-only matchers (no LLM, no embedding, no learned classifier). Honors the Phase C synthesizer's narrowness rule: out-of-corpus currency symbols, window units, and per-unit values do NOT match. Three matchers: _match_descriptive_setup_no_quantity (zero-quantity surface), _match_temporal_aggregation (event_count_per_window with observed_window_units/quantifiers honored), _match_rate_with_currency (currency_per_unit_rate with observed currency/per-unit/amount-kind honored). - generate/math_candidate_graph.py — narrowest-edit guard at the per-statement choice loop. Before the existing "no admissible candidate for statement" refusal, consult the ratified registry. Recognized statements are dropped from per_sentence_choices (zero math state) so the Cartesian product is identical to "this statement was never there." Empty registry is a no-op — backward compatibility preserved byte-identically. Downstream consumption of parsed_anchors (turning recognized rate/temporal surfaces into solver state that produces concrete answers) is Phase E follow-up. Tests (32 new) - tests/_phase_d_fixture.py — synthetic in-memory ratified registry built from the three Phase C pending proposals' content. Per ADR-0161 §5 the agent does NOT ratify the live log; the synthetic registry round-trips the real RecognizerSpec bytes the operator will ratify after Phase D ships. - tests/test_recognizer_registry.py (9) — empty/pending/wrong-kind filtering, sort order, malformed-spec rejection, cache hit + invalidation, live-log Phase C audit check. - tests/test_recognizer_match.py (14) — per-category positive cases, narrowness (out-of-corpus surface forms rejected), no-LLM import check. - tests/test_candidate_graph_recognizer_wiring.py (7) — empty registry preserves existing refusal; synthetic registry: recognized statements no longer trigger per-statement refusal; wrong_count_delta == 0 on GSM8K train_sample; capability axes G1.. G5+S1 wrong=0 unchanged; per-category admission counts on the refused-set; unrecognized statements still refuse with the existing reason. - tests/test_phase_d_replay_evidence.py (2) — full admissibility replay gate under synthetic registry: replay_equivalent=true, wrong_count_delta=0, every capability axis wrong=0; each ratified recognizer admits >= 1 train_sample statement (wiring is consequential). Per-category fixture-based admission counts (synthetic registry vs GSM8K train_sample refused-set sentences): - descriptive_setup_no_quantity: 40 - rate_with_currency: 2 - temporal_aggregation: 7 Narrowness-invariant negative case results (matcher correctly returns None on out-of-corpus / load-bearing-math surfaces): - rate_with_currency: "She paid $5 for the book." (no per-unit) - temporal_aggregation: "On Saturday she went to the store." (single day token) - descriptive_setup_no_quantity: "There are some kids in camp." (indefinite quantifier) Candidates for Phase B round 2 (3 of 20 temporal seeds match the spec's structural commitment but not my surface regex — author_notes explicitly flagged these as schema-gap edge cases): - ta-v1-0004 "Mark does a gig every other day for 2 weeks." - ta-v1-0012 "Robin walks 4 dogs every other day around the park." - ta-v1-0019 "The pump fills the tank with 80 gallons over 6 hours." Three landed wirings DO NOT shift the GSM8K train_sample baseline counts under fixture (correct=3, wrong=0, refused=47 unchanged) — Phase D's narrow wiring is wrong=0 safe by construction; lift to "correct" requires Phase E's downstream parser-side consumption of parsed_anchors. Capability axes G1..G5+S1 wrong=0 unchanged. Cross-refs: ADR-0163 (Phase D), ADR-0057 (proposal review), ADR-0151 (auto-proposal), ADR-0161 §5 (ratification boundary), Phase A PR #297, Phase B PR #298, Phase C PR #301. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
50 lines
30 KiB
JSON
50 lines
30 KiB
JSON
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_truth_grounds_knowledge","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"39d09297759f5bfa54e037d089a9fd11","proposed_chain":{"connective":"requires","intent":"cause","object":"knowledge","subject":"understanding"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"a199f13dba127a34cb8fa4bf28728020bec932e6b55c24c93ee1ef1be8d51063"}}
|
|
{"event":"replay","proposal_id":"39d09297759f5bfa54e037d089a9fd11","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_wisdom_orders_judgment","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"944c6c5180819c9194765f32dbc31714","proposed_chain":{"connective":"requires","intent":"cause","object":"wisdom","subject":"judgment"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"1f1a1387a4cd1cecb27dc6fb37af0e3322afd8bc23b6abeb9c9c0e5e606cf91a"}}
|
|
{"event":"replay","proposal_id":"944c6c5180819c9194765f32dbc31714","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_truth_grounds_knowledge","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"a5647f07a0227d1853f926d439603f28","proposed_chain":{"connective":"grounds","intent":"verification","object":"knowledge","subject":"evidence"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"b568e12273ddac1c0bf6e611ae331febcffc9f4df7a47df7f575416277d288f1"}}
|
|
{"event":"replay","proposal_id":"a5647f07a0227d1853f926d439603f28","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_knowledge_requires_evidence","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"bb01f8acd6f5db144bdac21a6f754dc7","proposed_chain":{"connective":"requires","intent":"cause","object":"evidence","subject":"inference"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"a4e1560e3e65f32d2b77496d9fe819038a9c0df2d7c8112fa8aaf6347b7b7081"}}
|
|
{"event":"replay","proposal_id":"bb01f8acd6f5db144bdac21a6f754dc7","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"transition","note":"Epistemology v1: understanding requires knowledge","proposal_id":"39d09297759f5bfa54e037d089a9fd11","to":"accepted"}
|
|
{"chain_id":"cause_understanding_requires_knowledge","event":"accepted_corpus_append","proposal_id":"39d09297759f5bfa54e037d089a9fd11","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Epistemology v1: judgment requires wisdom","proposal_id":"944c6c5180819c9194765f32dbc31714","to":"accepted"}
|
|
{"chain_id":"cause_judgment_requires_wisdom","event":"accepted_corpus_append","proposal_id":"944c6c5180819c9194765f32dbc31714","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Epistemology v1: evidence grounds knowledge","proposal_id":"a5647f07a0227d1853f926d439603f28","to":"accepted"}
|
|
{"chain_id":"verification_evidence_grounds_knowledge","event":"accepted_corpus_append","proposal_id":"a5647f07a0227d1853f926d439603f28","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Epistemology v1: inference requires evidence","proposal_id":"bb01f8acd6f5db144bdac21a6f754dc7","to":"accepted"}
|
|
{"chain_id":"cause_inference_requires_evidence","event":"accepted_corpus_append","proposal_id":"bb01f8acd6f5db144bdac21a6f754dc7","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_creation_reveals_meaning","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"016252428267e4f339969524988c4794","proposed_chain":{"connective":"reveals","intent":"cause","object":"meaning","subject":"thought"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"17673a2f15c8da21cbfa35328e7c477d53ba6b401651f0245f22558d2dfdeae8"}}
|
|
{"event":"replay","proposal_id":"016252428267e4f339969524988c4794","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_truth_grounds_knowledge","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"d3cd931dea69e06bd2c697276ae650d1","proposed_chain":{"connective":"reveals","intent":"cause","object":"understanding","subject":"question"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"f91d991bb80a7bb19811dafb1223a80613ded7ad4fcdf0ec0ff987f1a77bc50a"}}
|
|
{"event":"replay","proposal_id":"d3cd931dea69e06bd2c697276ae650d1","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_truth_grounds_knowledge","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"ef0666a6ee15f7c595efae1d8e5ea028","proposed_chain":{"connective":"grounds","intent":"cause","object":"concept","subject":"definition"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"60f3b19f100b087dc80555b19de654d70190b7cc096310369fcc6d0b379d4659"}}
|
|
{"event":"replay","proposal_id":"ef0666a6ee15f7c595efae1d8e5ea028","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_truth_grounds_knowledge","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"a19e8ffc0382c254a8d159cf95eb75aa","proposed_chain":{"connective":"grounds","intent":"cause","object":"understanding","subject":"meaning"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"7283546caaa0d273aad0b367bd5c556e29a6dffb8b41d66bcf7684a5dd290c58"}}
|
|
{"event":"replay","proposal_id":"a19e8ffc0382c254a8d159cf95eb75aa","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"cause_light_reveals_truth","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"b79daee7d266224225c6f45f91ec2434","proposed_chain":{"connective":"reveals","intent":"cause","object":"relation","subject":"analogy"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"b2239f20b5174439afc1e3dd0834af37cc8dc94df3e01bef0c1d1f013b5ed4a3"}}
|
|
{"event":"replay","proposal_id":"b79daee7d266224225c6f45f91ec2434","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"verification_truth_requires_evidence","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"1652a236fd525f1c5ba3dcd14f8c9b04","proposed_chain":{"connective":"requires","intent":"verification","object":"definition","subject":"concept"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"d44fe4f0edd15c215bd8989efa63ad4a7f718757119a60477bc7fc12c7aa07f3"}}
|
|
{"event":"replay","proposal_id":"1652a236fd525f1c5ba3dcd14f8c9b04","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"verification_memory_requires_recall","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"6ea18d4e5e5a04b8ec5ed6379e0b1140","proposed_chain":{"connective":"reveals","intent":"cause","object":"memory","subject":"recall"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"pre-adr-0094-migration","kind":"operator","source_id":""},"source_candidate_id":"23075c87735406d9ef5da5c7e4027de6f89b459adc947d7a5750f767fd6ac441"}}
|
|
{"event":"replay","proposal_id":"6ea18d4e5e5a04b8ec5ed6379e0b1140","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":0.9167,"versor_closure_rate":1.0},"regressed_metrics":[],"replay_equivalent":true}}
|
|
{"event":"transition","note":"Curriculum v2: thought reveals meaning (cognition-source cluster)","proposal_id":"016252428267e4f339969524988c4794","to":"accepted"}
|
|
{"chain_id":"cause_thought_reveals_meaning","event":"accepted_corpus_append","proposal_id":"016252428267e4f339969524988c4794","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Curriculum v2: question reveals understanding (Socratic doctrine)","proposal_id":"d3cd931dea69e06bd2c697276ae650d1","to":"accepted"}
|
|
{"chain_id":"cause_question_reveals_understanding","event":"accepted_corpus_append","proposal_id":"d3cd931dea69e06bd2c697276ae650d1","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Curriculum v2: definition grounds concept","proposal_id":"ef0666a6ee15f7c595efae1d8e5ea028","to":"accepted"}
|
|
{"chain_id":"cause_definition_grounds_concept","event":"accepted_corpus_append","proposal_id":"ef0666a6ee15f7c595efae1d8e5ea028","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Curriculum v2: meaning grounds understanding","proposal_id":"a19e8ffc0382c254a8d159cf95eb75aa","to":"accepted"}
|
|
{"chain_id":"cause_meaning_grounds_understanding","event":"accepted_corpus_append","proposal_id":"a19e8ffc0382c254a8d159cf95eb75aa","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Curriculum v2: analogy reveals relation","proposal_id":"b79daee7d266224225c6f45f91ec2434","to":"accepted"}
|
|
{"chain_id":"cause_analogy_reveals_relation","event":"accepted_corpus_append","proposal_id":"b79daee7d266224225c6f45f91ec2434","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Curriculum v2: concept requires definition","proposal_id":"1652a236fd525f1c5ba3dcd14f8c9b04","to":"accepted"}
|
|
{"chain_id":"verification_concept_requires_definition","event":"accepted_corpus_append","proposal_id":"1652a236fd525f1c5ba3dcd14f8c9b04","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"transition","note":"Curriculum v2: recall reveals memory","proposal_id":"6ea18d4e5e5a04b8ec5ed6379e0b1140","to":"accepted"}
|
|
{"chain_id":"cause_recall_reveals_memory","event":"accepted_corpus_append","proposal_id":"6ea18d4e5e5a04b8ec5ed6379e0b1140","provenance":{"adr_id":"adr-0057","raw":"adr-0057:discovery_promoted:2026-05-18","review_date":"2026-05-18","source":"discovery_promoted"}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0003","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0008","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0019","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0021","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0048","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0006","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0007","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0008","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0009","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0010","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0011","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0012","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0013","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0014","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0015","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0016","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0017","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0018","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0019","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:dsnq-v1-0020","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"59223f13722f906a1cf9b65d9b01c990","proposed_chain":{"connective":"recognizes","intent":"admissibility","object":"47ae70324a9a8d7057c7efacfaf180a4afd07e371896af92f9d24d0a1ef04651","recognizer_spec":{"canonical_pattern":{"graph_intent":"setup","outcome":"inadmissible_by_design","quantity_anchor_count":0,"shape_category":"descriptive_setup_no_quantity","subject_is_optional":true,"unresolved_notes":["Edge case: a single day-of-week token ('Saturdays') is present but day-of-week enumeration requires >=2 distinct days, so it must not trip temporal_aggregation.","Edge case: contains a time-unit-adjacent phrase ('lunch break') but no numeric or word-form count.","Edge case: includes a time-adjacency phrase ('after dinner') but carries no quantity marker; should not trip temporal_aggregation."]},"coverage":{"anchors_empty":20,"subject_named":16,"subject_null":4},"exemplar_count":20,"exemplar_digest":"3192f9bc16ac597aa893309b08d340f748a733ec31b567769d72f21547b9fc81","shape_category":"descriptive_setup_no_quantity"},"subject":"descriptive_setup_no_quantity"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"08c5e0e82feba5835b6b5e8a40dee1c590b10263","kind":"exemplar_corpus","source_id":"3192f9bc16ac597aa893309b08d340f748a733ec31b567769d72f21547b9fc81"},"source_candidate_id":"dd984fec928021e817d593de79c01cad254d380d69060f0979c9d87df021c177"}}
|
|
{"event":"replay","proposal_id":"59223f13722f906a1cf9b65d9b01c990","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":1.0,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":1.0,"versor_closure_rate":1.0},"capability_axes":{"G1_verb_classes":{"correct":20,"refused":0,"wrong":0},"G2_comparatives":{"correct":29,"refused":0,"wrong":0},"G3_numerics":{"correct":20,"refused":6,"wrong":0},"G4_multi_clause":{"correct":32,"refused":0,"wrong":0},"G5_aggregate":{"correct":20,"refused":0,"wrong":0},"S1_rate_events":{"correct":20,"refused":0,"wrong":0}},"gsm8k_train_sample":{"correct":3,"refused":47,"wrong":0},"regressed_metrics":[],"replay_equivalent":true,"wrong_count_delta":0}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0001","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0011","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0022","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0004","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0005","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0006","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0007","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0008","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0009","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0010","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0011","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0012","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0013","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0014","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0015","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0016","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0017","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0018","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0019","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:rwc-v1-0020","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"46ce297f797ff16da12db5de422ca3c9","proposed_chain":{"connective":"recognizes","intent":"admissibility","object":"7741c837933c975e52d01fe4a97d18c6609cce3dceaf934ba6eccefda0c6837a","recognizer_spec":{"canonical_pattern":{"anchor_count_max":1,"anchor_count_min":1,"anchor_kind":"currency_per_unit_rate","graph_intent":"rate","observed_amount_kinds":["decimal","integer"],"observed_currency_symbols":["$","\u00a3","\u00a5","\u20ac"],"observed_per_units":["bar","cup","dozen","event","hour","kg","month","pound","session","walk","yard","year"],"outcome":"admissible","shape_category":"rate_with_currency","unresolved_notes":["'for each X' alternative framing.","'for one X' alternative framing, matching the surface of train case 0011.","Edge case: non-USD currency (euro).","Edge case: non-USD currency (pound sterling). Tests that the recognizer generalizes the currency-symbol slot.","Edge case: non-USD currency (yen) and discrete-occurrence per_unit ('session').","Non-canonical 'for one X' framing rather than 'per X'. The recognizer must accept both surface forms.","Slash-form per-unit framing ('$45/hour') rather than 'per hour'; recognizer must accept both.","per_unit='dozen' is a multiplicative unit (12-pack), not a base unit; flagged for Phase C disambiguation.","per_unit='event' is a discrete-occurrence unit, not a base measurement unit; flagged for Phase C disambiguation."]},"coverage":{"amount_kind:decimal":1,"amount_kind:integer":19,"anchors_currency_per_unit_rate":20,"currency_symbol:$":17,"currency_symbol:\u00a3":1,"currency_symbol:\u00a5":1,"currency_symbol:\u20ac":1,"per_unit:bar":1,"per_unit:cup":2,"per_unit:dozen":1,"per_unit:event":1,"per_unit:hour":6,"per_unit:kg":1,"per_unit:month":3,"per_unit:pound":1,"per_unit:session":1,"per_unit:walk":1,"per_unit:yard":1,"per_unit:year":1},"exemplar_count":20,"exemplar_digest":"8cfbb6d2dad734de4256c74bc8630a5ffcf3ae23b8df85e0d3e5816333afe678","shape_category":"rate_with_currency"},"subject":"rate_with_currency"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"08c5e0e82feba5835b6b5e8a40dee1c590b10263","kind":"exemplar_corpus","source_id":"8cfbb6d2dad734de4256c74bc8630a5ffcf3ae23b8df85e0d3e5816333afe678"},"source_candidate_id":"1f2e7e29c5357b00446cf8acdfda39688962d40f053ec9bdc9632c7b444b957e"}}
|
|
{"event":"replay","proposal_id":"46ce297f797ff16da12db5de422ca3c9","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":1.0,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":1.0,"versor_closure_rate":1.0},"capability_axes":{"G1_verb_classes":{"correct":20,"refused":0,"wrong":0},"G2_comparatives":{"correct":29,"refused":0,"wrong":0},"G3_numerics":{"correct":20,"refused":6,"wrong":0},"G4_multi_clause":{"correct":32,"refused":0,"wrong":0},"G5_aggregate":{"correct":20,"refused":0,"wrong":0},"S1_rate_events":{"correct":20,"refused":0,"wrong":0}},"gsm8k_train_sample":{"correct":3,"refused":47,"wrong":0},"regressed_metrics":[],"replay_equivalent":true,"wrong_count_delta":0}}
|
|
{"event":"created","proposal":{"claim_domain":"factual","evidence":[{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0013","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0014","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0024","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:gsm8k-train-sample-v1-0050","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0005","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0006","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0007","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0008","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0009","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0010","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0011","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0012","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0013","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0014","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0015","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0016","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0017","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0018","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0019","source":"corpus"},{"epistemic_status":"coherent","polarity":"affirms","ref":"exemplar:ta-v1-0020","source":"corpus"}],"operator_note":"","polarity":"affirms","proposal_id":"a3b892546977c5f0f64c578d6052adbd","proposed_chain":{"connective":"recognizes","intent":"admissibility","object":"d6e31f6bc8e77067ef6388ff95b7fa47b20c51bc0ab5223c454e533909dcbb17","recognizer_spec":{"canonical_pattern":{"anchor_count_max":4,"anchor_count_min":1,"anchor_kind":"event_count_per_window","graph_intent":"aggregate","observed_window_quantifiers":["each","every","per"],"observed_window_units":["day","hour","minute","month","week"],"outcome":"admissible","shape_category":"temporal_aggregation","unresolved_notes":["'a gig' implies count=1; 'every other day' is approximated as window_quantifier='every' with unit 'day'; the outer 'for 2 weeks' duration bound is not captured by the current schema.","'daily' is treated as window_unit='day' with quantifier='per'; the adverbial form has no explicit quantifier word.","'every other day' approximated as window_quantifier='every'; the 'other' (skip-one) cadence is not represented in the schema.","Day-of-week enumeration is encoded as four day-windowed event_count anchors; specific day-of-week labels (Mon/Tue/Wed/Thu) are not captured because the schema lacks a day-of-week field.","Edge case: 'in N minutes' window framing (no 'each/every/per' word). Mirrors train case 0014 but with a different count/unit pairing; window_quantifier is mapped to 'per' and the '30' multiplier is implicit.","Edge case: 'over N hours' temporal-window framing. As with case 0014, the schema collapses '80 per 6 hours' to window_unit='hour' with quantifier='per'.","Edge case: minimal day-of-week enumeration (exactly two distinct day names \u2014 the threshold for the rule). Distinct from case 0024 which enumerates four days.","The 'one-hour' detail describes video length, not the aggregation window; it is intentionally omitted from quantity_anchors so Phase C generalizes the window-axis cleanly.","The window is 5 minutes (composite count + unit); the schema only encodes window_unit/quantifier, so 'per' is the closest canonical quantifier and the '5' multiplier is implicit. Phase C may need a window_count extension to express '10 per 5 minutes' versus '10 per minute' precisely.","count_token here refers to the per-day quantity (2 hours of practice); the inner unit 'hours' is part of the counted thing, not the window.","count_token=90 refers to minutes-of-practice per day; the inner unit 'minutes' is part of the counted thing."]},"coverage":{"anchors_event_count_per_window":24,"window_quantifier:each":11,"window_quantifier:every":5,"window_quantifier:per":8,"window_unit:day":15,"window_unit:hour":2,"window_unit:minute":2,"window_unit:month":1,"window_unit:week":4},"exemplar_count":20,"exemplar_digest":"cca6491bac0df6e9c935d38cefc8d421de9ea6761b34e2f8bf99f9e543c95e82","shape_category":"temporal_aggregation"},"subject":"temporal_aggregation"},"provenance":null,"replay_evidence":null,"review_state":"pending","source":{"emitted_at_revision":"08c5e0e82feba5835b6b5e8a40dee1c590b10263","kind":"exemplar_corpus","source_id":"cca6491bac0df6e9c935d38cefc8d421de9ea6761b34e2f8bf99f9e543c95e82"},"source_candidate_id":"71c76cbfd6ee52075ba78fa31b7a23490762d9bac7779c00ce293a362e23d2b2"}}
|
|
{"event":"replay","proposal_id":"a3b892546977c5f0f64c578d6052adbd","replay_evidence":{"baseline":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":1.0,"versor_closure_rate":1.0},"candidate":{"intent_accuracy":1.0,"surface_groundedness":1.0,"term_capture_rate":1.0,"versor_closure_rate":1.0},"capability_axes":{"G1_verb_classes":{"correct":20,"refused":0,"wrong":0},"G2_comparatives":{"correct":29,"refused":0,"wrong":0},"G3_numerics":{"correct":20,"refused":6,"wrong":0},"G4_multi_clause":{"correct":32,"refused":0,"wrong":0},"G5_aggregate":{"correct":20,"refused":0,"wrong":0},"S1_rate_events":{"correct":20,"refused":0,"wrong":0}},"gsm8k_train_sample":{"correct":3,"refused":47,"wrong":0},"regressed_metrics":[],"replay_equivalent":true,"wrong_count_delta":0}}
|