a83b35de07
CORE now decides natural-English deductive arguments end-to-end: 'If it rains then the ground is wet. It rains. Therefore the ground is wet.' -> ENTAILED, rendered over the user's own clauses. Both of ADR-0256's documented boundary cases (multiword conditional, nested- negation contraposition) are now decided; their lane gold updated declined->entailed. - generate/proof_chain/english.py (new): closed function-word grammar over OPAQUE clause-atoms (minted ids); if/then, [either] or, and, three negation forms (leading not / sentential / copular incl. contractions); typed refusals; honesty caps. Soundness: positive verdicts are substitution-closed; UNKNOWN is scoped + guarded (quantifier-led, is-a membership, unnormalizable negation refuse out of the opaque band). - render_entailment_english: verdicts quoted back verbatim; UNKNOWN phrasing explicitly scoped to the opaque reading. - chat/deduction_surface.py: v2-EN fallback tier AFTER v1/v1b — monotone widening, byte-identical on previously-served arguments. - Four en_* shape-bands EARN SERVE via the ADR-0199 arena (720/band, wrong=0, reliability 0.99087 >= 0.99); 9-band ledger re-sealed. - evals/deduction_serve/v2_en: 26 hand-authored real-English cases (content disjoint from the synthetic lexicon), wrong=0; report re-pinned. - realizer guard (ADR-0075): deduction surfaces exempt — quoted templates are not slot-composed articulations (pack 'open'=VERB was rejecting an honest quoted 'the door is not open'); pinned cold+warm in e2e. [Verification]: deductive 84 passed; smoke 180 passed; cognition 122 passed 1 skipped; arena 9x720 wrong=0 all SERVE; lanes v1 28/28, v2_en 26/26.
61 lines
1.1 KiB
JSON
61 lines
1.1 KiB
JSON
{
|
|
"aggregate": {
|
|
"correct": 54,
|
|
"declined": 0,
|
|
"n": 54,
|
|
"wrong": 0
|
|
},
|
|
"all_correct": true,
|
|
"arc": "deduction-serve",
|
|
"lane": "deduction_serve",
|
|
"schema_version": 1,
|
|
"splits": {
|
|
"v1": {
|
|
"all_cases_correct": true,
|
|
"by_gold": {
|
|
"declined": 4,
|
|
"entailed": 10,
|
|
"invalid": 1,
|
|
"refuted": 5,
|
|
"unknown": 5,
|
|
"valid": 3
|
|
},
|
|
"correct_by_gold": {
|
|
"declined": 4,
|
|
"entailed": 10,
|
|
"invalid": 1,
|
|
"refuted": 5,
|
|
"unknown": 5,
|
|
"valid": 3
|
|
},
|
|
"counts": {
|
|
"correct": 28,
|
|
"declined": 0,
|
|
"wrong": 0
|
|
},
|
|
"n": 28
|
|
},
|
|
"v2_en": {
|
|
"all_cases_correct": true,
|
|
"by_gold": {
|
|
"declined": 6,
|
|
"entailed": 13,
|
|
"refuted": 3,
|
|
"unknown": 4
|
|
},
|
|
"correct_by_gold": {
|
|
"declined": 6,
|
|
"entailed": 13,
|
|
"refuted": 3,
|
|
"unknown": 4
|
|
},
|
|
"counts": {
|
|
"correct": 26,
|
|
"declined": 0,
|
|
"wrong": 0
|
|
},
|
|
"n": 26
|
|
}
|
|
},
|
|
"wrong_is_zero": true
|
|
}
|