a83b35de07
CORE now decides natural-English deductive arguments end-to-end: 'If it rains then the ground is wet. It rains. Therefore the ground is wet.' -> ENTAILED, rendered over the user's own clauses. Both of ADR-0256's documented boundary cases (multiword conditional, nested- negation contraposition) are now decided; their lane gold updated declined->entailed. - generate/proof_chain/english.py (new): closed function-word grammar over OPAQUE clause-atoms (minted ids); if/then, [either] or, and, three negation forms (leading not / sentential / copular incl. contractions); typed refusals; honesty caps. Soundness: positive verdicts are substitution-closed; UNKNOWN is scoped + guarded (quantifier-led, is-a membership, unnormalizable negation refuse out of the opaque band). - render_entailment_english: verdicts quoted back verbatim; UNKNOWN phrasing explicitly scoped to the opaque reading. - chat/deduction_surface.py: v2-EN fallback tier AFTER v1/v1b — monotone widening, byte-identical on previously-served arguments. - Four en_* shape-bands EARN SERVE via the ADR-0199 arena (720/band, wrong=0, reliability 0.99087 >= 0.99); 9-band ledger re-sealed. - evals/deduction_serve/v2_en: 26 hand-authored real-English cases (content disjoint from the synthetic lexicon), wrong=0; report re-pinned. - realizer guard (ADR-0075): deduction surfaces exempt — quoted templates are not slot-composed articulations (pack 'open'=VERB was rejecting an honest quoted 'the door is not open'); pinned cold+warm in e2e. [Verification]: deductive 84 passed; smoke 180 passed; cognition 122 passed 1 skipped; arena 9x720 wrong=0 all SERVE; lanes v1 28/28, v2_en 26/26.
71 lines
1.7 KiB
JSON
71 lines
1.7 KiB
JSON
{
|
|
"classes": {
|
|
"atomic": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"categorical": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"conditional_chain": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"conditional_single": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"disjunctive": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"en_atomic": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"en_conditional_chain": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"en_conditional_single": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
},
|
|
"en_disjunctive": {
|
|
"correct": 720,
|
|
"refused": 0,
|
|
"t2_agrees_gold": 0,
|
|
"t2_verified": 0,
|
|
"wrong": 0
|
|
}
|
|
},
|
|
"content_sha256": "e89aee8fe4c99e9db6e79b3d98278c3ee9e9dcacbc4ba19598fc16d4cf048881",
|
|
"note": "Sealed-practice committed ledger for deduction serving (ADR-0256). Engine reads, never writes. Ceilings stay at safe defaults (theta_SERVE=0.99). A band earns SERVE by demonstrated pipeline reliability (reader+projector+engine) at volume >= 657 committed.",
|
|
"provenance": "evals.deduction_serve.practice.runner.seal_ledger",
|
|
"schema": "deduction_serve_ledger_v1"
|
|
}
|