* docs(adr-0084): propose definitional layer + prompt-diversity suite
Three companion artifacts proposing the next substantive design step
after ADR-0083:
1. ADR-0084 (Proposed) — Definitional Layer for Lexicon Packs
Optional `definition` block on pack entries: gloss,
definitional_atoms, predicates_invited, definition_version,
provenance. Pack-level opt-in. Closure rule: every word in a
gloss must resolve to a same-pack lemma, another mounted pack's
lemma, or a primitive in a new `packs/primitives/` pack.
NO composer change in this ADR (sequenced for ADR-0085) —
ratify substrate before any consumer depends on it.
2. evals/prompt_diversity/ (Proposed) — companion eval lane
~50 cases across question-shape × sophistication × domain,
measuring three new metrics: response_shape_fit,
audit_in_surface_rate (quantifies the trust-boundary leak into
user surfaces), gloss_quote_rate (zero today; rises with future
gloss-aware composer). No v1 pass thresholds — the lane
establishes a baseline distribution so future work has
something to move. 26 seed cases authored covering all 21
categories.
3. docs/handoff/ADR-0084-pack-content-brief.md — paste-ready brief
for a cheaper/faster dev agent to produce the pack content in
parallel. Self-contained, 5 sequenced phases (primitives pack
→ extend 9 existing glosses → add to relations/anchors → write
closure verifier → run safety lanes), explicit don't-touch list
(no composer / runtime / algebra / Greek+Hebrew packs / schema
parser), no-LLM-glosses discipline, per-phase acceptance.
Discovery while drafting: 9 packs already carry glosses.jsonl
under language_packs/data/ with a flat schema (78 entries in
en_core_cognition_v1 alone). The brief reflects that — most
work is extending existing entries, not authoring from scratch.
Strategic context: ADR-0083 raised the *depth* ceiling on chain
composition; ADR-0084 raises the *fidelity* ceiling. The φ
separation probe (memory: phi-separation-falsified) established
that semantic capability lives in chain composition, not in φ
geometry, so deepening the composer's substrate is the natural
next step. ADR-0084 → 0085 (gloss-aware composer) → 0086
(predicate licensing at ratification) is the planned sequence.
* feat(adr-0084): substrate — schema parser, primitives loader, closure verifier
Substrate-only code-side for ADR-0084 (Definitional Layer for Lexicon Packs).
No composer touches the new fields yet; consumer integration is ADR-0085.
Schema (additive, default preserves byte-identity)
- LanguagePackManifest.definitional_layer: bool = False
- compiler loader propagates the flag from manifest.json
language_packs/definitions.py (new)
- GlossEntry dataclass: lemma, gloss, pos, definitional_atoms,
predicates_invited, definition_version, provenance_ids
- parse_gloss_entry(payload, *, strict) — strict mode enforces ADR-0084
§Schema validation row-by-row: required keys, typed lists, no
unknown keys, positive definition_version; lax mode preserves the
legacy two-field shape for back-compat
- load_pack_glosses(pack_id, *, strict) with cache + clear hook
- verify_definitional_closure(pack_id, *, mounted_pack_lemmas,
primitive_lemmas, strict) returning tuple[ClosureViolation, ...];
case-insensitive resolution; cycles permitted per ADR
packs/primitives/loader.py (new)
- Sister loader to packs/safety/ and packs/identity/
- PrimitivesPack frozen dataclass with .lemmas frozenset
- Gates: checksum match, kind=='primitives', definitional_layer:true,
never_auto_mutable:true, pack_id matches dir, primitive_count
cross-check, duplicate-lemma rejection, path-traversal rejection,
strict per-entry schema with allow-list
- DEFAULT_PRIMITIVES_PACK = 'en_semantic_primitives_v1'
tests/test_adr_0084_definitional_substrate.py
- 38 tests covering strict parser (each required key rejection, unknown
key rejection, empty predicates_invited allowed, empty
definitional_atoms rejected, invalid definition_version), lax
parser back-compat, load_pack_glosses (missing/strict raise/lax
skip/malformed JSON), closure verifier (same-pack/primitive/mounted/
unresolved/case-insensitive), primitives loader (every gate), and
a back-compat check that every shipped pack still ratifies with
definitional_layer=False
Lanes: smoke 67/0, cognition 120/0/1, teaching 17/0, runtime 19/0,
packs 6/0. Cognition eval byte-identical 100/91.7/100/100.
When the content PR lands (primitives.jsonl + extended glosses.jsonl
under ADR-0084-pack-content-brief.md), the gate catches any closure-rule
violation without further code change.
* feat(evals): prompt_diversity lane runner — measurement instrument for ADR-0084+
Implements the runner against the existing contract.md + 26-case v1
public split. Lane auto-discovered by evals.framework via the standard
contract + runner convention.
Runner (evals/prompt_diversity/runner.py)
- run_lane(cases, *, config, workers) -> LaneReport
- 5 metrics: intent_accuracy, versor_closure_rate (carried over from
cognition), plus the three new lane-specific metrics —
response_shape_fit, audit_in_surface_rate, gloss_quote_rate
- breakdown dict groups by (question_shape, sophistication, domain)
per contract §How to read the output
- mirrors evals.cognition.runner's parallel worker pattern
Per-shape classifier (deliberately substring/regex-simple at v1)
- predicate_identity, explanation, sequence, two_subject_contrast,
narrative, honest_disclosure
- Unknown shape => neutral pass (don't penalise new categories)
Audit-leak detector
- trust-boundary preamble markers (teaching-grounded (, pack-grounded
(, No session evidence yet.)
- dotted semantic-domain tag regex (cognition.illumination, etc.)
Gloss-quote detector
- resolves expected_terms via chat.pack_resolver.resolve_gloss
- 4-token contiguous-window match against surface (high-confidence
"gloss actually quoted", not "shared one common word")
Tests (tests/test_prompt_diversity_runner.py — 23)
- shape classifier parametrized over the six expected_shape values
- audit-leak detector parametrized over preamble + tag + clean cases
- end-to-end on v1 public:
* versor_closure_rate == 1.0 (only v1 pass threshold per contract)
* every metric in [0, 1]
* breakdown groups present with the four per-cell metrics
* diversity gate: >=5 question shapes, >=3 domains
(defends against future regressions that collapse the suite
back to a cognition-shaped fixture)
v1/public baseline (26 cases)
intent_accuracy : 65.4% (contract predicted 70-85%)
versor_closure_rate : 100.0% (only v1 pass threshold) PASS
response_shape_fit : 53.8% (contract predicted low)
audit_in_surface_rate: 42.3% (contract predicted ~100%)
gloss_quote_rate : 7.7% (contract predicted 0%)
Three baseline surprises worth noting in the report (NOT failures —
the v1 lane is explicitly there to establish the distribution):
- audit_in_surface_rate at 42% (not 100%) means the chain-walk leak
fires on ~11/26; the other 15 are honest-disclosure cases that
emit no audit envelope. Sharpens the future surface-vs-envelope
ADR's actual target: grounded surfaces specifically.
- response_shape_fit at 54% (not "low") — classifier likely has
false positives on the ", which " cause-marker. Worth tightening
once we have an ADR-0085 baseline to compare against.
- intent_accuracy at 65% (below predicted 70-85%) — classifier dips
harder on adversarial/cross-pack than expected. Real gap.
All five smoke/cognition/teaching/runtime/packs lanes still green;
core eval cognition byte-identical 100/91.7/100/100.
* feat(packs): ADR-0084 pack content (primitives + extend glosses + closure verifier) (#65)
* feat(packs): ADR-0084 pack content
* feat(packs): repair ADR-0084 definitional content
* test(adr-0084): adjust substrate manifest tests for post-#65 content reality
PR #65 flipped definitional_layer:true on 13 English packs (9 core +
4 relations + collapse-anchors). The substrate's previous test
test_existing_packs_unchanged asserted that en_core_cognition_v1 +
en_core_relations_v1 still had definitional_layer:False — which was
the right pre-content invariant but is wrong post-content.
Replace it with two complementary tests that hold against real content:
- test_non_opted_packs_default_false:
pins that packs that DIDN'T flip the flag (en_minimal_v1,
he_core_cognition_v1, grc_logos_cognition_v1) still surface
definitional_layer=False through the loader. Defends against
a future change accidentally flipping the flag on a non-opted
pack.
- test_opted_packs_carry_flag:
pins that packs that DID flip the flag (en_core_cognition_v1,
en_core_relations_v1) surface definitional_layer=True through
the loader. Proves the substrate's manifest-field propagation
works against real ratified content, not just fixture packs.
Net: +1 test, same intent (substrate ratifies the manifest field
correctly), now with real-content coverage on both sides of the gate.
All 62 ADR-0084 substrate + prompt-diversity tests pass.
12 KiB
ADR-0084 — Definitional Layer for Lexicon Packs
Status: Proposed Date: 2026-05-20 Author: Shay
Context
Lexicon packs today carry per-lemma atoms and semantic_domains —
classification tags used by the composer as if they were glosses:
light — teaching-grounded (cognition_chains_v1):
cognition.illumination; logos.core.
light reveals truth (cognition.truth)...
cognition.illumination is not a definition. It's a bucket. The
composer can mention it, but cannot quote or paraphrase it,
because there's nothing to quote. Every surface that emerges from
this is therefore structurally bureaucratic: the system reports
which bucket a lemma sits in, then walks a chain. It never tells
you what the lemma means.
This has two downstream consequences we've absorbed silently:
-
Surfaces don't read as answers. ADR-0083's "light reveals truth, which grounds knowledge, which requires evidence" is structurally correct (every visible token is lemma / domain-tag / connective) but it does not answer "Why does light exist?". It walks a graph. The reason it walks a graph and not a definition is that we do not store definitions — we store graph edges.
-
Chains are graph-walks, not meaning-walks. A ratified chain
light → reveals → truthis true because someone reviewed it, not because the words' definitions entail it. The system has no way to check thatrevealscoheres with whatlightandtruthare. So the corpus accepts whatever passes review; the review boundary is the only gate. Definitions would let the chain be self-validating — license-checkable against the subject's invited predicates.
The φ separation probe (memory: phi-separation-falsified)
established that semantic capability lives in chain composition,
not in φ geometry. ADR-0083 raised the depth ceiling on chain
composition. ADR-0084 raises the fidelity ceiling by introducing
the first definitional substrate the composer can draw from.
Decision
Extend the pack schema with an optional per-entry definitional block. Backwards-compatible: every existing pack remains valid unchanged, and every existing composer path degrades byte-identically when the block is absent.
Schema extension
{
"lemma": "light",
"atoms": ["light"],
"semantic_domains": ["cognition.illumination", "logos.core"],
// ADR-0084 — optional definitional block
"definition": {
"gloss": "the medium by which what exists becomes visible",
"definitional_atoms": ["medium", "exist", "visible"],
"predicates_invited": ["reveals", "illuminates", "shines"],
"definition_version": 1,
"provenance": "adr-0084:reviewed:2026-05-20"
}
}
| Field | Required | Purpose |
|---|---|---|
gloss |
yes (inside definition) |
One-sentence definition. Composer-quotable. |
definitional_atoms |
yes | Every content word in gloss that is not a closed-class function word. Each must be (a) another lemma in this same pack, (b) a lemma in another mounted pack, or (c) a marked semantic primitive in packs/primitives/ (introduced as part of this ADR). |
predicates_invited |
yes | Predicates this lemma legitimately appears with as subject. Used by ADR-0086 to license chain ratification. v1 lemmas may carry an empty list during the migration — license-checking is opt-in at the pack level. |
definition_version |
yes | Bumped on every gloss change. Lets calibration / replay tests freeze a definitional snapshot. |
provenance |
yes | Same review-trail discipline as ratified chains. |
Definitional closure rule
The pack ratification gate is extended:
A pack with a
definitionblock on any entry is ratified only if everydefinitional_atomsreference resolves to (a) another lemma in the same pack, (b) a lemma in another currently mounted pack at ratification time, or (c) a primitive inpacks/primitives/. Cycles are permitted — definitions can co-reference (a primitive likeexistneed not bottom out at a leaf). The only forbidden state is an unresolvable reference.
This is the only thing that keeps a definitional pack from being a disguised dictionary of LLM-generated text. Every word in every gloss is traceable to a ratified source.
Primitives pack (new, small)
Create packs/primitives/en_semantic_primitives_v1/. ~30–60 entries.
Words like exist, be, medium, visible, what, cause,
relation, same, different. These do not have their own gloss
— their meaning is taken as primitive at the system level (analogous
to the ratified axioms in packs/safety/). This pack mounts by
default and is never auto-mutable.
The primitives discipline is the load-bearing claim of this ADR: we accept a small set of words as primitive so the rest can be defined in terms of them. The alternative (every word defined in terms of other defined words) requires bottoming out somewhere; we make that explicit.
Composer is not changed in this ADR
ADR-0084 ships the schema extension, the ratification gate, the
primitives pack, and one pilot pack (en_core_cognition_v1) with
glosses added end-to-end. Composer integration — surfaces that
actually quote the gloss — is ADR-0085 (Gloss-Aware Composer).
Predicate licensing at ratification time is ADR-0086.
This sequencing matters: ratify the substrate before any composer can depend on it, and prove the schema and closure rule are operational before adding consumers.
Pack-level opt-in
A pack signals participation by adding "definitional_layer": true
to its manifest. Packs without this flag are unchanged at every
boundary. Mounted alongside non-definitional packs, a definitional
pack contributes glosses for its own lemmas only; cross-pack gloss
access happens through definitional_atoms resolution at
ratification time, not at composition time.
Verification
Required tests
- Schema validation:
- new pack with valid
definitionblock parses; - missing
glossrejected; - missing
definitional_atomsrejected; - empty
predicates_invitedaccepted (migration aid); - unrecognised key inside
definitionrejected (strict gate).
- new pack with valid
- Closure rule:
- reference to an unmounted pack lemma → ratification failure;
- reference to a primitive present in
en_semantic_primitives_v1→ pass; - reference to a lemma in the same pack → pass;
- mutual reference (A's gloss uses B, B's gloss uses A) → pass;
- typo / missing lemma → ratification failure with the unresolved token named.
- Primitives pack:
- loads with
definitional_layer: truebut every entry has an emptydefinitional_atoms(terminal by construction); - mounting twice is a no-op;
- non-mountable as a teaching corpus.
- loads with
- Backward compatibility:
- all existing packs ratify unchanged;
- all cognition / teaching / smoke / runtime suites pass byte-identically;
core eval cognitionmetrics unchanged.
- Pilot pack measurement:
en_core_cognition_v1after gloss addition: every lemma has adefinitionblock; everydefinitional_atomsreference resolves;definition_version=1on every entry; manifest checksum updated.
Lanes (regression check)
core test --suite smoke
core test --suite cognition
core test --suite teaching
core test --suite packs
core test --suite runtime
core eval cognition
All metrics expected byte-identical (composer is unchanged in this ADR — definitions are loaded but unread).
Pilot pack scope
The pilot is en_core_cognition_v1. ~22 cognition lemmas
(light, truth, knowledge, wisdom, memory, evidence,
thought, meaning, understanding, inference, etc.). Each gets
one sentence, drawn exclusively from the primitives pack +
co-pack lemmas. Targeted at the cases the prompt-diversity suite
(companion to this ADR) exercises.
Consequences
What changes
language_packs/compiler.py— schema accepts the optionaldefinitionblock; ratification gate enforces closure.language_packs/data/en_core_cognition_v1/— pilot pack gains glosses end-to-end; manifest checksum refreshed; companion mastery report updated.- New
packs/primitives/en_semantic_primitives_v1/— ratified primitives pack; mounted by default; never auto-mutable. docs/runtime_contracts.md— adds the definitional-layer contract (what a gloss is, what closure means, where primitives live).
What does not change
- Composer behaviour: every surface is byte-identical to today. ADR-0084 ships substrate, not consumers.
- Versor / vault / recall: completely untouched.
- The non-negotiable field invariant
versor_condition(F) < 1e-6. - Trust boundaries: glosses are pack content, ratified through the same mastery-report self-seal as every other pack artifact.
- ADR-0073 anchor lenses: each lens-substrate pack can carry its
own gloss for the same English lemma — definitions and lenses
belong together. (Different traditions, different definitions
for
λόγος/דבר.) This ADR neither requires nor blocks per-lens glosses; it makes them possible.
Scope limits
- No composer changes. Surface-level lift is ADR-0085's job. This ADR is solely the substrate.
- No predicate licensing enforcement. ADR-0086's job. v1
accepts
predicates_invited: []so packs can adopt the schema before they're ready to commit to predicate constraints. - English pilot only. The Greek (
grc_logos_v1) and Hebrew (he_logos_v1) cognition-tier packs do not get glosses in this ADR. Per-lens glosses come after the English pilot has proven the schema is operational and the closure rule does what it claims. - Pack-level opt-in. Without
"definitional_layer": truein the manifest, a pack ratifies as today. - Primitives are commitments, not universals. The primitives pack encodes this system's primitives. Operators who disagree fork the pack.
Why now
The prompt-diversity eval suite (companion proposal at
evals/prompt_diversity/contract.md) is about to expose the
surface-quality problem at scale: the same chain-walk template
applied to every question shape. Surfaces should read like
answers to the questions asked. Today they read like graph
traversals.
The composer cannot fix this on its own — it has no material to work with beyond domain tags and connectives. ADR-0084 supplies the material. ADR-0085 teaches the composer to use it. ADR-0086 license-checks new chains against it. Without the substrate, the composer changes are speculation.
ADR-0084 is also the smallest possible commitment: optional schema field, optional pack flag, one pilot pack, no composer change, no runtime change. It's the most reversible-yet-load-bearing step in the sequence.
Cross-References
- ADR-0083 — raised the depth ceiling on chain composition; ADR-0084 raises the fidelity ceiling.
- ADR-0073 — anchor lens substrate; per-lens glosses are the natural extension of this ADR to non-English cognition-tier packs.
- ADR-0029 / ADR-0027 — pack-layer ratification discipline (mastery-report self-seal) reused verbatim for definitional packs and the primitives pack.
- Companion:
evals/prompt_diversity/contract.md— the prompt suite that will measure whether ADR-0084 → 0085 → 0086 actually moves surface quality across question shapes. - Memory:
phi-separation-falsified— semantic capability lives in chain composition, not φ geometry; ADR-0084 is the natural next substrate move for chain composition specifically. - Future: ADR-0085 (Gloss-Aware Composer), ADR-0086 (Predicate Licensing at Ratification).