075169c33c
monotonic-learning v2:
public/v2 — 5 domains × 3-4 probes × 20 cycles (377 ops)
domains: truth, light, wisdom, order, memory
max_regression=0.0, floor_score=1.0
holdouts/v2 — 4 distinct domains × 3-4 probes × 18 cycles (284 ops)
domains: creation, knowledge, reason, spirit
max_regression=0.0, floor_score=1.0
Demonstrates the structural claim (zero regression on prior domains
as new ones accumulate) at substantially deeper cycle count and
broader domain breadth than v1.
provenance v2:
public/v2 — 30 cases across pack_axiom, vault_recall, teaching, mixed
deeper priming (3-5 turns), mixed-kind cases combining
pack + vault + teaching sources in one probe
source_attribution=1.0, source_validity=1.0,
replay_determinism=1.0, input_sensitivity=1.0
holdouts/v2 — 20 cases on distinct vocabulary
all sub-metrics 1.0
Generator: scripts/generate_monotonic_cases.py extended with three
extra domain probe sets (order, memory, reason, spirit) and split
definitions for v2.
30 lines
4.9 KiB
JSON
30 lines
4.9 KiB
JSON
{"id":"PROV-V2-001","category":"pack_axiom","prime":[],"prompt":"What is order?","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-002","category":"pack_axiom","prime":[],"prompt":"What is principle?","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-003","category":"pack_axiom","prime":[],"prompt":"What is evidence?","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-004","category":"pack_axiom","prime":[],"prompt":"What is inference?","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-005","category":"pack_axiom","prime":[],"prompt":"What is comparison?","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-006","category":"pack_axiom","prime":[],"prompt":"Why does memory matter?","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-007","category":"pack_axiom","prime":[],"prompt":"Why does verification matter?","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-008","category":"pack_axiom","prime":[],"prompt":"Compare reason and inference","expected_sources":["pack"]}
|
|
{"id":"PROV-V2-009","category":"vault_recall","prime":["What is truth?","What is truth?","What is truth?"],"prompt":"What is truth?","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-010","category":"vault_recall","prime":["What is wisdom?","What is wisdom?","What is wisdom?"],"prompt":"What is wisdom?","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-011","category":"vault_recall","prime":["What is creation?","What is order?","What is principle?"],"prompt":"Compare creation and order","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-012","category":"vault_recall","prime":["What is light?","What is meaning?","What is identity?","What is memory?"],"prompt":"Why does light reveal?","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-013","category":"vault_recall","prime":["What is reason?","What is reason?","What is reason?","What is reason?"],"prompt":"What is reason?","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-014","category":"vault_recall","prime":["What is concept?","What is meaning?","What is identity?"],"prompt":"Compare concept and meaning","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-015","category":"vault_recall","prime":["What is principle?","What is principle?","What is order?","What is order?"],"prompt":"Compare principle and order","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-016","category":"vault_recall","prime":["What is judgment?","What is judgment?"],"prompt":"What is judgment?","expected_sources":["pack","vault"]}
|
|
{"id":"PROV-V2-017","category":"teaching","prime":["What is truth?"],"prompt":"Actually truth is more than that.","expected_sources":["pack","teaching"]}
|
|
{"id":"PROV-V2-018","category":"teaching","prime":["What is wisdom?"],"prompt":"No, wisdom requires understanding.","expected_sources":["pack","teaching"]}
|
|
{"id":"PROV-V2-019","category":"teaching","prime":["What is light?"],"prompt":"Actually light reveals more deeply.","expected_sources":["pack","teaching"]}
|
|
{"id":"PROV-V2-020","category":"teaching","prime":["What is order?"],"prompt":"No, order is not just sequence.","expected_sources":["pack","teaching"]}
|
|
{"id":"PROV-V2-021","category":"teaching","prime":["What is reason?"],"prompt":"Actually reason involves judgment.","expected_sources":["pack","teaching"]}
|
|
{"id":"PROV-V2-022","category":"mixed","prime":["What is truth?","What is truth?","What is wisdom?"],"prompt":"Actually truth and wisdom relate deeply.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-023","category":"mixed","prime":["What is creation?","What is order?","What is principle?"],"prompt":"No, creation involves more than order.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-024","category":"mixed","prime":["What is light?","What is light?","What is meaning?","What is meaning?"],"prompt":"Actually light and meaning are entwined.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-025","category":"mixed","prime":["What is knowledge?","What is wisdom?","What is understanding?"],"prompt":"No, knowledge is not the same as wisdom.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-026","category":"mixed","prime":["What is reason?","What is inference?","What is judgment?"],"prompt":"Actually reason precedes inference.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-027","category":"mixed","prime":["What is identity?","What is identity?","What is coherence?"],"prompt":"No, identity requires coherence.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-028","category":"mixed","prime":["What is memory?","What is memory?","What is recall?"],"prompt":"Actually memory and recall differ.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-029","category":"mixed","prime":["What is spirit?","What is life?","What is being?"],"prompt":"No, spirit is more than life.","expected_sources":["pack","vault","teaching"]}
|
|
{"id":"PROV-V2-030","category":"mixed","prime":["What is question?","What is answer?","What is verification?"],"prompt":"Actually questions ground answers.","expected_sources":["pack","vault","teaching"]}
|