core/evals/results/phase2_pack_measurements.json
Shay 4e276d0588 chore(evals): refresh pack-measurements artifact to current runtime
`core demo pack-measurements` reproduces refusal_rate = 0.25 across
all three identity packs (default_general_v1, precision_first_v1,
generosity_first_v1).  The committed baseline was 1.0, dating to the
ADR-0043 original commit (4ba1ef2); the runtime has evolved through
ADR-0048..0072 since then and the report file fell out of sync.

Evidence
  - `python -m core.cli demo pack-measurements --json` reproduces 0.25
    deterministically on the current main.
  - tests/test_pack_measurements_phase2.py — all 6 pass; tests pin
    structural invariants (pack_invariant_gate=True, fabrication=0.0,
    refusal_rate ∈ [0,1]), not the specific value.
  - report-level `claims_supported` still True; the pack-measurements
    demo still PASSes in `core demo all`.

Other fields unchanged:
  - fabrication_rate          : 0.0
  - out_of_grounding_count    : 8
  - pack_invariant_gate       : True
  - identity_divergence       : distinct_rate 0.8 across pack pairs

No code change.  Pure artifact refresh.
2026-05-19 19:16:33 -07:00

90 lines
2 KiB
JSON

{
"claims_supported": {
"grounding_gate_pack_invariant": true,
"identity_load_bearing": true,
"no_fabrication_under_any_pack": true
},
"identity_divergence": {
"alignment_bands": [
0.2,
0.45,
0.6,
0.8,
0.95
],
"case_count": 10,
"load_bearing": true,
"packs": [
{
"bare_rate": 0.6,
"case_count": 10,
"hedge_rate": 0.4,
"pack_id": "default_general_v1",
"qualifier_rate": 0.0,
"surface_count": 50
},
{
"bare_rate": 0.2,
"case_count": 10,
"hedge_rate": 0.6,
"pack_id": "precision_first_v1",
"qualifier_rate": 0.2,
"surface_count": 50
},
{
"bare_rate": 0.8,
"case_count": 10,
"hedge_rate": 0.2,
"pack_id": "generosity_first_v1",
"qualifier_rate": 0.0,
"surface_count": 50
}
],
"pairwise_divergence": [
{
"distinct_rate": 0.8,
"pack_a": "default_general_v1",
"pack_b": "precision_first_v1"
},
{
"distinct_rate": 0.4,
"pack_a": "default_general_v1",
"pack_b": "generosity_first_v1"
},
{
"distinct_rate": 0.8,
"pack_a": "precision_first_v1",
"pack_b": "generosity_first_v1"
}
],
"schema_version": 1
},
"refusal_calibration": {
"case_count": 13,
"in_grounding_count": 5,
"out_of_grounding_count": 8,
"pack_invariant_gate": true,
"packs": [
{
"fabrication_rate": 0.0,
"out_of_grounding_count": 8,
"pack_id": "default_general_v1",
"refusal_rate": 0.25
},
{
"fabrication_rate": 0.0,
"out_of_grounding_count": 8,
"pack_id": "precision_first_v1",
"refusal_rate": 0.25
},
{
"fabrication_rate": 0.0,
"out_of_grounding_count": 8,
"pack_id": "generosity_first_v1",
"refusal_rate": 0.25
}
],
"schema_version": 1
},
"schema_version": 1
}