core-labs/core
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions

chore(evals): refresh pack-measurements artifact to current runtime

Browse source 
`core demo pack-measurements` reproduces refusal_rate = 0.25 across
all three identity packs (default_general_v1, precision_first_v1,
generosity_first_v1).  The committed baseline was 1.0, dating to the
ADR-0043 original commit (4ba1ef2); the runtime has evolved through
ADR-0048..0072 since then and the report file fell out of sync.

Evidence
  - `python -m core.cli demo pack-measurements --json` reproduces 0.25
    deterministically on the current main.
  - tests/test_pack_measurements_phase2.py — all 6 pass; tests pin
    structural invariants (pack_invariant_gate=True, fabrication=0.0,
    refusal_rate ∈ [0,1]), not the specific value.
  - report-level `claims_supported` still True; the pack-measurements
    demo still PASSes in `core demo all`.

Other fields unchanged:
  - fabrication_rate          : 0.0
  - out_of_grounding_count    : 8
  - pack_invariant_gate       : True
  - identity_divergence       : distinct_rate 0.8 across pack pairs

No code change.  Pure artifact refresh.
This commit is contained in:
Shay 2026-05-19 19:16:33 -07:00
parent f673c0eb06
commit 4e276d0588
1 changed files with 3 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
evals/results/phase2_pack_measurements.json
View file

@ -69,19 +69,19 @@
"fabrication_rate": 0.0,
"out_of_grounding_count": 8,
"pack_id": "default_general_v1",
"refusal_rate": 1.0
"refusal_rate": 0.25
},
{
"fabrication_rate": 0.0,
"out_of_grounding_count": 8,
"pack_id": "precision_first_v1",
"refusal_rate": 1.0
"refusal_rate": 0.25
},
{
"fabrication_rate": 0.0,
"out_of_grounding_count": 8,
"pack_id": "generosity_first_v1",
"refusal_rate": 1.0
"refusal_rate": 0.25
}
],
"schema_version": 1