dataset: ARC-Challenge
purpose: sealed_audit_not_training
description: >
  AI2 Reasoning Challenge hard partition. Questions that simple retrieval
  and word-correlation methods fail on. Pairs with ARC-Easy for a
  difficulty-stratified science audit. See arXiv:1803.05457.
source: hf://allenai/ai2_arc
hf_config: ARC-Challenge
license: CC-BY-SA-4.0
version: pinned_release_or_commit
split: test
sha256: TODO_AFTER_DOWNLOAD
local_cache: .data/benchmarks/arc_challenge/
repo_policy: manifest_only
inspection_policy: aggregate_reports_only
mutation_policy: no_direct_pack_policy_operator_mutation
smoke_fixture: null  # PR-2: small public smoke slice
notes: |
  Hard science reasoning. Only questions that retrieval-based methods
  failed on are included. Key non-math audit lane for CORE.