core/docs/sessions/2026-05-23-pedagogy-research-and-teaching-loop-pivot.md

# SESSION 2026-05-23 — Pedagogy Research & Teaching-Loop Potential Pivot

**Date:** 2026-05-23
**Status:** Research note; load-bearing for ADR-0129 + ADR-0130
**Trigger:** Operator-supplied review of *Beyond Traditional Pedagogy:
Research-Based and Emergent Techniques for Deep, Durable Learning*
(`/Users/kaizenpro/Downloads/Beyond Traditional Pedagogy ...md`,
2026-05-23)
**Branch:** `docs/pedagogy-review-and-teaching-backlog`

---

## Why this session exists

CORE's mid-2026 work has concentrated on the GSM8K-math substrate arc
(ADRs 0114a → 0119 → 0120 → 0121 → 0122 → 0123 / 0123a / 0123b → 0126
candidate-graph topology → 0127 units pack → 0128 numerics pack). The
last three substrate ADRs each produced **zero sealed-holdout lift**
despite being correct work, leading to an architectural pivot (ADR-0126)
and a substrate-substrate (ADR-0127 / 0128) reframing.

That sequence has been **all about the truth-articulation path** —
parse → graph → solve → verify → realize. The orthogonal axis — how
CORE *learns* from reviewed corrections — has not received the same
load-bearing attention since the ADR-0040-series teaching-substrate
work. The operator surfaced a pedagogy literature review as a sanity
check on whether the teaching loop, considered on its own merits,
has structural gaps that the GSM8K-math focus has been deferring.

This session is the result of that check: the literature review of
the supplied document, follow-up confirmation research on contested
claims, and the resulting two backlog ADRs (0129 and 0130).

---

## The reviewed document

**Title:** *Beyond Traditional Pedagogy: Research-Based and Emergent
Techniques for Deep, Durable Learning*

**Structure:** Executive summary + ~10 themed sections + a
synthesis table + 22 reference URLs. ~300 lines, well-cited within
the established cognitive-psychology / learning-science canon
(Bjork, Roediger & Karpicke, Kapur, Mayer, Collins / Brown / Newman,
Freeman et al., etc.).

**Headline claims:**

1. Active learning > passive lecture (Freeman et al. 2014 PNAS
   meta-analysis as exemplar).
2. Retrieval practice (effortful recall) drives durable learning;
   spacing + interleaving amplify.
3. Productive failure (Kapur) produces larger conceptual gains than
   instruction-first ("3x" rhetoric in some references).
4. Embodied cognition: gesture, manipulation, handwriting matter for
   acquisition.
5. Multimedia learning (Mayer): coordinated verbal + visual channels
   subject to cognitive-load management.
6. Cognitive apprenticeship (Collins / Brown / Newman): modeling,
   coaching, scaffolding, articulation, reflection, exploration.

**Treatment quality:** sound at the survey level; weak on
calibration of contested findings.

---

## Literature confirmation pass

To avoid uncritical adoption, three areas with known replication
or boundary concerns were searched against 2024–2025 literature:

### 1. Productive failure — calibration of the "3x" rhetoric

**Anchor:** Sinha & Kapur 2021 meta-analysis (166 experimental
comparisons, ~12,000 participants), [SAGE](https://journals.sagepub.com/doi/full/10.3102/00346543211019105).

| Claim | Reality |
|-------|---------|
| "3x conventional gains" | Headline from high-fidelity PF studies; meta-analysis average is **d = 0.36**, rising to **d = 0.58** at high design fidelity. Real but more modest. |
| "Broadly applicable" | **Largely a STEM finding.** Non-STEM evidence scarce; domain-general skill transfer not supported. |
| "Works for all learners" | Better effects for **older students** (secondary onwards); prior knowledge is a strong moderator (PMC 2023 study on prior math achievement). |

**Verdict for CORE:** PF is the doc's most-overstated technique.
The structural analog inside CORE (let-attempt-then-review)
already exists in adversarial generation (ADR-0119.5), but with
a different mechanism — adversarial generation is a wrong-answer
*rejection* tool, not a learning-from-attempt tool. Adopting PF
shape inside CORE would mean intentionally allowing the engine
to attempt with knowingly-insufficient grounding and learning
from the gap. **This is the deliberate inverse of CORE's
`wrong==0` doctrine** and would require structural justification
beyond "the literature supports it."

### 2. Retrieval practice — transfer limits

**Anchor:** Pan & Rickard 2018 transfer meta-analysis;
Cognitive Research 2024 follow-up on far-transfer mechanisms,
[Cognitive Research](https://cognitiveresearchjournal.springeropen.com/articles/10.1186/s41235-024-00598-y).

| Claim | Reality |
|-------|---------|
| "Retrieval drives transfer" | **Near transfer: yes (d = 0.4). Far transfer: weak/null (Pan & Rickard d = 0.16, n.s.).** |
| "Works for complex material" | Strongest for simple materials learned by rote; complex / educationally relevant materials show smaller, more contingent effects. |
| "Universal mechanism" | Recent work (Cognitive Research 2024): far-transfer benefits appear specifically when **rule-based learning** is the underlying mechanism + after delay. |
| "Lecture-hall ecological validity" | Glaser & Richter 2025 ([Teaching of Psychology](https://journals.sagepub.com/doi/10.1177/00986283231218943)): testing effect transfers poorly to studied-but-not-practiced content. |

**Verdict for CORE:** Retrieval practice IS the most robust
finding *for retention of practiced material*. CORE's vault recall
already encodes the exact-recall ceiling of this technique. The
*spaced-retrieval* extension (spacing across time) is the part
not currently modeled in CORE's teaching loop — see ADR-0129.

### 3. Embodied cognition — replication crisis

**Anchor:** Machery 2024 chapter on the embodied-cognition
replication crisis,
[Routledge Handbook of Replication](https://www.taylorfrancis.com/chapters/edit/10.4324/9781003322511-50/replication-crisis-embodied-cognition-research-edouard-machery);
Frontiers in Education 2026 STEM-learning integrative review,
[Frontiers](https://www.frontiersin.org/journals/education/articles/10.3389/feduc.2026.1811569/full).

| Claim | Reality |
|-------|---------|
| Embodied learning effects | **Known replication crisis.** Foundational findings have failed independent replication. |
| Handwriting > typing | Strongest for very early literacy acquisition; broader generalizations are contested. |
| Universal benefit | "Embodiment sometimes facilitates learning and sometimes does not" — boundary conditions matter (Frontiers 2026). |

**Verdict for CORE:** Not applicable directly (no body, no
sensorimotor system). Structural analogs (e.g., the
algebra/field/vault substrate as "grounding in a non-symbolic
representation") exist but the analogy is too weak to load-bear
design decisions.

---

## What the doc missed (frameworks worth knowing)

These should be on the radar even though they weren't in the
reviewed document:

| Framework | Why it matters |
|-----------|----------------|
| **Worked-example effect** (Sweller, Paas, van Merriënboer) | Strong evidence for novice instruction; counter-evidence for experts (see expertise-reversal) |
| **Expertise-reversal effect** | Techniques that help novices actively hurt experts and vice versa. Directly relevant to CORE's `apprentice → audit-passed → expert` promotion contract (ADR-0120) |
| **Cognitive load theory** (Sweller) | Distinct intrinsic / extraneous / germane load distinction. Operationally useful for designing teaching corpora |
| **Deliberate practice** (Ericsson) | Specific goals + immediate feedback + repetition at the edge of capability. Better lens than "active learning" for skill domains |
| **Self-explanation effect** (Chi) | Narrow but strong evidence, particularly for science learning from worked examples |
| **Bloom's 2-sigma problem** (1984) | Unsolved benchmark: 1:1 tutoring delivers ~2 SD gains over conventional instruction. Most "evidence-based" techniques are attempts to approach this asymptote without the staffing cost |
| **Feedback science** (Hattie & Timperley 2007; Wisniewski et al. 2020) | Type / timing / specificity of feedback dominate effect sizes |
| **Pre-testing effect** (Carpenter, Richland) | Testing *before* studying primes attention. Distinct from retrieval practice |

---

## Cross-walk to CORE architecture

This is the load-bearing section: not "what does the literature
say" but "what does the literature say that maps onto a structural
move CORE could make."

| Pedagogy concept | CORE analog | Status |
|------------------|-------------|--------|
| Retrieval practice | `teaching/correction.py` + vault recall | **Structurally aligned.** Every reviewed correction IS a retrieval+strengthen event. Exact-recall ceiling already met. |
| Spaced retrieval | (none) | **Genuine gap.** No deterministic spaced re-verification of past corrections. → ADR-0129 |
| Interleaving | Cross-pack chains (ADR-0064 / 0067) | **Aligned.** Cross-pack chains force discrimination across domains. |
| Metacognition / calibration (prediction vs outcome) | (none at teaching layer; partial at runtime via ADR-0035) | **Genuine gap.** No prediction-vs-outcome capture in teaching loop. → ADR-0130 |
| Cognitive apprenticeship | Ratified packs as articulated expert ontology | **Strong analog.** Packs ARE the encoded expert representation; ratification IS the "fade scaffolding" step. |
| Worked examples → fading | Teaching corpora → unsupervised generation | **Partial.** Corpora encode correct answers; less so the reasoning chain that produced them. Could be more first-class. |
| Productive failure | Adversarial generation (ADR-0119.5) | **Different mechanism.** Adversarial generation is rejection; PF would mean attempt-before-grounding. Inverse of `wrong==0`. Not recommended for direct port. |
| Pre-testing | (none) | Genuine gap. CORE always grounds before articulating; never the reverse. Adopting would conflict with `wrong==0`; not recommended. |
| Self-explanation | `SolutionTrace` provenance chain | **Structurally present.** Every answer has its derivation. Could be more first-class in teaching-store records. |
| Cognitive load theory | Substrate hierarchy: algebra → field → vault → realizer | **Implicit alignment.** CORE's layering matches CLT separation of intrinsic structure from extraneous load. |
| Expertise reversal | Pack-tier promotion (ADR-0120) | **Already encoded.** The `apprentice / audit-passed / expert` contract already knows that what helps an apprentice can ossify an expert. |
| Desirable difficulties | `wrong == 0` discipline | **Inverse mapping.** CORE refuses *undesirable* difficulty (confabulation under uncertainty). A teaching-side concept of *desirable* difficulty (challenging-but-not-impossible curriculum sequencing) is not yet first-class. |
| Feedback science | `teaching/review.py` | **Partially aligned.** Reviewed corrections ARE structured feedback. Timing / specificity dimensions could be more first-class. |

---

## The two structural gaps worth addressing

Distilled from the cross-walk, two design moves are both
*pedagogically supported by robust literature* AND *consistent
with CORE's existing determinism + provenance discipline*:

### Gap 1 — Spaced reviewed-correction replay
**Mapped to:** retrieval-with-spacing literature (most robust
finding).
**ADR:** [ADR-0129](../adr/ADR-0129-spaced-correction-replay-deferred.md)
**Status:** Deferred.
**Summary:** Periodic deterministic re-run of past reviewed
corrections to verify they still produce intended outcomes
under current state. Defense against silent regression as the
correction store and pack set evolves.

### Gap 2 — Pre-articulation calibration logging
**Mapped to:** metacognitive calibration / prediction-outcome
comparison literature.
**ADR:** [ADR-0130](../adr/ADR-0130-pre-articulation-calibration-deferred.md)
**Status:** Deferred.
**Summary:** When a correction is proposed, log CORE's
pre-correction prediction; on acceptance, emit the gap.
Provides empirical answer to "is CORE actually getting better"
across pack-version cohorts; supports operator triage.

---

## What is NOT proposed (and why)

| Considered | Rejected because |
|------------|------------------|
| Adopt productive-failure mechanism inside CORE | Inverse of `wrong==0`; would require structural justification beyond pedagogy literature. Adversarial generation (ADR-0119.5) covers the related "wrong-answer rejection" use case without the conceptual conflict. |
| Adopt pre-testing in articulation | Same conflict with `wrong==0`. CORE grounds before articulating by design. |
| Add embodied / sensorimotor layer | No body. The structural analogy (substrate as "grounding") is too weak to load-bear. |
| Add peer-learning multi-agent loop | Out of scope. Multi-agent coordination is a separate architectural question; not driven by this pedagogy review. |
| Adopt cognitive-load-theory load-balancing in realizer | Already implicit in the substrate hierarchy. Making it more explicit risks decoration without integration. |

---

## Why both ADRs are deferred, not accepted

Both ADR-0129 and ADR-0130 are **proposed but deferred**, following
the established ADR-0121 / ADR-0122-deferred pattern. The deferral
reasons compose:

1. **Path-B uncertainty.** The active GSM8K-math arc
   (ADR-0126 / 0127 / 0128) may resolve to a benchmark
   re-targeting. If so, the correction-store population
   characteristics change, and the right cadence (ADR-0129) /
   cohort structure (ADR-0130) may differ.
2. **No observed incident.** Neither ADR has a triggering
   incident. They're defensive infrastructure — useful if a
   regression occurs (0129) or calibration drift develops (0130),
   but speculative without that evidence.
3. **Cost/benefit unmeasured.** Both add telemetry volume and
   operator review surface. Worth it only if the signal proves
   load-bearing.
4. **Composition argument.** If either is un-deferred, the other
   should be re-evaluated jointly — spaced-replay events
   naturally yield calibration evidence; the two share
   infrastructure. Deferring both together preserves that
   composition.

The exit criteria for un-deferral are documented in each ADR's
"Exit criteria for un-deferral" section.

---

## Sequencing recommendation

1. Land ADR-0126 (PR #161) — architecture.
2. Land ADR-0127 (Gemini in flight) — units pack.
3. Land ADR-0128 (Opus #2 in flight) — numerics pack.
4. Re-run train sample with both packs mounted → real Path-A vs
   Path-B verdict.
5. If Path A: continue along the math expert promotion path.
   ADR-0129 / 0130 remain deferred until an incident or
   bandwidth pressure surfaces them.
6. If Path B: benchmark re-targeting becomes the work; ADR-0129 /
   0130 may become more relevant if the new benchmark's
   correction-store characteristics are different enough to
   warrant proactive verification.

---

## Reference list (additional to the original document)

- Sinha, T. & Kapur, M. (2021). When Problem Solving Followed by
  Instruction Works: Evidence for Productive Failure.
  [SAGE](https://journals.sagepub.com/doi/full/10.3102/00346543211019105)
- Pan, S. C. & Rickard, T. C. (2018). Transfer of test-enhanced
  learning: meta-analytic review and synthesis. *Psychological Bulletin*.
- Glaser, J. & Richter, T. (2025). The Testing Effect in the
  Lecture Hall: Does it Transfer to Content Studied but Not
  Practiced? [Teaching of Psychology](https://journals.sagepub.com/doi/10.1177/00986283231218943)
- Cognitive Research: Principles and Implications (2024). Far
  transfer of retrieval-practice benefits: rule-based learning
  as the underlying mechanism.
  [Springer](https://cognitiveresearchjournal.springeropen.com/articles/10.1186/s41235-024-00598-y)
- Machery, E. (2024). The Replication Crisis in Embodied Cognition
  Research. *Routledge Handbook of Replication*.
  [Taylor & Francis](https://www.taylorfrancis.com/chapters/edit/10.4324/9781003322511-50/replication-crisis-embodied-cognition-research-edouard-machery)
- Frontiers in Education (2026). Embodied cognition in STEM
  learning: an integrative review.
  [Frontiers](https://www.frontiersin.org/journals/education/articles/10.3389/feduc.2026.1811569/full)
- Sinha & Kapur (2023). Prior math achievement and inventive
  production predict learning from productive failure.
  [PMC](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10185511/)
- Bloom, B. S. (1984). The 2 Sigma Problem.
  *Educational Researcher 13(6)*.
- Hattie, J. & Timperley, H. (2007). The Power of Feedback.
  *Review of Educational Research 77(1)*.
- Wisniewski, B., Zierer, K., Hattie, J. (2020). The Power of
  Feedback Revisited: A Meta-Analysis.
- Ericsson, K. A., et al. (1993). The Role of Deliberate Practice
  in the Acquisition of Expert Performance.
  *Psychological Review 100(3)*.
- Sweller, J., van Merriënboer, J. J. G., Paas, F. G. W. C. (1998).
  Cognitive Architecture and Instructional Design.

---

## Open questions surfaced (not resolved this session)

These are noted for future sessions; not items I'm advocating
for action:

1. **Should teaching-corpus records carry "why" structure, not
   just "what"?** Self-explanation literature suggests reasoning
   chains in corpora may be more useful than answers alone.
   `SolutionTrace` already exposes provenance; pushing this into
   teaching corpora is a separate question.
2. **Is there a deliberate-practice analog at the curriculum
   level?** ADR-0120's promotion contract already encodes
   "stretch-but-pass" structure (correct_rate ≥ 0.60 floor).
   Whether sub-curricula should also encode this is open.
3. **Could the pack-mutation-proposal pathway adopt a worked-
   example pattern?** When a pack mutation is proposed, today
   the operator sees the diff; could they also see a small
   worked example showing the behavioral implication?
   Speculative.
4. **Is Bloom's 2-sigma a meaningful target for CORE?** A
   deterministic engine with exact recall has structural
   properties that may exceed 1:1 tutoring on some axes
   (consistency, replay) while underperforming on others
   (adaptation, social affordances). Whether to claim this
   target is an architectural framing question, not a
   technical one.

---

## End-of-session state

- **ADRs added:** 0129 (deferred), 0130 (deferred).
- **Session note:** this file.
- **Branch:** `docs/pedagogy-review-and-teaching-backlog`.
- **PR plan:** single docs-only PR for the three files; lands
  independently of the in-flight ADR-0126 / 0127 / 0128 chain.
- **No code changes.** No regression risk.