The gap between controlled and real

The evidence base for memory research is unusually rich — but much of it was built in a single afternoon, in a quiet room, with nonsense syllables or unrelated word lists. Hermann Ebbinghaus, working at the University of Berlin in the 1880s, was scrupulously rigorous within those constraints. What he could not do was test whether a curve fitted to artificial material would hold for a medical student learning pharmacology across a sixteen-week term.

A quiet library carrel seen from behind
FIG. 2Most of the estimates on this site were produced in rooms like this, on adults working alone.

This is the lab-to-classroom problem, and it matters more than introductory accounts of cognitive science usually admit.

The cost is ecological validity: the conditions that make measurement clean are also the conditions least like the ones in which adults actually need to learn.

Laboratory experiments earn their credibility from control. The researcher decides the material, the timing, the test format, and the number of exposures.

The travel record

  • Testing effectreplicates well in field settings (smaller effect, higher variance)
  • Spacing effectmixed at term-length intervals
  • Word-list findings (Ebbinghaus)ecological validity low for semantic, structured material

Real material has structure. A chemistry concept depends on earlier chemistry concepts. A legal principle sits inside a web of prior principles. That semantic embedding changes how forgetting and retrieval work, in ways that a list of unrelated words cannot capture. Endel Tulving’s work on encoding specificity already suggested in the 1970s that memory is deeply tied to context; stripping context to isolate a variable also strips the thing being varied.

Cluttered writer's desk with open notebooks, magnifying glass, pens and lamps casting warm light

Effect sizes are another pressure point. The testing effect — the finding that retrieval practice beats re-study — replicates robustly in the lab and has held up reasonably well in applied settings. But the effect in field studies is typically smaller than in lab studies, and variance is higher. Henry Roediger and Jeffrey Karpicke at Washington University in St. Louis have been careful to note this, distinguishing what the basic science establishes from what applied claims are warranted. Not every lab-born result travels as cleanly.

Key researchers and institutions

  • Hermann EbbinghausUniversity of Berlin; nonsense-syllable paradigm
  • Endel Tulvingencoding specificity principle; memory tied to context
  • Henry Roediger & Jeffrey KarpickeWashington University in St. Louis; retrieval practice applied work

Timescale is a third issue. Many lab experiments measure retention after minutes or hours. A retention interval of a week, a month, or an academic term introduces interference, re-exposure, sleep, motivation change, and a dozen other variables the lab design cannot see. Results that look robust at short intervals have a mixed record at long ones.

None of this discredits the laboratory work. Control is what allows causal inference in the first place; without it, you have correlational field data that is harder to interpret, not easier. The honest position is that lab findings give you a provisional map — a guide to which mechanisms exist and roughly what conditions activate them. Whether the terrain matches the map is a separate, empirical question, and in cognitive science, it is often still being answered.