MCQ answer: (1) — the advantage nearly disappeared
On randomized boards, masters recalled only slightly more pieces than novices — both groups performed at roughly the same, much-lower level they’d shown on real positions being reproduced by weaker players. The dramatic 20-vs-a-handful gap from the real-game condition collapsed almost entirely. This is the single most important result in the whole line of research: it directly rules out “masters just have better visual/spatial memory in general” (option 0), which predicts the advantage should persist regardless of what’s on the board. It also rules out “masters are especially good at memorizing arbitrary information” (option 2) — precisely the opposite happened. And there’s no evidence of masters being actively harmed by randomness (option 3) — they simply lost their edge, performing close to novice level.
Part 2 — Why this is the decisive piece of evidence
If masters had also dramatically outperformed novices on random boards, the field would have had to conclude something like “masters simply have superior visual memory capacity” — a general cognitive advantage unrelated to chess knowledge specifically, which wouldn’t explain why that advantage is specific to chess experts on chess boards rather than a domain-general superpower that should show up on any visual memory task.
What actually happened — the advantage nearly vanishing — means, mechanistically: the master’s recall advantage on real boards wasn’t coming from holding more raw pieces in memory. It was coming from the board being decomposable into a small number of meaningful, previously-learned configurations (a castled king with its pawn shield, a common opening structure, a recognizable tactical setup) — each configuration retrieved and stored as one chunk rather than as several independent pieces. Randomizing the position destroys every one of those learned patterns — the same 20-odd pieces are still there, but none of them form a recognizable chunk anymore, so a master is forced to fall back on memorizing raw, ungrouped pieces one at a time, same as anyone else, bumping into the same ~7±2-chunk working memory limit that constrains everyone (Lesson 2). The “expertise” was in the chunking apparatus built by years of exposure to meaningful chess positions, not in memory capacity itself.
Part 3 — Predicting the pattern in another domain
Take a radiologist reading X-rays. Meaningful condition: a real, clinically-realistic X-ray (even a normal one, or one with a genuine pathology) — full of recognizable anatomical configurations and pathology patterns a trained radiologist has seen thousands of times. Randomized/scrambled condition: the same image, cut into small tiles and shuffled into a spatially incoherent arrangement, or a synthetic image with anatomically impossible structure. Prediction, by direct analogy to Chase & Simon: an experienced radiologist should recall/reconstruct far more detail from a brief glance at the real X-ray than a novice — but on the scrambled version, that advantage should nearly vanish, both groups reduced to memorizing disconnected visual fragments. A result matching this pattern would confirm radiological expertise is pattern-recognition/chunking of meaningful anatomical and pathological configurations, not a generically sharper visual memory — mirroring the chess result exactly.
Part 4 — Chunking analogue and its “random board” test in an agent harness
A candidate mechanism: a model trained on enormous amounts of real code learns to represent common, meaningful code structures (a standard error-handling pattern, an idiomatic loop, a familiar API usage pattern) as compressed, recognizable units in its internal representations — analogous to a chess chunk — rather than processing each token as an independent, unrelated symbol. This would show up behaviorally as a coding-capable model handling realistic, idiomatically-structured code far more fluently (understanding it faster, with fewer tokens of “working memory” effectively needed to track it, making fewer errors summarizing or modifying it) than equally-long but structurally scrambled code (e.g., the same tokens reordered to be syntactically broken, or a codebase with variable names and structure deliberately randomized to destroy familiar patterns while preserving raw token count).
The “random board” control test: give the same model a task on two matched inputs — one realistic/idiomatic, one with equivalent length and vocabulary but scrambled structure (broken idioms, unfamiliar naming, non-standard organization) — and compare performance. If the model’s advantage on the realistic input nearly vanishes on the scrambled one (same as Chase & Simon’s masters), that’s evidence the model’s apparent “skill” is pattern-based compression of meaningful structure, not brute memorization or a generic capacity advantage that should be indifferent to whether the input is realistic.
The pattern
| Condition | Master’s recall | Novice’s recall | Gap |
|---|---|---|---|
| Real game position | High (~20+ pieces, via chunks) | Low (~4-7 pieces) | Large |
| Randomized position | Low (~4-7 pieces, no chunks available) | Low (~4-7 pieces) | Nearly zero |
Rule: expertise, tested this way, turns out to be pattern recognition built from extensive domain exposure — chunking meaningful configurations into fewer, larger retrievable units — not a generic upgrade to memory capacity. The signature test is exactly this real-vs-randomized comparison: destroy the meaningful structure, and the expert’s advantage should collapse if the skill really is chunking-based.
Where this goes: next lesson asks a harder question about this same body of research — given that expertise clearly can be built through practice, why doesn’t sheer quantity of practice reliably produce it? Deliberate practice, its specific requirements, and the real limits on transfer between domains.