Self-Adjudicated Dispute

What it is

The structure has three parts. A dispute is conceded. A source is given. The source is a party to the dispute. Anything can be substituted for the third part, which is why the test that detects it is simple.

The detection test is to read the note attached to the concession and ask who wrote it, and whether they were a party to the dispute. If the only source is the defendant, or the only source is one prosecutor, the concession has been used to close the question rather than open it. A second question makes it firmer: does any figure appear? A genuine treatment of a contested effect almost always has to state how large the effect is, because that is usually what is being argued about.

Being fair to the move matters. A rebuttal is a legitimate citation, and authors under criticism are often the people who understand the criticism best. Citing it is not the error. Citing only it is.

In effect

The defining instance is Cal Newport's Deep Work, at page 35, in a footnote, and it is the only place in the book where the contest surfaces. Newport concedes that deliberate practice has critics, characterises them as generally suspicious of popular-science writing, which converts a scientific dispute into a reaction to a trade book, and reports that the criticisms for the most part did not invalidate the necessity of deliberate practice. His sole authority for that verdict is Anders Ericsson's own 2014 response to criticisms in Intelligence. No meta-analysis appears anywhere in the book, no critic is named, and no figure for how much of the variance practice explains is given. The footnote is never revisited, and by later chapters the same disputed literature supplies numbers from which other quantities are derived by arithmetic.

Both sides of that dispute are real science and both belong here. Ericsson's objection is legitimate: he and Harwell argued in Frontiers in Psychology in 2019 that the critical meta-analyses count structured practice rather than deliberate practice as defined in 1993, which is solitary, effortful, designed by a teacher, aimed at a specific weakness and accompanied by immediate feedback, and that many included studies never use the term at all. On the critical side, Brooke Macnamara leads the work: with David Hambrick and Frederick Oswald in Psychological Science in 2014, covering eighty-eight studies, where practice explained roughly a quarter of the differences between people in games, a fifth in music, under a fifth in sport and very little in education and at work; with David Moreau and Hambrick in Perspectives on Psychological Science in 2016, where practice separates sub-elite athletes from average ones and does not reliably separate elite from elite; and decisively with Maitra in Royal Society Open Science in 2019, a direct replication of the violin study behind the whole idea, in which the group rated best had practised fewer hours than the group rated merely good. This publication lands with Macnamara on the numbers and with Ericsson on the definition. Practice is necessary and it is not sufficient. Note also that ten thousand hours was one group average in the 1993 paper and never a threshold.

Two further instances are on record. Johann Hari's Stolen Focus settles an open question over twin studies in behaviour genetics by saying in its notes that the author finds Jay Joseph's rebuttals persuasive, with Joseph an unusually strong critic of behaviour-genetic method rather than a median voice, and with the aggregate concession from the other side naming no scientist. The structure is identical and the direction is reversed: Newport cites the defendant, Hari cites the prosecution, and the defect is not which side an author picks but that the reader meets only one of them. A third variant is a book crediting brain training to a researcher with a commercial interest in a brain-training product, without disclosing that interest and without mentioning the contested transfer literature.

The counter-example is worth recording too, because it shows what the good version looks like. The Elephant in the Brain leans on a mating-prime result, and rather than settling the priming dispute by citing a proponent, its notes flag a meta-analysis casting doubt on romantic-priming experiments, tell the reader to take the study with a grain of salt, and then argue why the authors still think their contrast holds. The critic is cited, the critic is named in the references, and the author's answer is given as an answer rather than as a verdict.

What it does not say

It does not say that citing a rebuttal is wrong. It says that citing only a rebuttal, at the one point where a dispute is conceded, closes a question the concession appeared to open.

It does not apply where no dispute is raised at all. A premise stipulated and never argued is a different defect, and this publication files that separately.

It does not decide the underlying disputes. On deliberate practice this entry states a position and shows the papers on both sides; on twin studies it takes none.

It does not attribute motive. Nothing here characterises any author's intention, and the finding is about the shape of an apparatus rather than about anyone's state of mind.

It does no less damage than silence. A reader who meets no concession knows they have been given one view. A reader who meets a concession believes they have been given both, and the belief is the harm.

---