I learned something from the comments on my preventive stupidity post (also here). The best comment was from Kim Oyhus, whose earlier comment had started it all. Were I to discuss the subject from scratch, here’s what I’d add (mostly elaborating what Kim said):
Scientific discussions are usually about data and theory. From Data A, someone has “concluded” — more precisely, raised the plausibility of — Theory X. At this point, preventive stupidity often begins: Someone says “correlation doesn’t equal causation” or “the plural of anecdote is not data” or something similar.
Here’s what I think. More data are better. Two data sets are better than one. To go from one data set (A) to two (A and B) is a step forward. Less data are worse. To go from one data set (A) to none is a step backward. If you respond to the assertion that A supports X by mentioning more data that bears on the truth of X, that’s a step forward. The more convincing the new data (in either direction, pro or con), the bigger the improvement.
Likewise, more ideas are better. Two plausible explanations of A are better than one. To go from one idea (X) to two (X and Y) is a step forward. Fewer ideas are worse. To go from one explanation (X) to none is a step backward. If you respond to the assertion that A supports X by mentioning another plausible explanation of A, that’s a step forward. The more plausible the new explanation, the bigger the step forward.
The sayings I wrote about (e.g., “absence of evidence doesn’t equal evidence of absence”) make their users stupider because they push them from thinking about one data set to thinking about none (they dismiss Data A) or from considering one idea to considering none (they dismiss Theory X). They make the rest of us stupider because they prevent their users from making useful contributions. They really are preventive stupidity, as Orwell said.
If these sayings were used as transitions, as throat-clearing, fine. If somebody wrote, “Look, correlation doesn’t equal causation. Here’s another plausible explanation for what you observed . . . ” that would be okay. In my experience, that’s not what happens. They’re used to support an overall dismissiveness. Several months ago I wrote about my observations that connected socks with foot fungus. Some of the comments provided new relevant data — steps forward. A few comments, however, made this or that preventive-stupidity point (“ Sample size of 1, no control . . . . you can’t seriously think you’ve proved anything here“, “ your post is post hoc ergo propter hoc reasoning“). The comments didn’t go on to make a step forward. They were steps backward.