It would have been harsh to title this post “Marc Hauser, RIP”. However, unless the following is shown to be in error, I’ll never believe anything he writes or has written:
According to the document that was provided to The Chronicle, the experiment in question was coded by Mr. Hauser and a research assistant in his laboratory. A second research assistant was asked by Mr. Hauser to analyze the results. When the second research assistant analyzed the first research assistant’s codes, he found that the monkeys didn’t seem to notice the change in pattern. In fact, they looked at the speaker more often when the pattern was the same. In other words, the experiment was a bust.
But Mr. Hauser’s coding showed something else entirely: He found that the monkeys did notice the change in pattern—and, according to his numbers, the results were statistically significant. If his coding was right, the experiment was a big success.
The second research assistant was bothered by the discrepancy. How could two researchers watching the same videotapes arrive at such different conclusions? He suggested to Mr. Hauser that a third researcher should code the results. In an e-mail message to Mr. Hauser, a copy of which was provided to The Chronicle, the research assistant who analyzed the numbers explained his concern. “I don’t feel comfortable analyzing results/publishing data with that kind of skew until we can verify that with a third coder,” he wrote.
A graduate student agreed with the research assistant and joined him in pressing Mr. Hauser to allow the results to be checked, the document given to The Chronicle indicates. But Mr. Hauser resisted, repeatedly arguing against having a third researcher code the videotapes and writing that they should simply go with the data as he had already coded it. After several back-and-forths, it became plain that the professor was annoyed.
“i am getting a bit pissed here,” Mr. Hauser wrote in an e-mail to one research assistant. “there were no inconsistencies! let me repeat what happened. i coded everything. then [a research assistant] coded all the trials highlighted in yellow. we only had one trial that didn’t agree. i then mistakenly told [another research assistant] to look at column B when he should have looked at column D. … we need to resolve this because i am not sure why we are going in circles.”
The research assistant who analyzed the data and the graduate student decided to review the tapes themselves, without Mr. Hauser’s permission, the document says. They each coded the results independently. Their findings concurred with the conclusion that the experiment had failed: The monkeys didn’t appear to react to the change in patterns.
They then reviewed Mr. Hauser’s coding and, according to the research assistant’s statement, discovered that what he had written down bore little relation to what they had actually observed on the videotapes. He would, for instance, mark that a monkey had turned its head when the monkey didn’t so much as flinch. It wasn’t simply a case of differing interpretations, they believed: His data were just completely wrong.
As word of the problem with the experiment spread, several other lab members revealed they had had similar run-ins with Mr. Hauser, the former research assistant says. This wasn’t the first time something like this had happened. There was, several researchers in the lab believed, a pattern in which Mr. Hauser reported false data and then insisted that it be used.
If taken literally, this description seems to imply that Hauser was making up data — writing down results much more favorable to his career than the actual results — and not realizing it! As if someone else was marking the data sheet. Since the videotapes are being coded by more than one person the fabrication/delusion/whatever would come to light, you might think, but he does it anyway! And then gets “a bit pissed” when things don’t work out perfectly.
I would love to hear Hauser’s side of this story, and see the videotapes being coded. So far Hauser has said nothing to make me doubt the straightforward interpretation: He made up data. After Saul Sternberg and I published a paper implying that Ranjit Chandra had made up data, Chandra retired.
Derek Bickerton says Hauser “fell victim to a soon-to-be-outdated view of evolution”. I am more interested in what this says about Harvard and Hauser’s co-authors. In particular, I wonder what Noam Chomsky, one of Hauser’s co-authors, will say. The incident makes Chomsky look bad. Hauser appears to be a person who pushes aside the truth of things. That Chomsky wrote a major paper with him suggests that Chomsky failed to notice this.
Thanks to Dave Lull and Language Log.