“Goes Against Everything I was Taught in Med School”

A reader of this blog reported the following conversation with his doctor:

us: We want to put our autistic daughter on a gluten-free, casein-free diet. We have heard that some autistic kids have gotten some benefit from it.

Dr: It’s not something I know about, but there is no harm in it so feel free to give it a try. You know, I had a patient whose parents put her on a ketogenic diet to treat her seizures, and it seemed to help. That goes against everything I was taught in med school, but if it works, I think that’s great.

What’s telling here is the word everything. In medical school, the doctor seems to say, he was taught in a dozen ways that the sun revolves around the earth (or its health-science equivalent). If the alternative — the earth revolves around the sun — explains more of the data, well, “that’s great.” Again, it sounds like 1984: Part of the doctor’s brain has been turned off by repetition of something that supports the status quo.

Ocean Science High School

There is a high school in Osaka called (in Japanese) Ocean Science High School. It specializes in training students for fish industry jobs. During my visits to Japan, what’s most impressed me hasn’t been high-end restaurant food, as great as it is, but the way everyone seems to take pride in their job and doing it well. At one point a friend’s car got a flat tire. We limped to a service station. The attendant fixed the flat in 3 minutes, running around as if we were in a race. Typical for Japan, but unlike anywhere else I’ve been. I hope someday I can learn how this attitude is taught. Surely it has something to do with schools like Ocean Science — not Fish Industry — High School.

Beijing Street Vendors: What Color Market?

Black market = illegal. Grey market = “the trade of a commodity through distribution channels . . . unofficial, unauthorized, or unintended.”

In the evening, near the Wudaokou subway station in Beijing (where lots of students live), dozens of street vendors sell paperbacks ($1 each), jewelry, dresses, socks, scarves, electronic accessories, fruit, toys, shoes, cooked food, stuffed animals, and many other things. No doubt it’s illegal. When a police car approaches, they pick up and leave. Once I saw a group of policemen confiscate a woman’s goods.

What’s curious is how far vendors move when police approach. Once I saw the vendors on a corner, all 12 of them, each with a cart, move to the middle of the intersection — the middle of traffic — where they clustered. At the time I thought the traffic somehow protected them. Now I think they wanted to move back fast when the police car went away. Tonight, like last night, there’s a police car at that corner, the northeast corner of the intersection. No vendors there. The vendors who’d usually be there were now at the northwest corner. In other words, if a policeman got out of his car and walked across the street, he’d encounter all the vendors that he’d displaced.

Assorted Links

Thanks to Steve Hansen and Gary Wolf.

Probiotics Help Preterm Infants

It has just come to my attention that a systematic review published two years ago found that probiotics help preterm infants ward off necrotizing enterocolitis. Here is a summary of the review:

Necrotizing Enterocolitis (NEC) is a serious disease that affects the bowel of premature infants in the first few weeks of life. Although the cause of NEC is not entirely known, milk feeding and bacterial growth play a role. Probiotics (dietary supplements containing potentially beneficial bacteria or yeast) have been used to prevent NEC. Our review of studies found that the use of probiotics reduces the occurrence of NEC and death in premature infants born less than 1500 grams.

The reductions in the likelihood of this disease and of death (presumably from this disease) were both greater than 50%.

Show-Off Professors

A new Jeffrey Eugenides short story quotes Derrida. Quote 1:

In that sense it is the Aufhebung of other writings, particularly of hieroglyphic script and of the Leibnizian characteristic that had been criticized previously through one and the same gesture.

Quote 2:

What writing itself, in its nonphonetic moment, betrays, is life. It menaces at once the breath, the spirit, and history as the spirit’s relationship with itself. It is their end, their finitude, their paralysis.

“A little Derrida goes a long way and a lot of Derrida goes a little way,” said a friend of mine who was a graduate student in English. These quotes show why. In Theory of the Leisure Class, Veblen argued that professors write like this (and assign such stuff to their students) to show status. I have yet to hear a convincing refutation of this explanation nor a plausible alternative. Is there a plausible alternative?

Veblen was saying that professors are like everyone else. Think of English professors as a model system. Their showing-off is especially clear. It’s pretty harmless, too, but when a biology professor (say) pursues a high-status line of research about some disease rather than a low-status but more effective one, it does — if it happens a lot — hurt the rest of us. Sleep researchers, for example, could do lots of self-experimentation but don’t, presumably because it’s low-status. And poor sleep is a real problem. Throughout medical school labs, researchers are studying the biochemical mechanism and genetic basis of this or that disorder. I’m sure this is likely to be less effective in helping people avoid that disorder than studying its environmental roots, but such lines of research allow the researchers to request expensive equipment and work in clean isolated laboratories — higher status than cheap equipment and getting your hands dirty. I don’t mean high-status research shouldn’t happen; we need diversity of research. But, like the thinking illustrated by the Derrida quotes, there’s too much of it. A little biochemical-mechanism research goes a long way and lot of biochemical-mechanism research goes a little way.

Can John Gottman Predict Divorce With Great Accuracy?

Andrew Gelman blogged about the research of John Gottman, an emeritus professor at the University of Washington, who claimed to be able to predict whether newlyweds would divorce within 5 years with greater than 90% accuracy. These predictions were based on brief interviews near the time of marriage. Andrew agreed with another critic who said these claims were overstated. He modified Gottman’s Wikipedia page to reflect those criticisms. Andrew’s modifications were removed by someone who works for the Gottman Institute.

Were the criticisms right or wrong? The person who removed reference to them in Wikipedia referred to a FAQ page on the Gottman Institute site. Supposedly they’d been answered there. The criticism is that the “predictions” weren’t predictions: they were descriptions of how closely a model fitted after the data were collected could fit the data. If the model were complicated enough (had enough adjustable parameters), it could fit the data perfectly, but that would be no support for the model — and not “100% accurate prediction” as most people understand it.

The FAQ page says this:

Six of the seven studies have been predictive—each began with a hypothesis about factors leading to divorce. [I think the meaning is this: The first study figured out how to predict. The later six tested that method.] Based on these factors, Dr. Gottman predicted who would divorce, then followed the couples for a pre-determined length of time. Finally, he drew conclusions about the accuracy of his predictions. . . . This is true prediction.

This is changing the subject. The question is not whether Gottman’s research is any help at all, which is the question answered here; the question is whether he can predict at extremely high levels (> 90% accuracy), as claimed. Do the later six studies provide reasonable estimates of prediction accuracy? Presumably the latest ones are better than the earlier ones. The latest one (2002) was obviously not about accurate prediction estimates (its title used the term “exploratory”) so I looked at the next newest, published in 2000. Here’s what its abstract says:

A longitudinal study with 95 newlywed couples examined the power of the Oral History Interview to predict stable marital relationships and divorce. A principal components analysis of the interview with the couples (Time 1) identified a latent variable, perceived marital bond, that was significant in predicting which couples would remain married or divorce within the first 5 years of their marriage. A discriminant function analysis of the newlywed oral history data predicted, with 87.4% accuracy, those couples whose marriages remained intact or broke up at the Time 2 data collection point.

The critics were right. To say a discriminant function “predicted” something is to mislead those who don’t know what a discriminant function is. They don’t predict, they fit a model to data, after the fact. To call this “true prediction” is false.

To me, the “87.4%” suggests something seriously off. It is too precise; I would have written “about 90%”. It is as if you asked someone their age and they said they were “24.37 years old.”

Speaking of overstating your results, reporting bias in medical research. Thanks to Anne Weiss.

Cigarettes are Bad, Right?

My mom says her friends knew that smoking was harmful long before the Surgeon General’s report in 1962; they smoked anyway. The evidence that smoking causes lung cancer began to be accumulated in the 1950s. At first it was a radical idea. The boss of one of the scientists involved, Ernst Wynder, cut his research budget for continuing to study such a far-fetched notion.

Some of the details, indeed, did not make sense, as this fascinating essay (“The Scientific Scandal of Antismoking”, thanks to Robert Reis) points out. Were I to teach a course in scientific method, I might make this essay the first assignment: “Tell me its strengths and weaknesses.” Its strength is that it brings up new data that challenge a well-known idea (smoking causes lung cancer) that most people don’t give a second thought to. The conventional view that smoking is simply bad is surely wrong. The essay’s weaknesses are a dismissive attitude (“second-rate”) and a failure to learn from facts that don’t fit the authors’s ideas. For example, the big correlation between smoking and lung cancer that Wynder was the first to notice. What causes it? A more subtle lesson is that the big randomized controlled clinical trials are not the wonderful thing that most writers, including the authors of this essay, make them out to be (“the gold standard”). MRFIT was a hugely-expensive controlled clinical trial that produced no difference between the groups. It isn’t clear why. What can we learn from this? I’d ask my students. One lesson is the value of doing the smallest possible study — if they’d figured out the problems with a small study (and designed a better study that avoided them) they would have had a better chance of learning something from their massive study.

The Oneness of Fermentation

A New York article about the suicide of a Dalton student contains this interesting observation. The dead boy

left filthy socks (which smelled, a cousin said, like kimchi) on his pillow

From which I conclude not only that kimchi is a good source of bacteria (“fermented foods” is a vague category — fermented for how long? — that might contain poor sources of bacteria) but also that our olfactory systems are good at detecting bacteria or more precisely bacterial byproducts. (Kimchi and used socks involve vastly different bacteria but are lumped together.) We don’t use smell to avoid predators or find food. We use vision and hearing for that. Maybe we use smell mainly to decide what to eat — to decide what contains calories (by learning smell-calorie associations, the basis of the Shangri-La Diet) and, as this observation suggests, what contains bacteria.

Mark Frauenfelder says that fermenting foods (yogurt, sauerkraut, kombucha) makes him happy.