Cheating at Caltech

Caltech has a serious problem with undergraduates cheating on academic work, which Caltech administrators appear to be ignoring. A few years ago, one alumnus considered the problem so bad that he urged other alumni to stop donating. I attended Tech (that’s what we called it) for a year and a half in the 1970s. I didn’t think cheating was a problem then. Now it is.

A recent article in the Times Higher Education Supplement by Phil Baty praised Caltech’s “honor system”, which includes trusting students not to cheat on exams. A Caltech professor of biology named Markus Meister told Baty that “cheats simply cannot prosper in an environment that includes such small-group teaching and close collaboration with colleagues because they would rapidly be exposed.” That strikes me as naive. How convenient for Meister that there is no need to test his theory — it must be true (“cheats simply cannot prosper”).

A few years ago, a Caltech alumnus named Peter Seidel, after receiving a donation request, told his fellow alumni not to donate until the system was cleaned up. Here’s some of what he said:

I found out today that Dean of Students Jean-Paul Revel said the following to my dad on the phone while I was at Caltech (Not realizing that my dad is a former Caltech student and BOC [Board of Control] rep) “Peter has a real problem with cheating. The fact is that people cheat. Peter needs to get over it.”

I think it’s safe to say that the Caltech ‘Honor Code’ is obsolete. [= is no longer working — Seth]

There is a small and growing population of students at Caltech [who] are systematically cheating, and the Caltech administration is aware of it but refuses to do anything about it. I suspect the problem began when Caltech started advertising its ‘Honor Code’ to prospective high school students in the 90′s, which lead to self-selection of students who were willing to bend the rules.

In my personal experience, I caught students cheating red-handed while I was a student, and though I took my findings to the BOC, nothing ever came of it.

I also went to one of my professors (along with several of my classmates) and we explained that we were very concerned that there was a significant amount of cheating going on in his class. While he was very empathetic and gave us a significant amount of his time, ultimately he essentially said that his hands were tied because the school does not allow him to give proctored exams.

The Caltech exam system is set up in such a way that it is extremely easy to take extra time on an exam, open a book on a closed book exam, or search for the answers on the internet. Most exams are taken by students alone in their dorm room, with no one watching, at the time of their choosing, with the student timing themself and with both the coursebook and an internet connection in the room, with only the student’s integrity preventing them from using resources they are not allowed to use. For that matter, many quizzes and exams are turned in to unlocked boxes in empty hallways where it would be simple to take another students answered exam to copy or check answers against, and then return it when turning in one’s own exam. <

In my job in the financial industry I interview a number of Caltech seniors every year for potential jobs. And unfortunately, I have to try to answer the question ‘Is this person a cheater?’ as part of my interview process. I have seen examples of resumes where students flat out lied about their GPA.

But probably the most blatant example . . . is a student [he means graduate — Seth] that I recently interviewed [who] claimed, as his two ‘hobbies’, to be a member of the Caltech fencing team his freshman and sophomore years, and a member of the Caltech chess club all four years at Caltech. As it happened, when I was handed his resume, the coworker sitting to the left of me was a former Caltech grad student that coached the fencing team during those years, and the coworker sitting to the right of me was a former Caltech undergrad who was an avid member of the chess club as both an undergrad and an alum. Both of them also happened to be part of the group scheduled to interview this student, and received copies of his resume. I asked them what their opinion was of the candidate.

Neither of them had ever heard of him.

We decided to go ahead and give the candidate an interview, and give him a chance to explain, in case we were somehow misunderstanding the resume. The first person to interview him was the former fencing coach. The interview began normally, and then after a while they had the following exchange (I’m paraphrasing somewhat):

Former fencing coach: I see you have two years on the Caltech fencing team.

Candidate: That’s right.

Former fencing coach: Well, I was the coach at that time… and I don’t remember you.

Candidate: Well, it wasn’t actually my freshman and sophomore years; it was just my freshman year.

Former fencing coach: I was the coach both years.

Candidate: Well, I wasn’t really on the official team, I just took the PE class that taught fencing.

Former fencing coach: I taught that class.

Candidate: Well, I didn’t really take the whole class. I signed up for it, but I only went to the first week, and then I dropped it.

After the first interview, we decided we wouldn’t be making him an offer, but I decided to go in and talk to the candidate anyway. [In] the meantime, the coworker who was a Caltech chess club member asked another chess club friend of his if he knew the guy, and he didn’t. I told the candidate that we wouldn’t be offering him a job, but I wanted to talk to him about his resume. I told him I had heard about the previous interview, and that there were also a couple members of the Caltech chess club who did not know who he was. He responded ‘Well, it wasn’t a formal team, and not everyone went every time.’ I asked him what night of the week the club met, and he told me (confidently) ‘Saturday nights.’ (I knew that it was actually Friday nights.)

When people cheat and get away with it, they are more likely to cheat in the future, Seidel believes — a very plausible idea. Given the disinterest of professors and administrators in the problem, the Caltech mascot should be a monkey with its hands over its eyes.

Elegant Variation, Fashion and Employee Free Time: What Do They Have in Common?

I am learning Chinese by studying a Chinese version of The Three Little Pigs. The story contains a phrase that irritated me: “Three’s home” (in Chinese). Although I did know the Chinese for “home”, the rest of the story used the term “Three’s brick house” (in Chinese). Why couldn’t they stick with one name for it? I thought.

I knew the answer: In language, we like to use different words for the same thing. A famous archeological decipherment puzzle was solved when someone realized the stone cutter had used different words for the same thing. A little repetition is okay but extreme repetition is not. Thus the term elegant variation. Using different words for the same thing is not just confusing, it makes the language harder to learn (because it is larger), with no obvious improvement in breadth or speed of communication.

Why do we do this? Why do we dislike certain sorts of repetition, even though language is built on repetition? I think the answer is that this is built into us to help the language to expand and grow. The variation seems useless but it isn’t because (a) there is a new word and (b) the new word can shift in meaning. The old word can continue to mean what it meant.

Fashion has a similar function. Our shifting preferences in art and decoration force artists to keep inventing. They cannot merely do the same thing over and over and over. Fashion obviously increases innovation.

In her brilliant book The Good Jobs Strategy, Zeynep Ton, an MIT business professor, says that retailers should “operate with slack” — meaning hire more employees than necessary. The effect is to give employees some free time. Why should this be? Because when you give employees free time you give them to think. Giving them time to think gives them time to think of improvements.

Language (elegant variation) and material science (fashion) might be more central to human life than well-run stores (slack) but in each case there are real problems to solve — and they are solved, in part, by adding seemingly-useless elements to the system. The new elements help the system improve.

Assorted Links

Thanks to John Batzel, dearieme and Adam Clemans.

The Idealist: Jeffrey Sachs and the Quest to End Poverty by Nina Munk

After I finished The Idealist: Jeffrey Sachs and the Quest to End Poverty by Nina Munk, I thought of something a graduate student in English had told me: A little Derrida goes a long way and a lot of Derrida goes a little way. It was literally true. A few sentences by Derrida, you could think about for days, maybe productively. A whole book by him was baffling and irritating. A lot of Jeffrey Sachs goes a little way, I thought.

When it came out (2005), I thought The End of Poverty by Sachs was the ravings of a lunatic. Munk’s book shows I was right but I had to admit that George Soros giving Sachs $100 million or whatever to put his ideas into practice (to “test” them) was considerably more interesting than the activities of the other billionaires Munk had written about before Sachs. Soros had an advisory board whose reaction to Sachs’s ideas was the same as mine but Soros overruled them. Soros was right. A tiny bit was learned from spending all that money, which is better than learning nothing. Certainly I learned more than if the money had been used to buy a private jet.

As an assistant professor doing animal learning experiments, I saw over and over that it was incredibly hard to learn anything. Anything. No doubt all science professors who are honest learn this. But then I saw something that is less easy to see: If doing the “right” thing pays off worse than we expect — Sachs’s flamboyant failure in Africa is an example — then doing the “wrong” thing should pay off better. If spending an enormous amount of money we learn less than expected, then when we spend very little money we should learn more than expected. This is the upside of ignorance. The less you know, the easier it is to learn more. And we know much less than famous professors, such as Sachs, say we know.

My personal science is the polar opposite of what Sachs did. He tried to help others (poor Africans), I try to help myself. He tries to help people he knows almost nothing about, I try to help myself — and I know a lot about myself. He tried to do something big (end poverty). I try to do something small (e.g., sleep better). What he did cost millions of dollars. What I do costs nothing. I can test a new idea about how to sleep better in days. Sachs took years to test his ideas. For me, failure costs almost nothing. Sachs’s failure cost him years of his life. You have to be an extraordinary person with great talent to do what Sachs did. Whereas anyone can do personal science.

Journal of Personal Science: L. Planturum-Rich Fermented Foods and Supplement Prevented/Cured My Eczema


by Shant Mesrobian

At some point during the last decade, while living in Washington D. C., I began to suffer from hand eczema. Painful red itchy inflamed dry skin covered most of my hands. It was usually triggered by cold dry weather in the fall and winter. It also flared up after a lot of cleaning — when my hands were exposed to a lot of water and soap, which dried them out. I was in my twenties when it began.

Eczema, also called atopic dermatitis, is believed to be a too-extreme allergic reaction. It is common. About 10% of American adults suffer from it, according to two recent surveys (here and here). In my case, a certain level of dryness is required. I believe the dryness, which may reduce a protective coating, allows something in the environment, like dust or pollen, to trigger an allergic inflammatory response.

The first thing I did to solve the problem was see a dermatologist, who prescribed a steroid-based cream. The cream did reduce the inflammation. It was just something to apply when the inflammation appeared. It didn’t stop it from happening. As I learned more about eczema, I decided this was an absurd solution. Steroids have nothing to do with the cause of eczema. At best they treated the symptoms, and had bad side effects (is anything creepier than “skin thinning”?).

Then a funny thing happened. A few years ago, my eczema disappeared. I didn’t notice it had stopped until this fall (2013), when it came back. I had forgotten about it. As soon as the weather turned cold and dry, it hit hard.

Why had it disappeared and returned? My environment had not changed in any big way. Nor, when I first thought about it, could I think of any dietary changes in the past year or two. Then I realized I had made a dietary change – and recently. In September (2013), I had stopped eating a few fermented foods that I had steadily eaten for the past few years — sauerkraut, kimchi, and kombucha. I had drank kombucha only a few times a month but had eaten sauerkraut or kimchi almost daily (3-4 forkfuls/day, $0.50/day). I had started eating them in 2011, hoping they would improve my health. The last time I had had eczema was the winter before I began regularly eating them.

Had the fermented food prevented eczema? This was not far-fetched. The ideas that (a) bacteria in food can influence your immune system and that (b) bacterial exposure can “calm down” an over-reactive immune system are both well-accepted. Review articles are here, here and here. There is lots of supporting evidence. An early example is the evidence behind the hygiene hypothesis – children in “dirty” places had fewer allergies than children in cleaner places. This article says “approximately 70% of the entire immune system” is in the gastrointestinal system.
Fermented vegetables like sauerkraut and kimchi are dominated by the bacterial species Lactobacillus plantarum. If sauerkraut and kimchi had prevented eczema, it was probably due to L. plantarum.

After multiple flares over a few months, I tested this idea. I found a probiotic supplement (Jarrow Formulas Ideal Bowel Support) solely composed of L. plantarum. Then I waited for my eczema to flare up again. When it did (early January 2014), I began taking the supplement (one pill daily, $0.50/day). Within three days, the eczema had completely disappeared. In the past, three days after it started the eczema got worse. It usually lasted about two weeks from start to disappearance. I had never seen it disappear like this. Usually at this point (3 days after it started) hand washing would be painful and make it worse. Now I could hand wash with abandon. Even more amazing: I could walk around outside during a cold spell without gloves, and did not have any exacerbation or return of symptoms. Being able to do these things three days into a flare up had never happened before.

I kept taking the supplement (one pill/day). In the past, before the fermented foods, I had at least some inflammation on my hands through the entire fall and winter, with extreme periods and less extreme periods. Now (February 2014) I have zero inflammation. In the past, dryness on my hands immediately led to inflammation. In normal people, dry hands are dry hands. I never have just dry hands. Dryness is a trigger. I’m not used to seeing a dry hand without inflammation on it. For the past few weeks, I’ve had mildly dry hands without inflammation. I’ve become a normal person with dry hands.

Several studies – which I didn’t know about when I saw that the probiotic supplement helped — support the idea that L. plantarum can reduce eczema. Two studies (here and here) found that L. plantarum inhibited house-dust-mite-induced eczema in mice. Another study found that L. plantarum inhibited allergic reaction and histamine-induced scratching (itching is a hallmark symptom of eczema) in mice. It concluded that L. plantarum “may improve allergic diseases, such as . . . atopic dermatitis”. In another mouse study, L. plantarum was successfully used to reduce dust mite allergy. The most impressive evidence was from a 2012 study done with children in South Korea. All of them had eczema. Those given L. plantarum improved much more over 14 weeks than those given a placebo.

In contrast to my success, many studies have found no effect of probiotic supplements on eczema. One review concluded “Initial meta-analyses suggest no benefit of probiotics [supplements] in the treatment of eczema or asthma.” Maybe they tested the wrong bacteria or used a too-small dose. I haven’t noticed any effect of yogurt (which contains different bacteria) on my eczema.

After I posted about this in my blog, several people tried something similar and reported what happened. Overall I would summarize their results as modest improvement. The most positive result was this: “After 5 days of radish kimchi the eczema in that person [a family member] is very clearly receding and, in a few spots, is completely gone. From prior experience, it would not have done this on its own.” The least positive result was no change, which a few people noticed.

My interpretation is that kimchi and sauerkraut – that’s what everyone tried — have far less L. plantarum than the probiotic supplement I took. This article considered sauerkraut “probiotic” when the concentration of L. plantarum was “higher than 10^6 colony-forming units (CFU) per gram of product”.
This sauerkraut maker says their sauerkraut has 8 x 10^6 CFU per gram. A serving of sauerkraut might be 60 g, so the total number of L. plantarum in one serving will be roughly 5 x 10^8. In contrast, the probiotic supplement I took supposedly contained 10^10 CFU – a factor of one hundred more. A daily dose of 5 x 10^8 CFU might eliminate eczema if you eat it for months, as I did, but might produce much more modest results after just a week.

Adult Acne Due to Allergy

Someone commented:

I had awful adult acne, hideous cystic lumps that left scars. My college pictures are hard to look at. This continued into late twenties. It was [due to] a food allergy [that] took forever to figure out: black tea. Especially Oolong. [Oolong and black tea are usually distinguished. Black tea is “fully-fermented”, oolong “semi-fermented”. — Seth] My face would begin to itch within minutes of drinking, and the breakout came the following day. But it took years to notice the connection. . . . Green tea is no problem. Coffee is no problem.

In response to my questions, he verified the connection:

On Tuesday night, I drank two cups of strong black tea. Itching began within a hour, and mouth sores hit 18 hours later. Now at 48 hours, very slight acne breakout, but not bad at all.

Part of figuring out the problem was realizing that face itching was a bad sign. The black tea –> itching connection was relatively easy to notice. Another difficulty was the wrong ideas he’d been taught:

To figure out the tea, I first had to unlearn things that turned out to be wrong. Unlearning seems to be much slower than learning.

First, when I was in high school, acne was widely considered to be partly a hygiene problem. So I spent vast useless effort washing several times a day, while possibly missing signals that the cause was something else. Later, in college, I tried washing my face only with water, and then not at all. This turned out to have no effect on acne. That was the first clue of wrong learning.

Second, in high school I drank a lot of grapefruit juice. The citric acid was extremely painful on the mouth sores. I somehow concluded, maybe just emotionally biased by the sharp pain, that grapefruit juice was causing the sores. In college I didn’t drink grapefruit juice, but there was no effect on mouth sores.

Third, a received wisdom was that acne is hormonal, and there was not much you could do but try to manage it. So I didn’t even try to look for an environmental cause, until I was still suffering from acne well into my twenties.

These three wrong conclusions probably cost me years.

Not to mention the astonishing claim of dermatologists that acne is not caused by diet. This list of what to do about acne from the American Academy of Dermatology says nothing about food. It is plausible that in this situation — in 2014, after hundreds of years of experience treating the problem and thousands of medical journal articles about it — the overall effect of doctors is to make things worse.

“Night and Day”: Steve Hansen on Teaching

At a recent dinner, Steve Hansen, a friend of mine, said the difference between his current teaching and earlier teaching is “night and day,” partly due to this blog. I asked him to elaborate.

ROBERTS What is your teaching situation?

HANSEN I’ve been teaching at Peking University [in Beijing] in the Guanghua MBA program for the last two years. I teach courses in innovation (big company Clayton Christensen sort of stuff), entrepreneurship, and social responsibility/social enterprise. The classes usually consist of 30-50 students from all over the world.

My teaching at Peking U. is a part-time job. Full-time I run a social enterprise here in Beijing (Phonemica). Before this I was a professional market researcher working at a large company and I worked as a consultant for years. Although I had a little teaching experience early in my career (e.g. taught undergraduates when I was a grad student), I certainly did not have any special teacher training or background. I was hired at Peking U. on the basis of my professional experience. Thus when I started teaching I was to a large extent repeating to my students the experience I had had as an MBA student myself, years ago.

ROBERTS How did you teach this course at first?

HANSEN My teaching changed quite a bit in the first year. The first semester I did lecture and discussion. I didn’t like it. I felt it was a lot of work to prepare, and while it helped me personally a lot, by getting me to summarize my learnings from years of reading and work experience, I didn’t feel it gave the students a lot. Even though the course got mildly positive reviews, I felt the students weren’t engaged in a way that made me excited about going to teach.

The second semester I started making changes. First, I took to heart some advice I got to follow more of a case study approach. The experience I gave the students in the beginning of that semester was fairly standard “case study” method made famous by Harvard. Here‘s a mini-documentary of how Harvard expects case study method to work. The professor asks pointed questions from the case and expects the students to have answers and defend them.

ROBERTS What caused you to change how you teach it?

HANSEN I like the case study method in theory. I like it a lot. I think by mimicking real life situations and summarizing the many facts that synthesize a business manager’s knowledge and must be put to use in making business decisions, the case study method has the potential to help students learn in a way that is useful: giving them the skills to make real-world decisions, and doing it faster than they could get the same experience by going out and working. As far as activities that can be done in an academic environment go, the case study is pretty darned close to “learning by doing”.

However, I found my classroom reality was different from the ideal portrayed in that Harvard Youtube video, in which a professor says, “I have been amazed… at the consistent level of high preparation”.

In my reality, students often didn’t come prepared. Sometimes they would say, “Sorry, I didn’t have time to read the case” — despite significant portions of the grade being dependent on in-class participation. And even if they were prepared, to some extent, often it wouldn’t be to the extent that I had hoped, where they were able to argue the intricacies of a position and defend it. Instead they might give a cursory answer, with a weak defense, and much of the class would be spent with me pushing them to elaborate their answers through Socratic questioning, lecturing, and so on.

So I was still doing a lot of the talking, and really leading the class. It was better than my first semester, but it wasn’t meeting my standards of what a real learning environment should be: student-led because they’re motivated to learn.

It was about at that time that I must have read some of the articles and ideas you published about “learn by doing”. Those rang true to me. Learning by doing is something I’ve always believed in and tried to practice, and I realized that my students still weren’t doing it.

So later during that semester I started experimenting. My first experiment, I’m sorry to say, was a complete failure. My approach for a few classes was to have students simply teach the class. I would assign the next class’s case study to a group. They would read the case and come up with main points. I would meet with them and review what they were going to do. Then they went in and tried to teach their fellow students.

In retrospect it seems obvious that this was wrong. As business school students the “doing” that I wanted them to do shouldn’t have been to “do teaching” but to “do business” as simulated in the case. When the students were teaching the case they were (again naturally, in retrospect) worse than I was. They would lecture rather than ask. They would miss key issues. And of course they had the same problem I’d noticed myself: other students weren’t prepared enough, even though the lecturing group was extremely prepared.

After enough experimentation to realize this wasn’t working, I cut it off and went back to my semi-successful case study method.

But the failure had given me an idea. I saw that students who were forced to present were MUCH more engaged than those who sat and listened. Why not, I thought, just make everyone present? It would kill several birds with one stone. First, I’d noticed that students’ presentation skills needed a lot of work. They had trouble being concise and answering the critical questions. Having to present would give them practice on this critical skill. Second, they’d be engaged and motivated — at least for the part where they were presenting. Third, by divide-and-conquer of the case itself, we’d get far deeper into the details and (sometimes) quantitative analysis of the cases.

And so that’s what I started doing this year. It has worked even better than I imagined. Not only are students engaged for their part of the lecture and discussion; the preparation seems to spill over into the whole case, so most students really know what’s going on. The presentations get better and better as the semester progresses. In contrast to the past, now I’m having to shut down vigorous discussions in the interest of time, rather than ask pointed questions to stimulate interest. And best of all, this environment satisfies my own desire of creating a place where students want to learn. I work less, and the students learn more. That’s the part that seems “night and day” to me.

For anyone who’s curious, there are some details I’ve worked on to make the approach better, at least for my particular situation. Here’s the nitty gritty:

I divide the class into random groups of 4-5 students. That group is together for the semester, and for each class they’re tasked with presenting on one part of the case. I assign that presentation the week before, and it’s often a question that forces them to take a position. Often, too, I assign the same question to two different groups. This has the effect of creating a sort of debate between the groups, because they almost never come up with the same answer to a question.

I require VERY short presentations. Usually 2 minutes. Sometimes 3 or 4 if the topic is very complex. I allow any member of the group to present. Although I encourage them all to take the opportunity to practice presenting, I don’t force the issue.

All the students in the group get the same grade, but with the following “peer evaluation” element that I adapted from someone else (i read about it online but have now lost track of where). Peer evaluation means that your fellow students give you a grade at the end of the semester. If your fellow students all give you 100%, then you get 100% of the group grade. That’s the usual case. On the other hand, if all your fellow students give you 50%, that probably means you didn’t do much and you get only 50% of the group grade — a guaranteed failure for that portion of the class. In even more detail, what I do is take the average of the peer scores, but not including the lowest score. This virtually eliminates the possibility that one enemy classmate can sabotage a groupmate’s grade.

Overall I’ve found that the peer evaluation mostly eliminates the freeloader problem that general plagues groupwork. In cases where someone tries to freeload, they simply get a bad grade, so the other groupmates aren’t really bothered about it.

At least as importantly, this entire system, once explained, makes my grading job much easier.

I also like the “group is responsible for the presentation” approach because it allows some flexibility. There’s always going to be a week during a semester that a student simply gets swamped with other things and doesn’t have time to prepare. Under the group presentation regime, the busy students can beg groupmates to cover for them, and then return the favor another week. Would it be better if everyone were always prepared for every class? Well, maybe, but that doesn’t really seem realistic.

ROBERTS What did you read that influenced you?

HANSEN I read all your posts about education and teaching. It’s hard to say any one post made me change the way I teach. It’s more that your posts about teaching, like your posts about diet etc., often help me consider what my goals are and how I can do low-risk experiments to find better ways to reach those goals.

As for specifics…

I remember reading this, for example, that helped me remember to think about my students’ goals rather than my own for them (not that I think I should have no influence on their goals — more that I should keep in mind they are autonomous agents about whom I know little and should learn more).

I still grade, but I’ve experimented with “grading less” I guess you could call it, partly inspired by discussion like this.

I was probably most influenced/inspired by the Halmos paper (also here) you mentioned. I was a math major as an undergraduate, so I liked the subject matter. I was always interested in the kind of simple statement of problems and choices that he describes in that paper, not just in math, but in business and elsewhere. I really enjoy simple problem statements that force one to go through complicated analyses and yet still reduce everything back to a simple statement of resolution. Business at its most interesting can be quite like that. You have to make decisions: fund this project or don’t. Build this product or build that one. What do you do?

Even more than enjoying the problems, though, I completely agree that the hard part is making students ask questions. It’s not actually solving the problems that’s hard; it’s figuring out what the problems are in the first place. After reading his paper, I started doing some searching and found others who were experimenting with teaching techniques. It would take me a while to re-find those people, but I definitely gleaned ideas from others. These helped shape my own experimentation.

Assorted Links

Thanks to Carl Willat.

Evidence that Antioxidants Increase Cancer

Many researchers were shocked when a large 1984 experiment found that a beta-carotene supplement increased lung cancer. Because beta-carotene is a potent antioxidant, and epidemiology had linked eating vegetables with less cancer, it was supposed to decrease lung cancer. My Berkeley neighbor Bruce Ames was the foremost proponent of the idea that antioxidants will decrease cancer.

Now more evidence supports the idea that antioxidants may increase cancer.

A request for comment elicited this:

“It’s disappointing but not surprising that people’s beliefs are not modified by scientific evidence,” said Dr Paul Marantz, an epidemiologist at Albert Einstein College of Medicine in New York. “People so want to believe there is a magic bullet out there.”

One commenter on the article rightly says:

“It’s disappointing but not surprising that people’s beliefs are not modified by scientific evidence,” . . . Rather a snide comment considering the fact that it was science that spent years telling everyone that antioxidants and supplements were beneficial.