Science in Action: Omega-3 (a new test)

Two days ago I explained why the test I was using to measure my mental function many times/day had room for improvement. I wanted a new test much like the old test but with which my accuracy was higher.

I was more accurate with the simple arithmetic test (e.g., 3 + 6) than with the memory test I described two days ago. The crucial difference might have been the number of possible answers. The arithmetic test had 40-odd possible answers; the memory test had 2 (yes and no). Saul Sternberg did a reaction-time experiment in which the number of possible answers was varied from 2 to 8. I don’t know what the accuracy data were but the variance of the reaction times was lower with 8 possible answers even though reaction times were longer. A plausible explanation is that there was much more anticipation with 2 possible answers than with 8. Anticipation can cause errors.

The new test I am trying consists of typing how many letters from the set {A, B, C, D} are among a set of four letters chosen from a much larger set (most of the alphabet). The possible answers are “1″, “2″, “3″, and “4,” each equally likely. For example, I might see T B X A. The correct answer is “2″. I am using R (the programming language) to run this test so I type “2″ with one hand and hit Enter with the other as fast as possible.

Here are the results so far from the new test — the training phase.

mean RT

These values are taken from fit of a linear model; they are similar to means. As I gain experience with the test I am getting faster. The new test is slower than the old test (which is good — more mental processing).

Consistent with what Sternberg found, variation in reaction times is less with the new test than with the old test even though average reaction times are greater:

This graph shows the standard deviation of residuals from the fitted model. The units are reciprocal seconds (x 10) because I did a reciprocal transformation before fitting the model. The reciprocal transformation made the reaction times close to normally distributed.

Here is accuracy:

The new test feels easier than the old test, but so far there is little difference.

Overall it seems to be a step in the right direction. Reduction in variation of reaction times means more sensitive measurements.

The experiments I am planning are very simple: Test myself regularly (say, every half-hour), eat something. If the measurements are steady, it is very easy to see an effect. As far as I know, such experiments have never been done. One reason, I think, is that they require self-experimentation: It is no trouble for me to do the test (which takes 4 minutes) 100 times in a week and thereby reach a steady state. But to have someone else do the test 100 times as preparation — especially if the test were done in a lab — would be very difficult.

Science in Action: Omega-3 (follow-up of surprise)

During a trip to Los Angeles a few weeks ago, I noticed that my scores on several mental tests were better all of a sudden. The apparent cause was that I had taken flaxseed oil at an unusual time. Normally I took it about 10 hours before the tests; in this case I had taken it about 4 hours before.

Does flaxseed oil have a short-lived effect on brain function? When I got home I tried to find out. Rather than doing a set of four tests once per day I switched to one test many times per day (e.g., 10 times). This would allow detection of short-lived ups and downs in my mental function.

The test I used required nothing but my laptop. I usually have my laptop with me so such a test is much easier to do throughout the day than a task that requires other equipment. The test consisted of four blocks of 50 trials each. For each block I memorized a new set of three digits (e.g., 0 1 7). On each trial I saw 1, 3, or 5 digits and pressed a keyboard key as quickly as possible to indicate if any of the memorized digits is in the displayed set. For example, if the memory set was 0 1 7 and the display set was 3 2 8 the correct answer was “no” (which I indicated by pressing “4″).

The trials were packed together as closely as possible: As soon as I answered, the next set appeared. It took about 3 minutes to do 200 trials.

I did frequent measurements for four or five days. They appeared to confirm what the Los Angeles measurements suggested: Flaxseed oil did have a short-term effect. But two things muddied the water:

1. Baseline measurements were not always as steady as I would like. There were ups and downs that seemed too large to be random variation. The curious and exciting thing was that these ups and downs usually had a possible explanation — something had changed. For example, the measurements would be X1, X2, X3, Y. X1, X2, and X3 are close; Y is quite different. Between X3 and Y I had eaten a meal.

2. The task was difficult. I was about 88% correct and it was hard to do better. With any reaction-time task there is a speed-accuracy tradeoff: If you are slower, you can be more accurate. In this particular case this is a problem because it is an added source of variation and may reduce reaction-time differences: Rather than becoming slower, I become less accurate (or rather than becoming faster I become more accurate).

Problem #1 is easy (if slightly unpleasant) to solve: Keep the situation more constant. Eat less during the measurement period, etc.

To reduce Problem #2 I am learning a new task. I will go into detail tomorrow.

Omega-3: I Can See For Myself

“The flax seed oil scam” by a herbalist named Henriette says bad things about flaxseed oil. One is about (lack of) conversion of ALA (the short-chain omega-3 in flaxseed oil) to EPA and DHA (the long-chain omega-3s found in fish oil and presumably active in the brain):

The scam is in flax seed oil folks trying to maintain that we can convert ALA into EPA and DHA in anything like relevant amounts.

We can’t. We convert at most 10 %, but usually less than half that.

Which is “fairly common knowledge among nutritionists,” says Henriette. She quotes the abstracts of two scientific papers to support this point. The other criticism is that flaxseed oil goes bad quickly:

I dislike flax seed oil for another reason as well: it oxidizes (goes rancid) pretty much the minute it’s pressed, and unless it’s been refrigerated ALL the way from press to consumer, it’s ALWAYS rancid.

After I read this, I realized I was in an unusual position. When it comes to flaxseed oil, I don’t have to take anyone’s word for it. I have been able to measure the benefits by myself on myself. Apparently the conversion ratio, whatever it is, is high enough; and the suppliers of my flaxseed oil (I have used Spectrum Organic, Barlean’s, and the Whole Foods house brand) have solved the oxidation problem.

With almost every other nutrient, my knowledge is far less certain. Sure, I need some Vitamin C, but how much is best? Too much may cause cancer. I’ll probably never know the best amount for the average person, much less the best amount for myself.

Irritability and Coca-Cola

The following is from a friend of mine. He is in the middle of a self-experiment to measure the effect of various forms of Coca-Cola (regular, diet, diet w/o caffeine) on his mood.

TODAY’S EVENT

Today ~20 oz of coca cola (w/ caffeine and w/ sugar) dramatically eliminated (in about a minute) a very real, strong feeling of irritability.

BACKGROUND

I am on day 17/30 of the experiment and I am still blinded to the results of the first 16 days. I do know that none of my previous mood experiences in the past 16 days were like the one today.

I had a significant bought of irritability (6/10) today. This irritability has been brewing last 48 hours but was palpable all morning after I woke up this AM. This irritability was the REAL DEAL that I have been seeking the past few weeks – my family was well aware of my irritability yesterday and this AM. Since this irritability was so palpable, I decided to break my experimental protocol and drink a known real coke. Quite remarkably, within a minute or so of consuming the whole coke (~20 oz – large) my irritability was gone (really gone). [He drank the coke in 2 or 3 minutes. The effect lasted about an hour.] Be clear, this was not some psychological maybe I feel this maybe I don’t, this was real psychiatric, can’t miss it, need some drugs, psychotropic bad/irritable feeling.

The past 16 days of this experiment has made me very familiar with hunger, bad moods, hunger irritability, assessing my feelings around hunger, assessing feelings around soda pop, assessing feelings around a good meal. Therefore, today I was well prepared to focus on the minute to minute dynamics around drinking this coke – the coke abruptly ended hours of feeling irritable (no better word to describe the mood than irritable).

RESULTS

-1) Now that I am half way through the experiment, I think I can break the blind by identifying the three different types of coke. I can taste the clean sweetness of real coke immediately, I can feel caffeine in my body from the diet coke in about 5 minutes.

0) I am currently blinded to the results of the experiment I am doing. However, I do have some anecdotal impressions that presumed diet w/o caffeine causes no mood affect, diet w/ caf does affect mood, coke w/ caffeine and w/ sugar does affect mood. My anecdotal impression is that these effects are mild to modest.

1) Today was the first time I felt psychiatric grade irritability confounded by hunger irritability. Today unblinded Coke abruptly eliminated the bad feelings associated with this irritability.

2) I have been rating my mood with full meals 20-40 minutes after my soda pop drink and my impression is that real satiation does have some positive mood effects.

DISCUSSION

The big target is understanding how 20 oz of sugar and caffeine totally eliminates the strong and persistent feeling of psychiatric grade irritability confounded by hunger irritability. Designing an experiment to go for this issue is challenged by the infrequentness of this psychiatric grade irritability.

Coke eliminating irritability appears to produce happiness by eliminating the presence of bad irritability feelings. In this setting, Coke did not produce any positive feelings, Coke simply eliminated some strong bad feelings. Coke is not producing a good mood, it removed a bad one. (There may have been some “psychological” grade good mood, but this was so tentative and hard to assess that I am happy saying Coke produced no positive affect. The removal of the psychiatric irritable mood was clear and absolute).

In contrast to the absence of irritability caused by coke (and no good mood effects), I think the satiation I have experienced these past 16 days from the big healthy meals following my soda pop does has some positive feelings associated with it. Satiation presumably feels good not just because of elimination of hunger, there seems to be some warm glow from eating a large, well-balanced, fatty, carbo, vegetable, sweet meal.

There appear to be different kinds of irritability. More than six hours without food brings on a form of irritability, but this hunger irritability appears to be different from “mood” irritability. Mood irritability lasts for days while hunger irritability lasts for hours. Hunger irritability produced in the setting of no mood irritability is not that profound. Hunger irritability on top of mood irritability appears to be the REAL DEAL of irritability. It is this REAL DEAL of irritability which today (and typically) creates the setting such that a large caffeine/sugar soft drink eliminates the persistent palpable bad feelings associated with REAL DEAL irritability.

I understand why it would be nice if the subject is blinded. However, I am not sure the subject needs to be blinded. I think one still gets meaningful results even if placebo/nocebo effects are folded into the results.

CONCLUSION

A couple of days of irritability compounded by hunger produces a strong form of irritability which was dramatically relieved by a large glass of caffeine/sugar coke today (unblinded N = 1 in experiment). Strategies for further behavioral characterization of this phenomenon are needed. A physiological hypothesis is needed. A future design for FMRI measurements of this quick irritability response to caffeine/sugar will be fun to design.

In the final analysis, I guess it is worth finishing the current experiment – even though I think I can determine the identity of each drink. Good data from an inadequate experimental design will be helpful in creating a better experimental design.

About the author: John Keltner has a Ph.D. in Physics from UC Berkeley and an M.D. from Harvard. He is a research fellow at the University of Oxford. Given these results, I asked John if he was addicted to caffeine. He told me no, going without caffeine did not make him more irritable.

Why is Sicko So Good?

In What is Art? Tolstoy argued that the goal of art is to evoke emotion. According to a Blue Cross vice president, “You would have to be dead to be unaffected by [Sicko].”

Why is Sicko so good?

I have a theory: the Internet. At his website, Moore asked for health-insurance horror stories. He got 25 thousand submissions, I have read. With that much to work with, you can select some extremely moving stories. Not only that. In an article I wrote for Spy, my editor crossed out some comment I had made. “Sometimes the material is so good it speaks for itself,” she said. Moore’s material was so good it spoke for itself. Because Moore said less the diversity of voices was increased, a big artistic plus.

There is a connection with self-experimentation. I was surprised how effective my self-experimentation turned out to be — effective scientifically. Far more than my other research (just as Sicko is far better than Moore’s other movies). I came to believe that there was a large plodding element in effective science — to find new cause-effect relationships, you needed to be able to try lots of things. Self-experimentation worked so well because it made it easy to plod, to try lots of things. Sicko is so good because his website made it easy for Moore to gather lots of good stories.

Moore and Jane Jacobs.

Science in Action: Omega-3 (data from my mom)

My mother tried drinking flaxseed oil. She measured her balance by standing on one leg; the measure was how long she could do that. She did ten of these measurements per day.

Here is what happened:

effect of flaxseed oil on balance

When she started taking the flaxseed oil, her balance suddenly started to improve.

Are injury-causing falls “the new scurvy,” I wondered — that is, caused by an easily-preventable nutrient deficiency? These results support that idea. However, I can’t explain the decline in balance during the pre-flaxseed baseline period. Perhaps she had eaten food high in omega-3 and the effects were wearing off.

Here are precautions about flaxseed oil. If you are 70 years old or older and would like to find out if flaxseed oil improves your balance, please contact me.

Directory of my omega-3 research.

Science in Action: Omega-3 (a surprise!)

I have always stopped self-experimenting when I travel because so much changes. Surely I will sleep differently, etc., far from home. However, it is not so obvious my arithmetic speed (how fast I do arithmetic problems such as 6 + 3) will change. I am measuring arithmetic speed as part of my study of omega-3 (directory).

I recently spent a week in Los Angeles. For the first time I continued self-experimentation while traveling. When I arrived I bought a bottle of flaxseed oil. I continued to take 4 T/day and did the same mental-function tests I do at home: arithmetic, memory-scanning, and balance. I have described these tests in other posts.

My balance was much worse in Los Angeles, apparently because what I see during the test changed (because the floor and other surroundings are different). I hadn’t realized how much that mattered. My arithmetic and memory-scanning results were roughly the same as the results at home — that is, until the last day. This graph shows arithmetic speeds:

arithmetic speed

This graph shows memory-scanning results:

memory scanning speeds

The sudden improvement on the last day — also clear in the balance test — was a big surprise. It was too large to be due to practice, nor could it be due to being in LA — the previous 5 measurements were also in LA. It did, however, have a ready explanation: The previous night I had gotten back late and had forgotten to take the oil. So instead of taking 4 T at 11 pm I took it at 7 am. I did the tests at about noon. Instead of 8 or 9 hours between oil ingestion and test, in this case the difference was 5 hours.

If this explanation is correct, there is a short-lived effect of flaxseed oil on brain function — present 5 hours after ingestion but absent or weaker 8 hours later. Which, as a scientist, makes me say “Wow!” If this effect exists, it’s a new tool, the most precious and powerful thing in science. I can use it to compare amounts of flaxseed oil, oils (e.g., fish oil), and foods (e.g., salmon).

My current way of measuring omega-3 effects requires one/day tests repeated for weeks. When I reduced the amount of flaxseed oil I was taking from 4 T/day to nothing, it took more than a day with the lower dose before performance even went down, and many more days before performance stabilized. This meant that experiments had to last several weeks. If the new effect exists, it will allow much faster experiments.

The Twilight of Expertise (part 5: psychotherapy)

In The Starfish and the Spider (2006), a book about decentralized organizations, one of the examples is Alcoholics Anonymous, started in 1935, in which local chapters are almost entirely autonomous from headquarters. Of course AA led to many similar programs: Narcotics Anonymous, Overeaters Anonymous, and so on. All of these twelve-step programs offer therapy without therapists — for free. A little like the Protestant Reformation, which I mentioned earlier.

At a recent party I met a woman who runs an outpatient program for persons with mental disorders, including major depression. She asked me what I would suggest. Based on my faces research, I suggested early morning face-to-face meetings, especially for persons with depression. Very interesting, she said, AA folk wisdom is that morning meetings have the best success rates.

If you want to attend an early morning meeting (non-twelve-step), and you live in San Francisco, you may have a communal breakfast ($5 plus tax, served 8:30-9:30 am) at OneTaste (1074 Folsom at 7th St.), an “Urban Retreat Center”. If you can do this, I’m jealous. OneTaste is a group of 50 people who live and work together. They appear to support themselves by teaching yoga and giving other classes. They have been at their SF location for two years; before that they were at many different locations. The receptionist told me it was a “sensual community.” What’s that? I asked. “We try to activate our sensuality” etc., she said. I didn’t know what she meant. Is this on the website? I asked. Yes, she said, so I didn’t bother to take careful notes. I wish I had. The website puts it more bluntly: “Our purpose at OneTaste is to return to connection by researching our relationship to orgasm.” A recruitment video, to prepare for breakfast.

Science in Action: Sunlight and Sleep (progress report)

I’ve collected even more observations supporting the idea that outdoor light improves my sleep, as discussed earlier. Now I’d like to get some idea of the dose-response function. To sleep really well do I need two hours of outside light? Four hours? Eight hours?

I’ve started to rate my sleep on a scale where 50 = average sleep (average for the months before I started spending more time outside) and 100 = best sleep imaginable (which I got after standing about 10 hours). And I’ve started to use a stopwatch to measure how long I spend outdoors. I’ve also been using a light meter to measure the strength of light in various places. When I’m outdoors it’s almost always in the shade. Today I discovered that sitting indoors next to a cafe window the incident light was just as bright as when I sit outside. Great to know because indoors I can plug in my laptop.

A 1994 book chapter from Daniel Kripke‘s lab reported a correlation (0.24) between low light exposure and “abnormal sleep.” So the connection I am now studying has been plausible for many years. The measurements I am now making are easy, but no one made them. Perhaps too many people believe that anything other than a double-blind trial with control and experimental groups is, as Peter Norvig, Google’s Director of Research, believes, a “mistake.”

The Twilight of Expertise (part 3)

Do you need to be an expert on Topic X to write a serious (i.e., non-celebrity) well-paid well-publicized book about it? Less and less. As I said earlier, I am not a weight-control expert. Mickey DeLorenzo, a Philadelphia “multi-media developer” (website designer?) is even less of a weight-control expert. However, he used his Wii to lose 9 pounds in six weeks (story and data) and is working with an agent from a well-respected agency to write a book about it. The publicity started with digg.

You already knew you no longer have to be an expert on Topic X to write a well-read encyclopedia article about it.

Part 1. Part 2.

Thanks to Elaine Smith.