Coffee Experiments: Suggestions for Improvement

Seth Brown, a “data scientist” with a Ph.D. in computational genomics, has done several experiments about the best way to make coffee. In one, he compared other people’s burr grinders to his blade grinder. There was no clear difference in taste. In another, an Aeropress apparently produced better-tasting coffee than drip extraction. He hasn’t found other factors that matter. If I drank coffee, I’d be happy to know these things.

If I were teaching how to do experiments, his work would be a good case study. I’d have my students read it and suggest improvements. The contrast between his data analysis (sophisticated) and experimental design (unsophisticated) is striking, maybe because he has no background in experimentation.

Here’s what I would have done differently:

1. Study my reactions, not the reactions of guests. He had house guests rate the coffee he made. Yet he brews coffee for himself much more often than for others — at least, he gives that impression. Since his main customer is himself, it wasn’t clear why other people’s opinions are more important than his opinion. Maybe he read somewhere that blinding is good and thought it would be easier to achieve if other people did the ratings. He could have rated coffee he made himself blinded. Put stickers on the bottom of identical cups, shuffle the cups. However, since he will usually make coffee unblinded (he will know how he made it), it isn’t clear that blinding is good.

2. No “control” experiments. In a “control” experiment, he asked guests which of two identically-made cups of coffee was better. He doesn’t say what he learned from this — apparently nothing.

3. Simultaneous presentation. He gave guests two cups of coffee made differently and asked which they preferred. Apparently he gave them one cup at a time. Simultaneous presentation, allowing them to go back and forth, would have allowed much better discrimination. Maybe the two types of grinder differed but his experiment was too noisy to detect this.

In a footnote he wrote:

Ideally, I would have liked to use better control conditions [he appears to realize that there was something wrong with his control experiment — SR], larger sample sizes, more thorough subject randomization [I have no idea what this means; his designs are within-subject. In within-subject experiments, subjects are not randomized — SR], and a more consistent testing environment.

All of these changes would have made his experiments more difficult. Maybe he has internalized the rule harder is better.

The beginning of wisdom about science is roughly the opposite: do the simplest easiest thing that will tell you something. We always know less than we think, so make as few assumptions and as little investment as possible. The easier your experiment, the less you will lose if you make a wrong assumption. The smaller your sample size, the more resources (time, money, subjects, energy) you will have left over for other experiments. Bunsen’s experiments would have been easier if he had studied himself. By studying others, he made an untested assumption that they resembled him.

I’ve done dozens of tea experiments in which I compared tea brewed two different ways. The main things I’ve learned, besides best brew times and best amounts of tea to use, are: 1. Rinse tea before brewing. It eliminates a kind of dirty taste. 2. Combine chocolate tea and black tea. The combination is better than either alone. 3. A little bit of salt helps.

Tisano Chocolate Tea and Combining Complex Flavors

After I interviewed Patrick Pineda about how Tisano Tea began, he gave me several tins of chocolate tea, their main product. Since then, I’ve had dozens of cups of chocolate tea. It’s a good caffeine-free drink, especially with cream.

My main use of chocolate tea, however, has been to improve black tea. Black tea + chocolate tea = great drink, better than any black tea alone or chocolate tea alone. So much better that I have stopped drinking black tea the usual way (without chocolate tea). Even cheap black tea (e.g., Lipton’s) plus chocolate tea tastes better than expensive black tea. I think I know why. Black tea (fermented) has a complex flavor, like most fermented foods. Expensive black tea is more complex than cheap black tea, but only a little more. Likewise, chocolate tea has a complex flavor (like chocolate). Combining two sources of substantial complexity produces tea with great complexity — much more than you can get by tweaking one source of complexity (e.g., varying black tea).

Here’s a recipe:

1. To 2.0 g of black tea and 0.9 g of chocolate tea add 8 oz of boiling water. Brew 4 minutes.

2. Add cream and sugar to taste.

Peet’s tea designers may have reached a similar conclusion. Peet’s sells limited-edition teas that are available for only a few months, one at a time. Several months ago the limited-edition tea was Red Cloud Cacao, which combined black tea, chocolate tea, and rooibos. The chocolate tea was from Tisano. I loved it. It sold surprisingly well, I’m told. Their next limited-edition tea, still available, is Anniversary Breakfast Blend. Here’s what the tin says:

We seek out small lot teas with unique characters and intriguing flavors . . . Then . . . we set out to make great teas even better . . . We artfully marry the elements of distinctive black teas until we have achieved a well-balanced, extraordinarily aromatic, and flavorful cup.

I told a Peet’s customer service person how much I liked the combination of black and chocolate tea. That’s funny, she said, the Anniversary Breakfast Blend is made by adding a chocolate mist to black tea. The blended teas are misted with chocolate. The website and the container say nothing about this. My guess is that the tea designers came to the same conclusion as me. Chocolate was so potent they couldn’t bear to omit it. But they couldn’t simply add chocolate tea to the blend, because that would repeat Red Cloud Cacao, appear formulaic, and spoil the story of “seek[ing] out small lot teas”. It would also be obvious: You could look at the tea and see the chocolate. So they used chocolate mist and didn’t tell customers. What the tin says is doughnut truth: The whole truth, nothing but the truth, with a hole in the truth.

Complexity is much different than other sources of pleasure in food (salty, sweet, chewy, etc.). My explorations suggest we can detect a lot more complexity that you can get from a single fermented food. But I have yet to encounter a single recipe that combines fermented foods. Most professional recipes produce complexity via many spices, which is labor-intensive (you need to add and adjust all those spices, and worry about their age) and, in my experience, produces no better results than adding one fermented flavoring, such as miso.

Salting tea also seems to improve it.

Health benefits of cocoa, a new study.

How Things Begin: Tisano Tea

Tisano Tea, based in San Francisco, sells chocolate tea. It was started in 2010 by Patrick Pineda, Leonardo Zambrano, and Lucas Azpurua. I was curious about the company because I like two chocolate tea blends very much: Red Cloud Cacao (a black tea/chocolate tea blend from Peet’s, no longer available but they will bring it back) and CocoMate (from American Tea Room).

Patrick’s father was an ambassador from Venezuela. Patrick grew up in California and England and went to college at the University of East Anglia. After studying for a Master’s in Film Production from Columbia University (New York), he started working for Al Jazerra in Venezuela making documentaries. He also worked for a local TV station making segments for a children’s program. One segment was about cacao. He learned that Venezuelan cacao beans were among the most highly-valued cacao beans in the world. The cacao beans from one valley (Chuao) sold for ten times the usual price.

While making the segment, he met cacao farmers. He discovered a group of cacao farmers whose beans had been organically certified by the United States Department of Agriculture (USDA) due to local NGO sponsorship (the NGO paid for it). The farmers saw it as free training. The organic certification took lots of paperwork to maintain. The farmers had hoped that the certification would allow them to sell their beans at a premium. However, after four years, this hadn’t yet happened. At the end of each harvest, they’d had to sell their beans at the conventional (non-organic) price.

This struck Patrick as an opportunity – a niche (organic) within a niche (Venezualan). In the US, there was a growing demand for organic products. The co-op grew about 16 metric tons of organic cacao beans each year. In 2009, with the financial help of his older brother and friends, he bought 10 metric tons ($40,000). A month earlier, he hadn’t known that chocolate comes from cacao.

He soon realized there was a problem: How to get it out of the country? If taken straight out, the government would fumigate it and it would lose its organic certification. It would have to be processed in Venezuela. There were several cacao processing plants in Venezuela but to them 10 metric tons was nothing. Patrick finally convinced one of them that organic might be the future. He taught the employees how to process the beans organically while learning it himself. After that it was relatively easy to get the processing plant certified organic.

During processing, 12% of the weight is “lost” in shells that are normally discarded. Patrick took the shells with him back to America hoping he could do something with them. In Venezuela, he had met an indigenous tribal community that drank tea made from cacao shells as remedy for asthma and to sooth coughs. He looked academic journals for other uses. He eventually found about 120 published papers. The shells had been used as toothpaste and to increase the Vitamin D content of milk by feeding them to cows. The only common uses, it turned out, were as fertilizer (due to the nitrogen content) and animal feed (due to the fiber and Vitamin D content). Neither use was high-price.

What about tea? Patrick sent samples to his partners. They were unenthusiastic. “This tastes like grass. Why would anybody drink tea from a by-product?” However, he was selling chocolate butter and nibs online. With each order, he included an 8-ounce pouch of cacao shells with instructions how to brew the tea. His customers – at least, some of them – were enthusiastic: How unique, how great, they emailed him. A German woman said she hadn’t drunk such tea since World War II ended. During World War II, cacao shells had been added to tea to extend it. His customers wanted to buy more.

He convinced his partners to go to a trade show. In 2010, they went to Expo West, a natural and healthy food product show in Anaheim. Out of all of their products, the tea got the most attention. It won Best in Show for tea. Out of about 500 new products, it was one of four that won Best New Product of Show. People from Twinings Tea and Stash Tea complimented them on their product.

After the trade show, Patrick decided the tea was a good concept and decided to make it a separate brand. Dark chocolate without the guilt. No sugar, no caffeine. He launched Tisano. The name comes from tisane (herbal tea in French) and artesano (artisanal in Spanish).

When I tasted Tisano’s chocolate tea, it tasted very familiar. That’s because Tisano’s cacao shells are the cacao shells in both American Tea Room’s CocoMate and Peet’s Red Cloud Cacao. There is no doubt that Patrick has created a new niche within the American (and maybe world) tea market: chocolate tea. I don’t know how well CocoMate is selling at American Tea Room but I decided to buy it after smelling maybe 40 teas. At Peet’s, Red Cloud Cacao sold surprisingly well and they will bring it back seasonally.

Teeccino Tasting Notes

I started drinking lots of tea when I started the Shangri-La Diet. The diet made me crave food with smell, which tea provided. I started chewing gum, too, but that was less enjoyable, maybe because I never became a gum connoisseur.

I recently learned about Teeccino coffee-substitute “tees” (brewed like tea) from Patrick Pineda of Tisano. They resemble Pero but with more flavor and variety. I really liked the first two flavors I tried (Vanilla Nut and French Roast) so I wrote to Teeccino asking for samples of all the flavors. In addition to no caffeine, Teechino drinks are high in inulin, a soluble fiber.

Here are my comments on the samples.

Dandelion Dark Roast. Similar to French Roast (relatively strong coffee taste) but more earthy-tasting. Maybe that’s the dandelion.

French Vanilla. Strong vanilla taste. Too much like vanilla for me, I want something more complicated.

Caramel Nut. Halfway between caramel and burnt caramel, which I like. As complex as French Roast.

Mocha. Excellent. Complexity of coffee plus complexity of chocolate.

Chocolate. Like mocha, except darker coffee flavor.

Original. Excellent. Weaker coffee flavor plus fruity complexity.

Almond Amaretto. Wonderful combination of coffee flavor with nutty almond/amaretto flavor.

Java. Rounded coffee flavor.

Chocolate Mint. Enough mint but not enough chocolate and coffee.

Southern Pecan. Delicious. Pecan and coffee flavors well-balanced. I wonder: What does Northern Pecan taste like?

Maya Chai. Tastes like chai. I would prefer, in addition, a dark coffee taste.

Tea and News: Rinse First

While living in China, I discovered that it was a good idea to rinse tea with hot water before brewing it. The rinse removes a certain rough taste — easy to notice in side-by-side comparisons. A Chinese college student made an interesting analogy:

Entertainment news is like drinking tea, first time is like washing tea leafs, no one really cares. Maybe 2nd or 3rd time it will have the sweet taste, but in the end it gets weaker and weaker.

Hot Miso with Cream and Sweetener: Coffee/Tea Substitute

A few weeks ago, I wondered if I drink too much tea. Is 4 cups/day too much? What about 2 cups/day? To learn more, I needed to drink a lot less tea.

What about miso? I wondered. I had some high-quality miso paste in my refrigerator. I got it in Tokyo at a miso store (thanks to Gary Rymar for taking me there). I made a cup (about 25 g miso paste — 2-3 teaspoons? — mixed with 1 cup hot water). It was delicious. The complex taste reminded me of coffee and chocolate. I added a little cream and a half packet of sweetener (Sucralose). It tasted even better.

I did the same thing with miso from Berkeley. It was still very good.

I cannot imagine not drinking tea. But I can now imagine drinking less tea because miso is much healthier. Replacing tea with miso is an easy way to eat more fermented food. A cup of miso is easier to make than a cup of tea.

Incidentally, don’t waste your time with powdered miso. It is much worse than the refrigerated miso (paste) sold in tubs.

The Willat Effect: More Consequences

A month ago I bought three identical tea pots to compare tea side by side. I hoped to take advantage of the Willat Effect (side-by-side comparisons create connoisseurs) to become a tea connoisseur.

It worked. Side-by-side tea comparisons are fun, easy, and have taught me a lot. When I drink tea I notice more and like it more. I do about three comparisons per day. I blogged about the first results here. The most useful idea about these comparisons came from Carl Willat himself: Compare the same tea brewed differently (e.g., different amounts of tea, different brewing times, different water temperatures). Most of my comparisons vary amount of tea or brewing time.

These many comparisons have had several effects:

1. Yeah, I’m a snob. No more cheap tea. Yeah, I’m more nerdy about it.

2. I bought a scale (Camry EHA901, $12 in America) with a precision of 0.01 gram. No more heaping teaspoons. Mostly I use 1.5 grams of tea with about 170 ml water. For dense tea, 1.5 grams is roughly 1 teaspoon. Standard-size teabags contain about 2 g of tea.

3. Much different brewing times than recommended. The black tea I have now is Ahmad Tea English Tea No. 1 (in spite of the name, not expensive). The tin says “infuse 4-6 minutes.” I used to brew it (and all black tea) 5 minutes, now I prefer less than 3 minutes. I found that 2.75 minutes is better than 3 minutes. Around 3 minutes it starts getting bitter — I never noticed! Another example is American Tea Room‘s Choco Late, which contains cacao husks, vanilla, and rooibos. The package says brew 5 minutes. I prefer 30 minutes — 30 minutes tastes better than 20 minutes, I have found several times.

4. To make the comparisons as sensitive as possible I want to start with equal tea pots, so I need to clean them well after each use. This became boring. I could eliminate cleaning by using tea bags. I bought ordinary-size empty tea bags. Side-by-side comparisons (same tea, bagged versus loose) showed they made the flavor much worse. Too bad I’d bought 200. I bought much larger tea bags to use as liners rather than bags. That worked fine — no cleaning needed, taste just as good. However, they are too large, so I shorten them. The concept of a disposable tea liner (instead of tea bag) seems to be new. I cannot find any for sale. My connoisseurship has not only caused me to spend much more on tea, it has made me want an interesting new product. Tea pot makers could sell liners specially designed for their pots. Continuing revenue, like razor blades.

5. I stopped adding artificial sweetener (e.g., Splenda) to black tea. Now I prefer it without sweetener. I continue to add cream to black tea. This is the most surprising and intriguing change. Maybe sweetness is a distraction from the complexity of the flavor (which I now notice more and derive more pleasure from), but creaminess is not. I imagine the same thing is behind Richard Stallman’s “If it is tea I really like, I like it without milk and sugar.” And maybe the same thing is behind all sorts of artistic expression that strike outsiders as harsh and unpleasant. A few years ago I went to a BAM (Brooklyn Academy of Music) concert and was stunned how unpleasant it was. Yet the composer (who performed it) surely enjoyed it.

Regular readers know I think connoisseurship evolved because it increased technological innovation. My experience so far supports this. Thanks to the Willat Effect, I am more of a connoisseur. As a result of this change, I am spending more on high-end artisanal goods (expensive tea) and precision manufacturing (precision scale) and I want a new product (disposable tea liners).

People think of connoisseurs as having higher standards. The word connoisseur seems to mean exactly that. Iin some obvious ways, they do. Yet the sweetener change (I no longer want sweetener) is in a way a lowering of standards. Sweetness is pleasant. I no longer require, or even want, my tea to be sweet. As far as I can tell, something like this is true throughout the arts. Connoisseurs make unusual demands, yes, but in some ways they are easier to please than non-connoisseurs. Indie films are less pleasant than mainstream films. Yet film connoisseurs like them more. To most people, indie films are also much cheaper and more experimental than mainstream films. By supporting them — by preferring them — film connoisseurs are supporting innovation. The connoisseurs have lowered their standards for film in the sense that they can enjoy cheaper films. A friend of mine attends the San Francisco International Film Festival each year. He enjoys it. I wouldn’t. The SF film festival films don’t cost much, yet they have a certain innovative quality. (I”m not a film connoisseur, I barely understand it.) The source of pleasure has shifted from conventional sources (plot, music, dialogue, gorgeous actors, sets, and landscapes) to something else, perhaps novelty and complexity.

 

 

 

Even More About The Willat Effect

I have had tea daily for the last ten years, ever since I discovered the Shangri-La Diet. A few weeks ago, I started doing side-by-side comparisons of similar teas or the same tea prepared two ways (e.g., different brewing times). Would the Willat Effect make me a tea connoisseur?

Since then I have done at least one side-by-side comparison every day. It’s almost as easy as making an ordinary cup of tea and a lot more fun. These comparisons have taught me more about tea preparation than the previous ten years. I’ve learned:

1. The black tea I have (an Earl-Grey variant) tastes better when brewed for 3.5 minutes than 4.0 minutes.

2. The black tea tastes better when I use 1.5 grams of tea than when I use 2.0 grams of tea. (After starting these comparisons, I bought a scale for weighing tea.)

3. One of the green teas I have tastes better when “rinsed” for 30 seconds before brewing 1 minute than when simply brewed for 1 minute. In China, this preference (rinse green tea before brewing) is common. I was reminded of it by this comment and Paul Jaminet’s post about tea. Black tea is different, as I noted earlier.

4. I have a caffeine-free tea blend called Choco Late made of cacao husks, vanilla, and rooibos. The package says brew 5 minutes. Which is nonsense. It tastes better (fuller, more rounded) when brewed 30 minutes than when brewed 15 minutes. (I’ve noticed the same thing with caffeine-free chai blends. Enormous brewing times, like 60 minutes, produce much better results than short times.)

5. My most interesting discovery is when I brew Choco Late for 30 minutes it tastes so good I no longer want to sweeten it. It is pleasant enough already and sweetness would distract from the complexity, fullness, and slight bitterness. (At first I wrote “lovely complexity, fullness …”) I was shocked when I noticed this. It has never happened before.

This tea-selling website mentions the Willat Effect under the heading “Do you want to be a tea connoisseur?” I hope this means the idea will spread among the fancy-food community. They have a lot to gain from better understanding of how to make people connoisseurs. Many times I have asked people in that community what makes someone a connoisseur? The usual answer is education. In my case, Willat-Effect comparisons (side-by-side comparisons of similar teas) were far more powerful than reading about tea, drinking a variety of teas, going on tea tours, going to ordinary tea tastings (where you taste a wide range of teas), and talking about tea with experts. I have been to five or six Fancy Food Shows and have visited thousands of booths. Exactly one booth offered side-by-side comparisons of similar products. It was their product made with and without a special ingredient.

Willat-Effect comparisons are mini-science. They aren’t quantitative but they include three other things central to science: 1. Close comparisons. This is the essence of experimentation. 2. You don’t know the answer. 3. You care about the answer.