In August, at a Quantified Self meeting in San Jose, I told how butter apparently improved my brain function. When I started eating a half-stick of butter every day, I suddenly got faster at arithmetic. During the question period, Greg Biggers of genomera.com proposed a study to see if what I’d found was true for other people.
Eri Gentry, also of genomera.com, organized an experiment to measure the effect of butter and coconut oil on arithmetic speed. Forty-five people signed up. The experiment lasted three weeks (October 23-November 12). On each day of the experiment, the participants took an online arithmetic test that resembled mine.
The participants were randomly assigned to one of three groups: Butter, Coconut Oil, or Neither. The three weeks were divided into three one-week phases. During Phase 1 (baseline), the participants ate normally. During Phase 2 (treatment), the Butter participants added 4 tablespoons of butter (half a stick of butter) each day to their usual diet. The Coconut-Oil participants added 4 tablespoons of coconut oil each day to their usual diet. The Neither participants continued to eat normally. During Phase 3 (baseline), all participants ate normally.
After the experiment was finished. Eri reduced the data set to participants who had done at least 10 days of testing. Then she made the data available. I wanted to compute difference scores (Phase 2 MINUS average of Phases 1 and 3) so I eliminated someone who had no Phase 3 data. I also eliminated four days where the treatment was wrong (e.g., in the sequence N N N N N B B N N B, where N = Neither and B = Butter, I eliminated the final Butter day). That left 27 participants and a total of 443 days of data.
Because the scores on individual problems were close to symmetric on a log scale, I worked with log solution times. I computed a mean for each day for each participant and then a mean for each phase for each participant.
This figure shows the means for each phase and group. The downward slopes show the effect of practice. The separation between the lines shows that individual differences are large. (There was no reliable difference between the three groups during Phase 1.)
The point of the baseline/treatment/baseline design is allow for a large practice effect and large individual differences. It allows a treatment effect to be computed for each participant by computing a difference score: Phase 2 MINUS average of Phases 1 and 3. The average of Phases 1 and 3 estimates what the results would be if the treatment made no difference.
This graph shows the difference scores. There are clear differences by group. A Wilcoxon test comparing the Butter and Neither groups gives one-tailed p = 0.006.
The results support my idea that butter improves brain function. They also suggest that coconut oil does not. In another post I’ll discuss what else I learned from this experiment.
The post Results of The Buttermind Experiment appeared first on Quantified Self.
