The truth wears off
By JONAH LEHRER - THE NEW YORKER
Added: Thu, 06 Jan 2011 23:38:10 UTC
With thanks to drrenberg for the link
On September 18, 2007, a few dozen neuroscientists, psychiatrists, and drug-company executives gathered in a hotel conference room in Brussels to hear some startling news. It had to do with a class of drugs known as atypical or second-generation antipsychotics, which came on the market in the early nineties. The drugs, sold under brand names such as Abilify, Seroquel, and Zyprexa, had been tested on schizophrenics in several large clinical trials, all of which had demonstrated a dramatic decrease in the subjects’ psychiatric symptoms. As a result, second-generation antipsychotics had become one of the fastest-growing and most profitable pharmaceutical classes. By 2001, Eli Lilly’s Zyprexa was generating more revenue than Prozac. It remains the company’s top-selling drug.
But the data presented at the Brussels meeting made it clear that something strange was happening: the therapeutic power of the drugs appeared to be steadily waning. A recent study showed an effect that was less than half of that documented in the first trials, in the early nineteen-nineties. Many researchers began to argue that the expensive pharmaceuticals weren’t any better than first-generation antipsychotics, which have been in use since the fifties. “In fact, sometimes they now look even worse,” John Davis, a professor of psychiatry at the University of Illinois at Chicago, told me. Before the effectiveness of a drug can be confirmed, it must be tested and tested again. Different scientists in different labs need to repeat the protocols and publish their results. The test of replicability, as it’s known, is the foundation of modern research. Replicability is how the community enforces itself. It’s a safeguard for the creep of subjectivity. Most of the time, scientists know what results they want, and that can influence the results they get. The premise of replicability is that the scientific community can correct for these flaws.
But now all sorts of well-established, multiply confirmed findings have started to look increasingly uncertain. It’s as if our facts were losing their truth: claims that have been enshrined in textbooks are suddenly unprovable. This phenomenon doesn’t yet have an official name, but it’s occurring across a wide range of fields, from psychology to ecology. In the field of medicine, the phenomenon seems extremely widespread, affecting not only antipsychotics but also therapies ranging from cardiac stents to Vitamin E and antidepressants: Davis has a forthcoming analysis demonstrating that the efficacy of antidepressants has gone down as much as threefold in recent decades.
For many scientists, the effect is especially troubling because of what it exposes about the scientific process. If replication is what separates the rigor of science from the squishiness of pseudoscience, where do we put all these rigorously validated findings that can no longer be proved? Which results should we believe? Francis Bacon, the early-modern philosopher and pioneer of the scientific method, once declared that experiments were essential, because they allowed us to “put nature to the question.” But it appears that nature often gives us different answers.
Dave Mosher - National Geographic Comments
The sun is the roundest natural object ever precisely measured, astronomers say.
Geraint Jones - The Guardian Comments
Scientists who encoded the book say it could soon be cheaper to store information in DNA than in conventional digital devices
Ed Yong - Nature News Comments
Under the supervision of guards and graduate students, a small group of prisoners is breeding the beautiful orange-and-white insects in a greenhouse outside the prison. They have even carried out research to show what plants the butterfly prefers to lay its eggs on.
- - Scientific American Comments
Teachers, scientists and policymakers have drafted ambitious new education standards. All 50 states should adopt them
John Roach - NBC News Comments
An artificial “brain” built by a 17-year-old whiz kid from Florida is able to accurately assess tissue samples for signs of breast cancer, providing more confidence to a minimally invasive procedure.
MORE BY JONAH LEHRER
Jonah Lehrer - The New Yorker 106 Comments
While philosophers, economists, and social scientists had assumed for centuries that human beings are rational agents—reason was our Promethean gift—Kahneman, the late Amos Tversky, and others demonstrated that we’re not nearly as rational as we like to believe.
Jonah Lehrer - The New Yorker 106 Comments
Science is about learning new theories, but also learning to disregard our instincts.