An impressive new book about the shortcomings of scientific research is inadvertently ironic.
Psychologist Stuart Ritchie is the author of a new book,
Nevertheless, it’s difficult not to feel sympathy for this young academic. His book was no doubt completed late last year. He had no way of anticipating that a deadly new coronavirus was about to spread across the globe, and that John Ioannidis, one of the people he cites extensively in his book, would respond to the pandemic in unexpected ways.
Two weeks before Science Fictions was released in mid-July, Ritchie published an essay titled There should never be heroes in science. It begins by telling us about the late Hans Eysenck, once the most-cited psychologist in Britain. Throughout the latter half of the 20th century, this eminent personality (who died in 1997), devoted much of his energy to keeping his own profession honest. As Ritchie tells it, Eysenck authored “blistering critiques of psychoanalysis and psychotherapy, noting the unscientific nature of Freudian theories and digging into the evidence base for therapy’s effects on mental health.”
Last year, more than a dozen of Eysenck’s papers were retracted. Dozens more are now officially considered questionable. An investigation by Kings College London concurred with critics who’ve long been concerned about the quality of Eysenck’s data and “the implausibility of the results presented.” In other words, this “strong advocate of rigour in science” was better at identifying the flaws in other people’s reasoning, than in producing bulletproof research of his own.
Ritchie then turns his attention to Ioannidis:
It’s fair to say that Stanford University’s John Ioannidis is a hero of mine. He’s the medical researcher who made waves in 2005 with a paper carrying the firecracker title “Why Most Published Research Findings are False”, and who has published an eye-watering number of papers outlining problems in clinical trials, economics, psychology, statistics, nutrition research and more.
…Ioannidis’s contribution to science has been to make it far more open, honest, and self-reflective about its flaws. How odd it is, then, to see his failure to follow his own advice.
Ritchie points to a March 2020 article in which Ioannidis legitimately observed that politicians were making decisions about how to respond to the coronavirus “without reliable data.” Five months on, that’s still true. Many of the numbers currently available to us are compromised in one way or another.
But whether Ioannidis’ own hunches are correct is a different matter altogether. Writes Ritchie:
The most memorable part of the article was his prediction – on the basis of his analysis of the cursed cruise ship Diamond Princess – that around 10,000 people in the US would die from COVID-19…As US deaths have just hit 125,000, I don’t need to emphasise how wrong that prediction was.
Yesterday, American deaths from COVID-19 exceeded 187,000. Even if that count is wrong by 20% in either direction, we’re definitely talking a different ballpark.
Above, I should really have said that John Ioannidis was a hero of mine. Because this whole episode has reminded me that those self-critical, self-correcting principles of science simply don’t allow for hero-worship. Even the strongest critics of science need themselves to be criticised; those who raise the biggest questions about the way we do research need themselves to be questioned. Healthy science needs a whole community of sceptics, all constantly arguing with one another…Who watches the watchmen in science? The answer is, or at least should be: all of us. [bold added; italics in the original]
I invite you to re-read that sentence in bold font. So says a man whose book dismisses climate skeptics in peremptory fashion. In fact, Ritchie ends his final chapter by referencing a famous cartoon that implies climate policies will automatically create a “better world” even if the climate crisis turns out to be overblown.
This is unfortunate. Ritchie’s argument is that improving the way research is conducted makes sense even if we reject his contention that “something has gone very wrong with science.” But that famous climate cartoon naively presupposes that good intentions are enough, that climate programs have no negative consequences, that government policies are never counterproductive, ill-conceived, or designed to financially benefit political donors.
I critiqued that climate cartoon last year.
via Big Picture News, Informed Analysis
August 31, 2020 at 06:14AM