Friday, August 12, 2011
Scientific Errors and Fraud
I teach a course called "Scientific Controversies and Misconceptions." (You won't be surprised to learn that one of the main topics is evolution vs. creationism.) The most difficult part of the course is teaching students to be skeptical about the scientific literature. The reason why this is difficult is because the main focus is evidence based reasoning and science is an important way to gather reliable evidence. It's uncomfortable to have to mention that errors and fraud are not uncommon in the scientific literature.
I haven't figured out a way to teach students to read the scientific literature with the same skeptical perspective as those of us who have been doing it for decades. It seems as though this is a skill that must be learned through experience and can't be taught.
Almost every issue of Science has a retraction or a caution about a recently published paper. It's easy to get the impression that retractions are on the rise. Is this true? Yes, it is. Here's the data from PubMed Retractions. It shows a 15-fold increase in the number of retractions per publication.
This is quite alarming. Does it mean an increase in the number of papers containing significant errors? Does it mean an increase in scientific fraud and misconduct? Or, does it mean that the scientific community is becoming more active in removing suspect papers from the literature?
Here are articles from two bloggers who discuss these issues:
Orac at Respectful Insolence: Scientific fraud and journal article retractions.
Ed Silverman at Pharmalot: Retractions Of Scientific Studies Are Surging.
In both cases the focus is on the medical literature but the problem is not confined to medical journals. Personally, I think this is just the tip of the iceberg. For every article that's retracted there are a hundred articles that contains serious errors and misconceptions.