When authoritative sources hold onto bad data
In 2004, Hwang Woo-suk was celebrated for his breakthrough discovery creating , and his work was published in the prestigious journal Science. But the discovery ; Dr. Hwang had fabricated the data. Science publicly retracted the article and assembled a team to .
Retractions are frequently in the news. The high-profile discovery of a room-temperature superconductor on Nov. 7, 2023. A series of retractions of Stanford University on July 19, 2023. Major early studies on COVID-19 were found to have and retracted on June 4, 2020.
Retractions are generally framed as a negative: as science not working properly, as an embarrassment for the institutions involved, or as a flaw in the peer review process. They can be all those things. But they can also be part of a story of science working the right way: finding and correcting errors, and publicly acknowledging when information turns out to be incorrect.
A far more pernicious problem occurs when information is not, and cannot, be retracted. There are many apparently authoritative sources that contain flawed information. Sometimes the flawed information is deliberate, but sometimes it isn’t – after all, to err is human. Often, there is no correction or retraction mechanism, meaning that information known to be wrong remains on the books without any indication of its flaws.
As a , I’ve found that this is a particularly harmful problem with government information, which is often considered a and often lacking any means to retract the information.
Patent fictions and fraud
Consider patents, documents that contain many technical details that can be . There is . And patents contain : Although patents are reviewed by an expert examiner before being granted, whether the scientific data in the patent is correct.
In fact, the U.S. Patent and Trademark Office permits patentees to include in patents. This practice, called , is common; about . The patent office requires that prophetic examples be written in the present or future tense while real experiments can be written in the past tense. But this is confusing to nonspecialists, including scientists, who tend to assume that a phrase like “X and Y are mixed at 300 degrees to achieve a 95% yield rate” indicates a real experiment.
Almost a decade after Science retracted the journal article claiming cloned human cells, on his retracted discovery. Unlike the journal article, this patent has not been retracted. The patent office did not investigate the accuracy of the data – indeed, it granted the patent long after the data’s inaccuracy had been publicly acknowledged – and there is no indication on the face of the patent that it contains information that has been retracted elsewhere.
This is no anomaly. In a similar example, Elizabeth Holmes, the former – now imprisoned – CEO of Theranos, on her thoroughly discredited claims for a small device that could rapidly run many tests on a small blood sample. Some of those patents were granted long after Theranos’ fraud headlined major newspapers.
Long-lived bad information
This sort of under-the-radar wrong data can be deeply misleading to readers. The system of retractions in scientific journals is not without its critics, but it compares favorably to the alternative of no retractions. Without retractions, readers don’t know when they are looking at incorrect information.
My colleague and I conducted a study of patent-paper pairs. We looked at cases where the same information was published in a journal article and in a patent by the same scientists, and the journal paper had subsequently been retracted. We found that while citations to papers dropped steeply after the paper was retracted, there was with the very same incorrect information.
This probably happened because scientific journals paint a big red “retracted” notice on retracted articles online, informing the reader that the information is wrong. By contrast, patents have no retraction mechanism, so incorrect information continues to spread.
There are many other instances where . The Environmental Protection Agency publishes emissions data supplied by companies but not reviewed by the agency. Similarly, the Food and Drug Administration disseminates official-looking information about drugs that is generated by drug manufacturers and posted without an evaluation by the FDA.
Consequences of nonretractions
There are also economic consequences when incorrect information can’t be easily corrected. The Food and Drug Administration publishes that cover brand-name drugs. The FDA won’t approve a generic drug unless the generic manufacturer has shown that each patent that covers the drug in question is expired, not infringed or invalid.
The problem is that the list of patents is , who have an incentive to list patents that . Doing so increases the burden on generic drug manufacturers. The list is not checked by the FDA or anyone else, and there are few mechanisms for anyone other than the brand-name manufacturer to tell the FDA to remove a patent from the list.
Even when retractions are possible, they are effective only when readers pay attention to them. Financial data is sometimes retracted and corrected, but the revisions are not timely. “,” Paul Donovan, chief economist of UBS Global Wealth Management, told the Wall Street Journal, referring to governments revising gross domestic product figures.
Misinformation is a growing problem. There are no easy answers to solve it. But there are steps that would almost certainly help. One relatively straightforward one is for trusted data sources like those from the government to follow the lead of scientific journals and create a mechanism to retract erroneous information.
This article is republished from under a Creative Commons license. Read the .
Enjoy reading ASBMB Today?
Become a member to receive the print edition four times a year and the digital edition weekly.
Learn moreGet the latest from ASBMB Today
Enter your email address, and we’ll send you a weekly email with recent articles, interviews and more.
Latest in Policy
Policy highlights or most popular articles
Applied research won’t flourish without basic science
Three senior figures at the US National Institutes of Health explain why the agency remains committed to supporting basic science and research.
ASBMB weighs in on NIH reform proposal
The agency must continue to prioritize investigator-initiated, curiosity-driven basic research, society says.
ASBMB seeks feedback on NIH postdoc training questions
The National Institutes of Health takes steps toward addressing concerns about support caps, a funding mechanism and professional development.
5 growing threats to academic freedom
From educational gag orders to the decline of tenure-track positions, academic freedom in the United States has been worsening in recent years.
Will Congress revive the China Initiative?
The 2018 program to counter economic espionage raised fears about anti-Asian discrimination and discouraged researchers.
The sweeping impact of the Supreme Court’s Chevron reversal
Repealing the 40-year-old doctrine throws laws on climate, conservation, health, technology and more into doubt.