Call 413.540.1234 to
schedule an appointment
CONCERN/EAP: 413.534.2625
Billing questions? Call: 413.540.1212
CRISIS: 413.733.6661

Health Policy & Advocacy
Basic InformationMore InformationLatest News
Gun Injuries Add Millions of Dollars to Hospital CostsACP Does Not Support Legalization of Assisted SuicideAAP: Few Doctors Provide Firearm Injury Prevention Info in ER9 of 10 Docs Unprepared to Prescribe MarijuanaThis Mistake Can Cost Athletes' Lives in Cardiac ArrestDrills Assess ER Response to Communicable DiseaseDo Nursing Home Workers Change Gloves Often Enough?Minorities Exposed to Dirtier Air, U.S. Study FindsPhysicians Tweeting About Drugs May Have Conflict of Interest'Science Spin' Found Prevalent in Biomedical LiteratureHealth Tip: Overcoming the Obesity EpidemicU.S. Military Surgeons Helped More Than 6,000 Afghan AdultsWhat You Can Do to Help Fight the Opioid EpidemicAre Physicians Obligated to Help on Planes?Median Cost of Cancer Drug Development $648.0 MillionDoes Study Claim a Cure? Beware of Scientific 'Spin'Vaccine Campaign in Poor Countries to Save 20 Million LivesThird Dose of MMR Vaccine Could Help Curb Mumps OutbreaksDocs Should Be Aware of Family Beliefs Regarding NondisclosureIncrease in Medical Exemptions From Immunization in CaliforniaMailed Invitations Increase CRC Screening CompletionMany Americans Getting Medical Care They Don't NeedInsurer Aetna's Envelopes Revealed Customers' HIV StatusHealth Groups Demand 'R' Rating for Movies That Show SmokingGoogle Search for 'Depression' Now to Provide Screening TestPatients' Hearing Loss May Mean Poorer Medical CareFDA May Limit 'Risk Info' in Direct-to-Consumer TV Drug AdsFDA Announces Recall of Some Liquid Pharmaceutical ProductsIs FDA Taking Close Enough Look at Fast-Tracked Drugs?Steep Price Hikes Led to Drop in Use of 2 Heart Drugs at U.S. HospitalsAPA: Medical Discrimination Based on Size Stresses Patients2 of 3 U.S. Patients Keep Unused Painkillers After SurgeryMedical Reality Catches Up to Science FictionFDA Looks to Reduce Nicotine in CigarettesAHA Hands-Only CPR Training Kiosks Available at More Airports$100 Sweetens the Pot for a ColonoscopyJust a Few Vaccine Refusers Could Endanger ManyASCO Addresses Cancer Drug PricingHigh Court Rules Against Interstate Medical LiabilityFewer U.S. Dollars Spent on Cardiac Arrest Research: StudyPainkiller Prescriptions More Prone to Errors If HandwrittenFDA Panel OKs What May Soon Be First Gene Therapy Approved in U.S.Walking Rates Are Key to a Country's Obesity LevelsDocs Should Counsel Even Healthy People on Diet, Exercise, Experts SayHealth Service Use Unchanged From 1996-1997 to 2011-2012Easier Colon Exam Boosts Screening, But Insurers May Not PayMore U.S. Patients Are Recording Their Doctor VisitsMedication Mistakes Have Doubled in U.S. Since 2000: StudyPatient Involvement Can Cut Errors in X-Ray ImagingMarket Competition Linked to Change in Generic Drug Prices
Questions and AnswersLinksBook Reviews
Related Topics

Does Study Claim a Cure? Beware of Scientific 'Spin'

HealthDay News
by By Dennis Thompson
HealthDay Reporter
Updated: Sep 11th 2017

new article illustration

MONDAY, Sept. 11, 2017 (HealthDay News) -- Take with a grain of salt any flashy reports from clinical trials boasting groundbreaking results, a new scientific review warns.

A majority of clinical trials published in medical journals hype their findings, presenting them in a way that makes them look more favorable than they actually are, said senior researcher Lisa Bero.

An evidence review conducted by Bero and her colleagues found more than half of clinical trials "spin" their results either in the abstracts (summaries) or the main text of the published report.

"'Breakthrough' studies are quite rare, so any study making bold claims about [effectiveness] or causality should be viewed skeptically," said Bero, who's chair of medicines use and health outcomes with the University of Sydney in Australia.

"Science is an accumulation of knowledge, so new studies need to be put in the context of others," she added.

Spin or science hype involves different strategies, Bero said. These can include:

  • Claiming that statistically non-significant results actually mean something.
  • Making recommendations for clinical practice that aren't supported by study results.
  • Attributing cause-and-effect relationships that aren't supported by the findings.
  • Selectively reporting only the results that support the desired conclusion.
  • Presenting data in an overly favorable or optimistic light.

A hyped report might "conclude that a new treatment is beneficial when none of the results are statistically significant, or to suggest that a treatment or diagnostic test should be widely used based on the findings of a single, small study," Bero said.

To see how deeply such hype has infiltrated medical literature, Bero and her team reviewed 35 academic studies that individually attempted to assess spin in different fields of research.

Overall, the studies found that around 56 percent of clinical trials tended to hype their results. The presence of spin ranged from about 34 percent of reports from randomized clinical trials -- considered the gold standard of research -- up to 84 percent of papers written about non-randomized trials.

The researchers also found hype in 86 percent of papers on observational studies. These studies do not involve actual experiments, but instead try to discover new information by observing people's everyday lives.

Spin also was present in 26 percent of evidence reviews that attempt to sum up current medical knowledge by analyzing all the existing research, the findings showed.

Annette Flanagin is executive managing editor and vice president of operations for the Journal of the American Medical Association and the JAMA Network of publications. She said that this new analysis "provides more important information on the prevalence of biomedical studies with spin and describes the types of spin that are misleading and potentially deceptive."

Flanagin agreed with the authors of the new report that "editors and peer reviewers should be aware of the prevalence of spin and find ways to identify and remove it from papers before publication."

The spin produced by researchers seems motivated mainly by the desire to get a paper published by a medical journal, Bero said.

"Studies with favorable findings are more likely to get submitted for publication, get attention from other researchers, clinicians, and even the press," Bero said.

Her team found no link between hype in studies and whether they were funded by drug or medical device companies.

Readers can protect themselves against hyperbole by comparing any study's actual results against what the authors claim those results show, Bero noted.

"When reading a scientific paper, focus on the first paragraph of the discussion, which should simply summarize the results," Bero said. "The rest of the discussion may make bolder statements. Beware of adjectives!"

The new analysis was published in the Sept. 11 issue of PLOS Biology.

More information

For tips on reading scientific research papers, visit the American Association for the Advancement of Science.