EUVIMEDOpdag EUVIMED
Randomisierte kontrollierte StudieOpen access

Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials

Christine Holst iD, Steven Woloshin iD, Andrew D Oxman iD, Christopher Rose iD, Sarah Rosenbaum iD, Heather Menzies Munthe-Kaas iD

JMIR Public Health and Surveillance · 2025

DOI: 10.2196/62828 ↗

At a glance

Randomisierte kontrollierte Studie in JMIR Public Health and Surveillance, 2025. Written by Christine Holst and 5 co-authors. Institution: Centre for Epidemic Interventions Research, Norwegian Institute of Public Health, Oslo, Norway. Major MEDLINE topics: Comprehension, Public Health. Cited 1 times so far (Crossref); 33 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Well-designed public health messages can help people make informed choices, while poorly designed messages or persuasive messages can confuse, lead to poorly informed decisions, and diminish trust in health authorities and research. Communicating uncertainties to the public about the results of health research is challenging, necessitating research on effective ways to disseminate this important aspect of randomized trials.

Objective

This study aimed to evaluate people’s understanding of overall and statistical uncertainty when presented with alternative ways of expressing randomized trial results.

Methods

Two parallel, web-based, individually randomized trials (3×2 factorial designs) were conducted in the United States and Norway. Participants were randomized to 1 of 6 versions of a text (summary) communicating results from a study examining the effects of wearing glasses to prevent COVID-19 infection. The summaries varied in how overall uncertainty (“Grading of Recommendations Assessment, Development and Evaluation [GRADE] language,” “plain language,” or “no explicit language”) and statistical uncertainty (whether a margin of error was shown or not) were presented. Participants completed a web-based questionnaire exploring 4 coprimary outcomes: 3 to measure understanding of overall uncertainty (benefits, harms, and sufficiency of evidence), and one to measure statistical uncertainty. Participants were adults who do not wear glasses recruited from web-based research panels in the United States and Norway. Results of the trials were analyzed separately and combined in a meta-analysis.

Results

In the US and Norwegian trials, 730 and 497 individuals were randomized, respectively; data for 543 (74.4%) and 452 (90.9%) were analyzed. More participants had a correct understanding of uncertainty when presented with plain language (United States: 37/99, 37% and Norway: 40/76, 53%) than no explicit language (United States: 18/86, 21% and Norway: 34/80, 42%). Similar positive effect was seen for the GRADE language in the United States (26/79, 33%) but not in Norway (30/71, 42%). There were only small differences between groups for understanding the uncertainty of harms. Plain language improved correct understanding of evidence sufficiency (odds ratio 2.05, 95% CI 1.17-3.57), compared to no explicit language. The effect of GRADE language was inconclusive (odds ratio 1.34, 95% CI 0.79-2.28). The understanding of statistical uncertainty was improved when the participants were shown the margin of error compared to not being shown: Norway: 16/75, 21% to 24/71, 34% vs 1/71, 1% to 2/76, 3% and the United States: 21/101, 21% to 32/90, 36% vs 0/86, 0% to 3/79, 4%).

Conclusions

Plain language, but not GRADE language, was better than no explicit language in helping people understand overall uncertainty of benefits and harms. Reporting margin of error improved understanding of statistical uncertainty around the effect of wearing glasses, but only for a minority of participants. Trial Registration ClinicalTrials.gov NCT05642754; https://tinyurl.com/4mhjsm7s

Subjects

MeSH terms (MEDLINE)

ComprehensionPublic HealthHumansUncertaintyAdultFemaleMaleUnited StatesNorwayMiddle AgedRandomized Controlled Trials as TopicCOVID-19Surveys and QuestionnairesInternetYoung Adult

Author keywords

GRADE languageGrading of Recommendations Assessment, Development, and Evaluation languagecommunicationoverall uncertaintyrandomized trialstatistical uncertainty

Authors and institutions

  • Centre for Epidemic Interventions Research, Norwegian Institute of Public Health, Oslo, Norway.
  • Lisa Schwartz Foundation for Truth in Medicine, Norwich, VT, United States.
  • Dartmouth Institute for Health Policy and Clinical Practice, Geisel Medical School, West Lebanon, NH, United States.
  • Cluster for Reviews and Health Technology Assessments, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway.

ORCID profiles: Christine Holst, Steven Woloshin, Andrew D Oxman, Christopher Rose, Sarah Rosenbaum, Heather Menzies Munthe-Kaas

Cite

APA

Holst, C., Woloshin, S., Oxman, A. D., Rose, C., Rosenbaum, S., & Munthe-Kaas, H. M. (2025). Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials. JMIR Public Health and Surveillance. https://doi.org/10.2196/62828

Vancouver

Holst C, Woloshin S, Oxman AD, Rose C, Rosenbaum S, Munthe-Kaas HM. Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials. JMIR Public Health and Surveillance. 2025. doi:10.2196/62828

BibTeX
@article{Holst2025,
  author = {Holst, Christine and Woloshin, Steven and Oxman, Andrew D and Rose, Christopher and Rosenbaum, Sarah and Munthe-Kaas, Heather Menzies},
  title = {Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials},
  journal = {JMIR Public Health and Surveillance},
  year = {2025},
  doi = {10.2196/62828}
}
Start for free →