EUVIMEDEUVIMED entdecken
Randomisierte kontrollierte StudieOpen Access

Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials

Christine Holst iD, Steven Woloshin iD, Andrew D Oxman iD, Christopher Rose iD, Sarah Rosenbaum iD, Heather Menzies Munthe-Kaas iD

JMIR Public Health and Surveillance · 2025

DOI: 10.2196/62828 ↗

Kurz gefasst

Randomisierte kontrollierte Studie in der Zeitschrift JMIR Public Health and Surveillance, 2025. Verfasst von Christine Holst und 5 weiteren Autor:innen. Beteiligte Einrichtung: Centre for Epidemic Interventions Research, Norwegian Institute of Public Health, Oslo, Norway. Hauptthemen laut MEDLINE: Comprehension, Public Health. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Well-designed public health messages can help people make informed choices, while poorly designed messages or persuasive messages can confuse, lead to poorly informed decisions, and diminish trust in health authorities and research. Communicating uncertainties to the public about the results of health research is challenging, necessitating research on effective ways to disseminate this important aspect of randomized trials.

Objective

This study aimed to evaluate people’s understanding of overall and statistical uncertainty when presented with alternative ways of expressing randomized trial results.

Methods

Two parallel, web-based, individually randomized trials (3×2 factorial designs) were conducted in the United States and Norway. Participants were randomized to 1 of 6 versions of a text (summary) communicating results from a study examining the effects of wearing glasses to prevent COVID-19 infection. The summaries varied in how overall uncertainty (“Grading of Recommendations Assessment, Development and Evaluation [GRADE] language,” “plain language,” or “no explicit language”) and statistical uncertainty (whether a margin of error was shown or not) were presented. Participants completed a web-based questionnaire exploring 4 coprimary outcomes: 3 to measure understanding of overall uncertainty (benefits, harms, and sufficiency of evidence), and one to measure statistical uncertainty. Participants were adults who do not wear glasses recruited from web-based research panels in the United States and Norway. Results of the trials were analyzed separately and combined in a meta-analysis.

Results

In the US and Norwegian trials, 730 and 497 individuals were randomized, respectively; data for 543 (74.4%) and 452 (90.9%) were analyzed. More participants had a correct understanding of uncertainty when presented with plain language (United States: 37/99, 37% and Norway: 40/76, 53%) than no explicit language (United States: 18/86, 21% and Norway: 34/80, 42%). Similar positive effect was seen for the GRADE language in the United States (26/79, 33%) but not in Norway (30/71, 42%). There were only small differences between groups for understanding the uncertainty of harms. Plain language improved correct understanding of evidence sufficiency (odds ratio 2.05, 95% CI 1.17-3.57), compared to no explicit language. The effect of GRADE language was inconclusive (odds ratio 1.34, 95% CI 0.79-2.28). The understanding of statistical uncertainty was improved when the participants were shown the margin of error compared to not being shown: Norway: 16/75, 21% to 24/71, 34% vs 1/71, 1% to 2/76, 3% and the United States: 21/101, 21% to 32/90, 36% vs 0/86, 0% to 3/79, 4%).

Conclusions

Plain language, but not GRADE language, was better than no explicit language in helping people understand overall uncertainty of benefits and harms. Reporting margin of error improved understanding of statistical uncertainty around the effect of wearing glasses, but only for a minority of participants. Trial Registration ClinicalTrials.gov NCT05642754; https://tinyurl.com/4mhjsm7s

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ComprehensionPublic HealthHumansUncertaintyAdultFemaleMaleUnited StatesNorwayMiddle AgedRandomized Controlled Trials as TopicCOVID-19Surveys and QuestionnairesInternetYoung Adult

Stichwörter der Autor:innen

GRADE languageGrading of Recommendations Assessment, Development, and Evaluation languagecommunicationoverall uncertaintyrandomized trialstatistical uncertainty

Autor:innen und Institutionen

  • Centre for Epidemic Interventions Research, Norwegian Institute of Public Health, Oslo, Norway.
  • Lisa Schwartz Foundation for Truth in Medicine, Norwich, VT, United States.
  • Dartmouth Institute for Health Policy and Clinical Practice, Geisel Medical School, West Lebanon, NH, United States.
  • Cluster for Reviews and Health Technology Assessments, Division for Health Services, Norwegian Institute of Public Health, Oslo, Norway.

ORCID-Profile: Christine Holst, Steven Woloshin, Andrew D Oxman, Christopher Rose, Sarah Rosenbaum, Heather Menzies Munthe-Kaas

Zitieren

APA

Holst, C., Woloshin, S., Oxman, A. D., Rose, C., Rosenbaum, S., & Munthe-Kaas, H. M. (2025). Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials. JMIR Public Health and Surveillance. https://doi.org/10.2196/62828

Vancouver

Holst C, Woloshin S, Oxman AD, Rose C, Rosenbaum S, Munthe-Kaas HM. Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials. JMIR Public Health and Surveillance. 2025. doi:10.2196/62828

BibTeX
@article{Holst2025,
  author = {Holst, Christine and Woloshin, Steven and Oxman, Andrew D and Rose, Christopher and Rosenbaum, Sarah and Munthe-Kaas, Heather Menzies},
  title = {Alternative Presentations of Overall and Statistical Uncertainty for Adults’ Understanding of the Results of a Randomized Trial of a Public Health Intervention: Parallel Web-Based Randomized Trials},
  journal = {JMIR Public Health and Surveillance},
  year = {2025},
  doi = {10.2196/62828}
}
Kostenlos starten →