EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY-NC 4.0

Readability Assessment and Comparison of Large Language Model-Generated Summaries of Trial Descriptions on ClinicalTrials.gov

Tzu-Chun Wu, Hanniel Shih, Anunita Nattam, Himaja Chintalapalli, David A Hanauer, Kai Zheng, Danny T Y Wu

Studies in Health Technology and Informatics · 2025

DOI: 10.3233/shti250982 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Studies in Health Technology and Informatics, 2025. Verfasst von Tzu-Chun Wu und 6 weiteren Autor:innen. Beteiligte Einrichtung: University of Cincinnati, Cincinnati, OH, United States. Hauptthemen laut MEDLINE: Comprehension, Clinical Trials as Topic, Health Literacy, Natural Language Processing. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluated the readability of ClinicalTrials.gov trial information using traditional readability measures (TRMs) and compared it to summaries generated by large language models (LLMs), specifically ChatGPT and a fine-tuned BART-Large-CNN (FBLC). The study involved: 1) assessing required reading levels (RRL) with TRMs, 2) generating sample LLM-based summaries, and 3) evaluating summary quality based on scores provided by two independent reviewers. The results show that the original ClinicalTrials.gov trial descriptions were scored above the recommended readability level. In contrast, ChatGPT-generated summaries had significantly lower RRLs and higher quality scores. We conclude that ChatGPT shows great promise of creating readable, high-quality summaries. Future research is warranted to assess whether LLMs could be a viable solution to improve the readability of ClinicalTrials.gov to facilitate comprehension by laypersons.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ComprehensionClinical Trials as TopicHealth LiteracyNatural Language ProcessingLanguageHumansLarge Language Models

Stichwörter der Autor:innen

Readability assessmentclinical trialslarge language models

Autor:innen und Institutionen

  • University of Cincinnati, Cincinnati, OH, United States.
  • University of Michigan, Ann Arbor, MI, United States.
  • University of California, Irvine, CA, United States.
  • University of North Carolina, Chapel Hill, NC, United States.

Zitieren

APA

Wu, T. C., Shih, H., Nattam, A., Chintalapalli, H., Hanauer, D. A., Zheng, K., & Wu, D. T. Y. (2025). Readability Assessment and Comparison of Large Language Model-Generated Summaries of Trial Descriptions on ClinicalTrials.gov. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti250982

Vancouver

Wu TC, Shih H, Nattam A, Chintalapalli H, Hanauer DA, Zheng K, et al. Readability Assessment and Comparison of Large Language Model-Generated Summaries of Trial Descriptions on ClinicalTrials.gov. Studies in Health Technology and Informatics. 2025. doi:10.3233/shti250982

BibTeX
@article{Wu2025,
  author = {Wu, Tzu-Chun and Shih, Hanniel and Nattam, Anunita and Chintalapalli, Himaja and Hanauer, David A and Zheng, Kai and Wu, Danny T Y},
  title = {Readability Assessment and Comparison of Large Language Model-Generated Summaries of Trial Descriptions on ClinicalTrials.gov},
  journal = {Studies in Health Technology and Informatics},
  year = {2025},
  doi = {10.3233/shti250982}
}
Kostenlos starten →