Paediatric rare diseases: Can large language models assist off‐label prescribing?
British Journal of Clinical Pharmacology · 2025
DOI: 10.1002/bcp.70168 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Clinical Pharmacology, 2025. Verfasst von Anna Flamigni und 3 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Maternal and Child Health (IRCCS Burlo Garofolo), Trieste, Italy. Hauptthemen laut MEDLINE: Off-Label Use, Rare Diseases, Natural Language Processing. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Italian Ministry of Health.
Abstract (Originalsprache)
Aims
To evaluate the effectiveness and reliability of large language models (LLMs) in retrieving and synthesizing biomedical information to support off‐label drug prescribing in paediatric rare diseases, and to compare their performance with human‐authored references in terms of scientific rationale, adverse events and drug interactions.
Methods
The study reviewed 20 cases of off‐label prescriptions in rare paediatric diseases using 4 LLMs (i.e., GPT‐4o, Sophos‐2, Claude‐3, Scopus AI). The queries addressed focused on scientific rationale, adverse events and drug interactions. The performance measures encompassed sensitivity, precision, accuracy, F1‐score, response quality and reference quality. A Global Performance Score integrated all measures.
Results
After evaluating 2758 references and 480 responses, a significant discrepancy was found among 4 LLMs concerning Global Performance Score ( P = .001). Posthoc analysis showed that Scopus AI vs . GPT‐4o comparison was significant, with GPT‐4o showing higher values. Median LLM reference quality often surpassed human performance, yet variability limits conclusions regarding superiority.
Conclusions
LLMs are capable of retrieving and synthesizing biomedical information, but performance varies depending on query type and search mode. These tools speed up retrieving relevant information to assess off‐label prescribing appropriateness. Despite the promise of artificial intelligence, human oversight remains critical to ensure data accuracy and reliability.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute for Maternal and Child Health (IRCCS Burlo Garofolo), Trieste, Italy.
- University of Trieste, Trieste, Italy.
ORCID-Profile: Anna Flamigni, Giulia Zamagni, Gilda Paternuosto, Anna Arbo
Förderung
- Italian Ministry of Health
Zitieren
APA
Flamigni, A., Zamagni, G., Paternuosto, G., & Arbo, A. (2025). Paediatric rare diseases: Can large language models assist off‐label prescribing?. British Journal of Clinical Pharmacology. https://doi.org/10.1002/bcp.70168
Vancouver
Flamigni A, Zamagni G, Paternuosto G, Arbo A. Paediatric rare diseases: Can large language models assist off‐label prescribing?. British Journal of Clinical Pharmacology. 2025. doi:10.1002/bcp.70168
BibTeX
@article{Flamigni2025,
author = {Flamigni, Anna and Zamagni, Giulia and Paternuosto, Gilda and Arbo, Anna},
title = {Paediatric rare diseases: Can large language models assist off‐label prescribing?},
journal = {British Journal of Clinical Pharmacology},
year = {2025},
doi = {10.1002/bcp.70168}
}
EUVIMED