EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Paediatric rare diseases: Can large language models assist off‐label prescribing?

Anna Flamigni iD, Giulia Zamagni iD, Gilda Paternuosto iD, Anna Arbo iD

British Journal of Clinical Pharmacology · 2025

DOI: 10.1002/bcp.70168 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Clinical Pharmacology, 2025. Verfasst von Anna Flamigni und 3 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Maternal and Child Health (IRCCS Burlo Garofolo), Trieste, Italy. Hauptthemen laut MEDLINE: Off-Label Use, Rare Diseases, Natural Language Processing. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Italian Ministry of Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aims

To evaluate the effectiveness and reliability of large language models (LLMs) in retrieving and synthesizing biomedical information to support off‐label drug prescribing in paediatric rare diseases, and to compare their performance with human‐authored references in terms of scientific rationale, adverse events and drug interactions.

Methods

The study reviewed 20 cases of off‐label prescriptions in rare paediatric diseases using 4 LLMs (i.e., GPT‐4o, Sophos‐2, Claude‐3, Scopus AI). The queries addressed focused on scientific rationale, adverse events and drug interactions. The performance measures encompassed sensitivity, precision, accuracy, F1‐score, response quality and reference quality. A Global Performance Score integrated all measures.

Results

After evaluating 2758 references and 480 responses, a significant discrepancy was found among 4 LLMs concerning Global Performance Score ( P = .001). Posthoc analysis showed that Scopus AI vs . GPT‐4o comparison was significant, with GPT‐4o showing higher values. Median LLM reference quality often surpassed human performance, yet variability limits conclusions regarding superiority.

Conclusions

LLMs are capable of retrieving and synthesizing biomedical information, but performance varies depending on query type and search mode. These tools speed up retrieving relevant information to assess off‐label prescribing appropriateness. Despite the promise of artificial intelligence, human oversight remains critical to ensure data accuracy and reliability.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Off-Label UseRare DiseasesNatural Language ProcessingHumansChildReproducibility of ResultsDrug InteractionsLarge Language Models

Stichwörter der Autor:innen

artificial intelligencechildrenclinical decision‐makinglarge language modelsoff‐labelrare diseases

Autor:innen und Institutionen

  • Institute for Maternal and Child Health (IRCCS Burlo Garofolo), Trieste, Italy.
  • University of Trieste, Trieste, Italy.

ORCID-Profile: Anna Flamigni, Giulia Zamagni, Gilda Paternuosto, Anna Arbo

Förderung

  • Italian Ministry of Health

Zitieren

APA

Flamigni, A., Zamagni, G., Paternuosto, G., & Arbo, A. (2025). Paediatric rare diseases: Can large language models assist off‐label prescribing?. British Journal of Clinical Pharmacology. https://doi.org/10.1002/bcp.70168

Vancouver

Flamigni A, Zamagni G, Paternuosto G, Arbo A. Paediatric rare diseases: Can large language models assist off‐label prescribing?. British Journal of Clinical Pharmacology. 2025. doi:10.1002/bcp.70168

BibTeX
@article{Flamigni2025,
  author = {Flamigni, Anna and Zamagni, Giulia and Paternuosto, Gilda and Arbo, Anna},
  title = {Paediatric rare diseases: Can large language models assist off‐label prescribing?},
  journal = {British Journal of Clinical Pharmacology},
  year = {2025},
  doi = {10.1002/bcp.70168}
}
Kostenlos starten →