EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation of the Quality and Reliability of ChatGPT‐4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment

Ivan Cherrez-Ojeda iD, Torsten Zuberbier iD, Gabriela Rodas-Valero, Jorge Sanchez, Michael Rudenko, Stephanie Dramburg iD, Pascal Demoly, Davide Caimmi iD, René Maximiliano Gómez, German D Ramon, Ghada E Fouda, Kim R Quimby und 8 weitere

Clinical and Translational Allergy · 2025-12 · 15 (12)

DOI: 10.1002/clt2.70130 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Clinical and Translational Allergy, online erschienen am 29.11.2025. Verfasst von Ivan Cherrez-Ojeda und 19 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Allergology, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berli…. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Chat Generative Pre‐Trained Transformer 4 (ChatGPT‐4) represents an advancing large language model (LLM) with potential applications in medical education and patient care. While Allergen Immunotherapy (AIT) can change the course of allergic diseases, it can also bring uncertainty to patients, who turn to readily available resources such as ChatGPT‐4 to address these doubts. This study aimed to use validated tools to evaluate the information provided by ChatGPT‐4 regarding AIT in terms of quality, reliability, and readability.

Methods

In accordance with EAACI clinical guidelines about AIT, 24 questions were selected and introduced in ChatGPT‐4. Independent reviewers evaluated ChatGPT‐4 responses using three validated tools: the DISCERN instrument (quality), JAMA Benchmark criteria (reliability), and Flesch‐Kincaid Readability Tests (readability). Descriptive statistics summarized findings across categories.

Results

ChatGPT‐4 responses were generally rated as “fair quality” on DISCERN, with strengths in classification/formulations and special populations. Notably, the tool provided good‐quality responses on the preventive effects of AIT in children and premedication to reduce adverse reactions. However, JAMA Benchmark scores consistently indicated “insufficient information” (median = 0–1), primarily due to absent authorship, attribution, disclosure, and currency. Readability analyses revealed a college graduate–level requirement, with most responses classified as “very difficult” to understand. Overall, ChatGPT‐4 demonstrated fair quality, insufficient reliability, and difficult readability for patients.

Conclusions

ChatGPT‐4 provides generally well‐structured responses on AIT but lacks reliability and readability for clinical or patient‐directed use. Until specialized, reference‐based models are developed, healthcare professionals should supervise its use, particularly in sensitive areas such as dosing and safety.

Schlagwörter

Stichwörter der Autor:innen

allergen immunotherapyallergic rhinitisartificial intelligence

Autor:innen und Institutionen

  • Institute for Allergology, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.
  • Fraunhofer Institute for Translational Medicine and Pharmacology ITMP, Immunology and Allergology, Berlin, Germany.
  • Universidad Espiritu Santo, Samborondon, Ecuador.
  • Respiralab Research Group, Guayaquil, Ecuador.
  • Group of Clinical and Experimental Allergy, Hospital "Alma Mater de Antioquia", University of Antioquia, Medellín, Colombia.
  • London Allergy and Immunology Center, London, UK.

ORCID-Profile: Ivan Cherrez-Ojeda, Torsten Zuberbier, Stephanie Dramburg, Davide Caimmi, Oliver Pfaar, Jean Bousquet

Zitieren

APA

Cherrez-Ojeda, I., Zuberbier, T., Rodas-Valero, G., Sanchez, J., Rudenko, M., Dramburg, S., Demoly, P., Caimmi, D., Gómez, R. M., Ramon, G. D., Fouda, G. E., Quimby, K. R., Chong-Neto, H., Llosa, O. C., Larco, J. I., Monge Ortega, O. P., Faytong-Haro, M., Pfaar, O., Bousquet, J., & Robles-Velasco, K. (2025). Evaluation of the Quality and Reliability of ChatGPT‐4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment. Clinical and Translational Allergy, 15(12). https://doi.org/10.1002/clt2.70130

Vancouver

Cherrez-Ojeda I, Zuberbier T, Rodas-Valero G, Sanchez J, Rudenko M, Dramburg S, et al. Evaluation of the Quality and Reliability of ChatGPT‐4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment. Clinical and Translational Allergy. 2025;15(12). doi:10.1002/clt2.70130

BibTeX
@article{CherrezOjeda2025,
  author = {Cherrez-Ojeda, Ivan and Zuberbier, Torsten and Rodas-Valero, Gabriela and Sanchez, Jorge and Rudenko, Michael and Dramburg, Stephanie and Demoly, Pascal and Caimmi, Davide and Gómez, René Maximiliano and Ramon, German D and Fouda, Ghada E and Quimby, Kim R and Chong-Neto, Herberto and Llosa, Oscar Calderon and Larco, Jose Ignacio and Monge Ortega, Olga Patricia and Faytong-Haro, Marco and Pfaar, Oliver and Bousquet, Jean and Robles-Velasco, Karla},
  title = {Evaluation of the Quality and Reliability of ChatGPT‐4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment},
  journal = {Clinical and Translational Allergy},
  year = {2025},
  volume = {15},
  number = {12},
  doi = {10.1002/clt2.70130}
}
Kostenlos starten →