EUVIMEDEUVIMED entdecken
Crossref

Evaluating AI Chatbots for Pediatric Contact Lenses: A Study on Accuracy, Readability, and Reliability

Mehmet Ömer Kırıştıoğlu, Meral Yıldız, Sevde İşleker, Esin Söğütlü Sarı, Ahmet Özmen, Mehmet Baykara

Uludağ Üniversitesi Tıp Fakültesi Dergisi · 16.03.2026 · 52 · 1780297

DOI: 10.32708/uutfd.1780297 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Uludağ Üniversitesi Tıp Fakültesi Dergisi, online erschienen am 16.03.2026. Verfasst von Mehmet Ömer Kırıştıoğlu und 5 weiteren Autor:innen. Die Arbeit nennt 32 Literaturangaben. Gefördert von: Not applicable.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluated the accuracy, readability, and comprehensiveness of patient-facing responses generated by LLM-based chatbot platforms to pediatric contact lens (CL)–related questions, using expert grading and readability benchmarking. Five platforms (ChatGPT-4o, Gemini 1.5, Perplexity, Copilot, and Claude 3.5 Sonnet) were assessed using 28 curated questions. Two pediatric ophthalmologists graded anonymized outputs using DISCERN and PEMAT-P, 5-point Likert scales for accuracy and comprehensiveness, and multiple automated readability indices. Expert-written responses were included only for readability benchmarking. ChatGPT-4o produced the longest responses (p<0.0001). Accuracy and comprehensiveness differed across platforms (p=0.0216 and p=0.0067), with ChatGPT-4o scoring higher than Perplexity in post-hoc comparisons (p=0.0173 and p=0.0087). Expert responses were shorter but showed higher complexity on readability indices. Accuracy-based reproducibility was high for general pediatric CL queries but lower for aphakic CL–related questions (p=0.041), and factual inaccuracies were more frequent in aphakic topics. While LLMs may support patient education, variability in correctness and completeness underscores the need for expert oversight; these tools should complement, not replace, clinical expertise in pediatric CL usage.

Förderung

  • Not applicable

Zitieren

APA

Kırıştıoğlu, M. Ö., Yıldız, M., İşleker, S., Sarı, E. S., Özmen, A., & Baykara, M. (2026). Evaluating AI Chatbots for Pediatric Contact Lenses: A Study on Accuracy, Readability, and Reliability. Uludağ Üniversitesi Tıp Fakültesi Dergisi, 52, 1780297. https://doi.org/10.32708/uutfd.1780297

Vancouver

Kırıştıoğlu MÖ, Yıldız M, İşleker S, Sarı ES, Özmen A, Baykara M. Evaluating AI Chatbots for Pediatric Contact Lenses: A Study on Accuracy, Readability, and Reliability. Uludağ Üniversitesi Tıp Fakültesi Dergisi. 2026;52:1780297. doi:10.32708/uutfd.1780297

BibTeX
@article{Krtolu2026,
  author = {Kırıştıoğlu, Mehmet Ömer and Yıldız, Meral and İşleker, Sevde and Sarı, Esin Söğütlü and Özmen, Ahmet and Baykara, Mehmet},
  title = {Evaluating AI Chatbots for Pediatric Contact Lenses: A Study on Accuracy, Readability, and Reliability},
  journal = {Uludağ Üniversitesi Tıp Fakültesi Dergisi},
  year = {2026},
  volume = {52},
  pages = {1780297},
  doi = {10.32708/uutfd.1780297}
}
Kostenlos starten →