Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study
Clinical Oral Investigations · 18.03.2025 · 29 (4)
DOI: 10.1007/s00784-025-06268-7 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift Clinical Oral Investigations, online erschienen am 18.03.2025. Verfasst von Nadav Grinberg und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Otolaryngology, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel. Nadav.grinb…. Hauptthemen laut MEDLINE: Artificial Intelligence, Mouth Diseases, Mouth Mucosa. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 34 Literaturangaben.
Abstract (Originalsprache)
OBJECTIVES: Artificial intelligence (AI) is becoming more popular in medicine. The current study aims to investigate, primarily, if an AI-based chatbot, such as ChatGPT, could be a valid tool for assisting in establishing a differential diagnosis of oral mucosal lesions. METHODS: Data was gathered from patients who were referred to our clinic for an oral mucosal biopsy by one oral medicine specialist. Clinical description, differential diagnoses, and final histopathologic diagnoses were retrospectively extracted from patient records. The lesion description was inputted into ChatGPT version 4.0 under a uniform script to generate three differential diagnoses. ChatGPT and an oral medicine specialist's differential diagnosis were compared to the final histopathologic diagnosis. RESULTS: 100 oral soft tissue lesions were evaluated. A statistically significant correlation was found between the ability of the Chatbot and the Specialist to accurately diagnose the cases (P < 0.001). ChatGPT demonstrated remarkable sensitivity for diagnosing urgent cases, as none of the malignant lesions were missed by the chatbot. At the same time, the specificity of the specialist was higher in cases of malignant lesion diagnosis (p < 0.05). The chatbot performance was reliable in two different events (p < 0.01). CONCLUSION: ChatGPT-4 has shown the ability to pinpoint suspicious malignant lesions and suggest an adequate differential diagnosis for soft tissue lesions, in a consistent and repetitive manner. CLINICAL RELEVANCE: This study serves as a primary insight into the role of AI chatbots, as assisting tools in oral medicine and assesses their clinical capabilities.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Otolaryngology, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel. Nadav.grinberg@mail.huji.ac.il.
- , Mevasseret Zion, Israel. Nadav.grinberg@mail.huji.ac.il.
- Oral Medicine Unit, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel.
- Department of Otolaryngology, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel.
Zitieren
APA
Grinberg, N., Whitefield, S., Kleinman, S., Ianculovici, C., Wasserman, G., & Peleg, O. (2025). Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study. Clinical Oral Investigations, 29(4). https://doi.org/10.1007/s00784-025-06268-7
Vancouver
Grinberg N, Whitefield S, Kleinman S, Ianculovici C, Wasserman G, Peleg O. Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study. Clinical Oral Investigations. 2025;29(4). doi:10.1007/s00784-025-06268-7
BibTeX
@article{Grinberg2025,
author = {Grinberg, Nadav and Whitefield, Sara and Kleinman, Shlomi and Ianculovici, Clariel and Wasserman, Gilad and Peleg, Oren},
title = {Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study},
journal = {Clinical Oral Investigations},
year = {2025},
volume = {29},
number = {4},
doi = {10.1007/s00784-025-06268-7}
}
EUVIMED