EUVIMEDEUVIMED entdecken
Validierungsstudie

Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study

Nadav Grinberg, Sara Whitefield, Shlomi Kleinman, Clariel Ianculovici, Gilad Wasserman, Oren Peleg

Clinical Oral Investigations · 18.03.2025 · 29 (4)

DOI: 10.1007/s00784-025-06268-7 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Clinical Oral Investigations, online erschienen am 18.03.2025. Verfasst von Nadav Grinberg und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Otolaryngology, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel. Nadav.grinb…. Hauptthemen laut MEDLINE: Artificial Intelligence, Mouth Diseases, Mouth Mucosa. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 34 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

OBJECTIVES: Artificial intelligence (AI) is becoming more popular in medicine. The current study aims to investigate, primarily, if an AI-based chatbot, such as ChatGPT, could be a valid tool for assisting in establishing a differential diagnosis of oral mucosal lesions. METHODS: Data was gathered from patients who were referred to our clinic for an oral mucosal biopsy by one oral medicine specialist. Clinical description, differential diagnoses, and final histopathologic diagnoses were retrospectively extracted from patient records. The lesion description was inputted into ChatGPT version 4.0 under a uniform script to generate three differential diagnoses. ChatGPT and an oral medicine specialist's differential diagnosis were compared to the final histopathologic diagnosis. RESULTS: 100 oral soft tissue lesions were evaluated. A statistically significant correlation was found between the ability of the Chatbot and the Specialist to accurately diagnose the cases (P < 0.001). ChatGPT demonstrated remarkable sensitivity for diagnosing urgent cases, as none of the malignant lesions were missed by the chatbot. At the same time, the specificity of the specialist was higher in cases of malignant lesion diagnosis (p < 0.05). The chatbot performance was reliable in two different events (p < 0.01). CONCLUSION: ChatGPT-4 has shown the ability to pinpoint suspicious malignant lesions and suggest an adequate differential diagnosis for soft tissue lesions, in a consistent and repetitive manner. CLINICAL RELEVANCE: This study serves as a primary insight into the role of AI chatbots, as assisting tools in oral medicine and assesses their clinical capabilities.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceMouth DiseasesMouth MucosaHumansDiagnosis, DifferentialRetrospective StudiesMaleFemaleMiddle AgedAdultBiopsySensitivity and SpecificityAgedMouth NeoplasmsGenerative Artificial Intelligence

Stichwörter der Autor:innen

Artificial intelligenceChatGPTDifferential diagnosisOral mucosal lesionsOral squamous cell carcinoma

Autor:innen und Institutionen

  • Department of Otolaryngology, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel. Nadav.grinberg@mail.huji.ac.il.
  • , Mevasseret Zion, Israel. Nadav.grinberg@mail.huji.ac.il.
  • Oral Medicine Unit, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel.
  • Department of Otolaryngology, Head and Neck Surgery and Maxillofacial Surgery, Tel-Aviv Sourasky Medical Center, 64239, Tel Aviv, Israel.

Zitieren

APA

Grinberg, N., Whitefield, S., Kleinman, S., Ianculovici, C., Wasserman, G., & Peleg, O. (2025). Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study. Clinical Oral Investigations, 29(4). https://doi.org/10.1007/s00784-025-06268-7

Vancouver

Grinberg N, Whitefield S, Kleinman S, Ianculovici C, Wasserman G, Peleg O. Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study. Clinical Oral Investigations. 2025;29(4). doi:10.1007/s00784-025-06268-7

BibTeX
@article{Grinberg2025,
  author = {Grinberg, Nadav and Whitefield, Sara and Kleinman, Shlomi and Ianculovici, Clariel and Wasserman, Gilad and Peleg, Oren},
  title = {Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study},
  journal = {Clinical Oral Investigations},
  year = {2025},
  volume = {29},
  number = {4},
  doi = {10.1007/s00784-025-06268-7}
}
Kostenlos starten →