EUVIMEDEUVIMED entdecken
Multizentrische StudieOpen Access · CC BY-NC 4.0

The utility of artificial intelligence platforms for patient‐generated questions in Mohs micrographic surgery: a multi‐national, blinded expert panel evaluation

Kyle C Lauck iD, Seo Won Cho iD, Matthew DaCunha, John Wuennenberg, Sumaira Aasi, Murad Alam, Sarah T Arron, Anna Bar, David G Brodland, Felipe B Cerci, Joel L Cohen, Brett Coldiron und 8 weitere

International Journal of Dermatology · 2024-11 · 63 (11) · 1592-1598

DOI: 10.1111/ijd.17382 ↗

Kurz gefasst

Multizentrische Studie in der Zeitschrift International Journal of Dermatology, online erschienen am 09.08.2024. Verfasst von Kyle C Lauck und 19 weiteren Autor:innen. Beteiligte Einrichtung: Baylor University Medical Center, Dallas, TX, USA. Hauptthemen laut MEDLINE: Mohs Surgery, Artificial Intelligence, Patient Education as Topic. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence (AI) and large language models (LLMs) transform how patients inform themselves. LLMs offer potential as educational tools, but their quality depends upon the information generated. Current literature examining AI as an informational tool in dermatology has been limited in evaluating AI's multifaceted roles and diversity of opinions. Here, we evaluate LLMs as a patient‐educational tool for Mohs micrographic surgery (MMS) in and out of the clinic utilizing an international expert panel.

Methods

The most common patient MMS questions were extracted from Google and transposed into two LLMs and Google's search engine. 15 MMS surgeons evaluated the generated responses, examining their appropriateness as a patient‐facing informational platform, sufficiency of response in a clinical environment, and accuracy of content generated. Validated scales were employed to assess the comprehensibility of each response.

Results

The majority of reviewers deemed all LLM responses appropriate. 75% of responses were rated as mostly accurate or higher. ChatGPT had the highest mean accuracy. The majority of the panel deemed 33% of responses sufficient for clinical practice. The mean comprehensibility scores for all platforms indicated a required 10th‐grade reading level.

Conclusions

LLM‐generated responses were rated as appropriate patient informational sources and mostly accurate in their content. However, these platforms may not provide sufficient information to function in a clinical environment, and complex comprehensibility may represent a barrier to utilization. As the popularity of these platforms increases, it is important for dermatologists to be aware of these limitations.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Mohs SurgeryArtificial IntelligencePatient Education as TopicHumansSkin NeoplasmsSearch Engine

Stichwörter der Autor:innen

AIMohs micrographic surgeryartificial intelligencedermatologic surgerylanguage learning modelpatient educationskin cancer education

Autor:innen und Institutionen

  • Baylor University Medical Center, Dallas, TX, USA.
  • Texas A&M College of Medicine, Dallas, TX, USA.
  • The Skin Cancer Center, University of Cincinnati, Cincinnati, OH, USA.
  • Surgical Dermatology Group, Vestavia Hills, AL, USA.
  • Department of Dermatology, Stanford University School of Medicine, Redwood City, CA, USA.
  • Department of Dermatology, Feinberg School of Medicine, Chicago, IL, USA.

ORCID-Profile: Kyle C Lauck, Seo Won Cho, George Hruza, Stanislav N Tolkachjov

Zitieren

APA

Lauck, K. C., Cho, S. W., DaCunha, M., Wuennenberg, J., Aasi, S., Alam, M., Arron, S. T., Bar, A., Brodland, D. G., Cerci, F. B., Cohen, J. L., Coldiron, B., Council, M. L., Harmon, C. B., Hruza, G., Läuchli, S., Moody, B. R., Wysong, A. S., Zitelli, J. A., & Tolkachjov, S. N. (2024). The utility of artificial intelligence platforms for patient‐generated questions in Mohs micrographic surgery: a multi‐national, blinded expert panel evaluation. International Journal of Dermatology, 63(11), 1592-1598. https://doi.org/10.1111/ijd.17382

Vancouver

Lauck KC, Cho SW, DaCunha M, Wuennenberg J, Aasi S, Alam M, et al. The utility of artificial intelligence platforms for patient‐generated questions in Mohs micrographic surgery: a multi‐national, blinded expert panel evaluation. International Journal of Dermatology. 2024;63(11):1592-1598. doi:10.1111/ijd.17382

BibTeX
@article{Lauck2024,
  author = {Lauck, Kyle C and Cho, Seo Won and DaCunha, Matthew and Wuennenberg, John and Aasi, Sumaira and Alam, Murad and Arron, Sarah T and Bar, Anna and Brodland, David G and Cerci, Felipe B and Cohen, Joel L and Coldiron, Brett and Council, M Laurin and Harmon, Christopher B and Hruza, George and Läuchli, Severin and Moody, Brent R and Wysong, Ashley S and Zitelli, John A and Tolkachjov, Stanislav N},
  title = {The utility of artificial intelligence platforms for patient‐generated questions in Mohs micrographic surgery: a multi‐national, blinded expert panel evaluation},
  journal = {International Journal of Dermatology},
  year = {2024},
  volume = {63},
  number = {11},
  pages = {1592--1598},
  doi = {10.1111/ijd.17382}
}
Kostenlos starten →