EUVIMEDEUVIMED entdecken
Randomisierte kontrollierte Studie

‘ChatGPT can make mistakes’ warnings fail: A randomized controlled trial

Yavuz Selim Kıyak iD, Özlem Coşkun, Işıl İrem Budakoğlu

Medical Education · 2026-02 · 60 (2) · 138-142

DOI: 10.1111/medu.70056 ↗

Kurz gefasst

Randomisierte kontrollierte Studie in der Zeitschrift Medical Education, online erschienen am 25.09.2025. Verfasst von Yavuz Selim Kıyak und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Education and Informatics, Faculty of Medicine, Gazi University, Ankara, Türkiye. Hauptthemen laut MEDLINE: Clinical Decision-Making, Diagnostic Errors, Generative Artificial Intelligence, Students, Medical. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 17 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Warnings are commonly used to signal the fallibility of AI systems like ChatGPT in clinical decision‐making. Yet, little is known about whether such disclaimers influence medical students' diagnostic behaviour. Drawing on the Judge–Advisor System (JAS) theory, we investigated whether the warning alters advice‐taking behaviour by modifying perceived advisor credibility.

Method

In this randomized controlled trial, 186 fourth‐year medical students evaluated three clinical vignettes with two diagnostic options. Each case was specifically designed to include the presentations of both diagnoses to make the case ambiguous. Students were randomly assigned to receive feedback either with (warning arm) or without (no‐warning arm) a prominently displayed warning (‘ChatGPT can make mistakes. Check important info’.). After submitting their initial response, students received ChatGPT‐attributed disagreeing diagnostic feedback explaining why the alternate diagnosis was correct. Then they were given the opportunity to revise their original choice. Advice‐taking was measured by whether students changed their diagnosis after viewing AI input. We analysed change rates, weight‐of‐advice (WoA) and used mixed‐effects models to assess intervention effects.

Results

The warning did not influence diagnostic changes (15.3% no‐warning vs. 15.9% warning; OR = 1.09, 95% CI: 0.46–2.59, p = 0.84). The WoA was 0.15 (SD = 0.36), significantly lower than the 0.30 average in prior JAS meta‐analysis ( p < 0.001). Among students who retained their original diagnosis, the warning group showed a tendency toward providing explanations on why they disagree with the AI advisor (60% vs. 51%, p = 0.059).

Conclusions

The students underweight AI's diagnostic advice. The disclaimer did not alter students' use of AI advice, suggesting that their perceived credibility of ChatGPT was already near a behavioural floor. This finding supports the existence of a credibility threshold, beyond which additional cautionary cues have limited effect. Our results refine advice‐taking theory and signal that simple warnings may be insufficient to ensure calibrated trust in AI‐supported learning.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Clinical Decision-MakingDiagnostic ErrorsGenerative Artificial IntelligenceStudents, MedicalFemaleHumansMaleEducation, Medical, Undergraduate

Autor:innen und Institutionen

  • Department of Medical Education and Informatics, Faculty of Medicine, Gazi University, Ankara, Türkiye.

ORCID-Profile: Yavuz Selim Kıyak

Zitieren

APA

Kıyak, Y. S., Coşkun, Ö., & Budakoğlu, I. İ. (2026). ‘ChatGPT can make mistakes’ warnings fail: A randomized controlled trial. Medical Education, 60(2), 138-142. https://doi.org/10.1111/medu.70056

Vancouver

Kıyak YS, Coşkun Ö, Budakoğlu Iİ. ‘ChatGPT can make mistakes’ warnings fail: A randomized controlled trial. Medical Education. 2026;60(2):138-142. doi:10.1111/medu.70056

BibTeX
@article{Kyak2026,
  author = {Kıyak, Yavuz Selim and Coşkun, Özlem and Budakoğlu, Işıl İrem},
  title = {‘ChatGPT can make mistakes’ warnings fail: A randomized controlled trial},
  journal = {Medical Education},
  year = {2026},
  volume = {60},
  number = {2},
  pages = {138--142},
  doi = {10.1111/medu.70056}
}
Kostenlos starten →