EUVIMEDObjevte EUVIMED
VergleichsstudieOpen access · CC BY-NC 4.0

A comparative vignette study: Evaluating the potential role of a generative AI model in enhancing clinical decision‐making in nursing

Mor Saban iD, Ilana Dubovi iD

Journal of Advanced Nursing · 2025-11 · 81 (11) · 7489-7499

DOI: 10.1111/jan.16101 ↗

At a glance

Vergleichsstudie in Journal of Advanced Nursing, published online on 2024-02-17. Written by Mor Saban and 1 co-authors. Institution: Nursing Department, Steyer School of Health Professions, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel. Major MEDLINE topics: Clinical Decision-Making, Artificial Intelligence, Students, Nursing, Clinical Competence. Cited 68 times so far (Crossref); 39 references. The full text is freely available (open access, CC BY-NC 4.0).

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Aim

This study explores the potential of a generative artificial intelligence tool (ChatGPT) as clinical support for nurses. Specifically, we aim to assess whether ChatGPT can demonstrate clinical decision‐making equivalent to that of expert nurses and novice nursing students. This will be evaluated by comparing ChatGPT responses to clinical scenarios to those of nurses on different levels of experience.

Design

This is a cross‐sectional study.

Methods

Emergency room registered nurses (i.e. experts; n = 30) and nursing students (i.e. novices; n = 38) were recruited during March–April 2023. Clinical decision‐making was measured using three validated clinical scenarios involving an initial assessment and reevaluation. Clinical decision‐making aspects assessed were the accuracy of initial assessments, the appropriateness of recommended tests and resource use and the capacity to reevaluate decisions. Performance was also compared by timing response generations and word counts. Expert nurses and novice students completed online questionnaires (via Qualtrics), while ChatGPT responses were obtained from OpenAI.

Results

Concerning aspects of clinical decision‐making and compared to novices and experts: (1) ChatGPT exhibited indecisiveness in initial assessments; (2) ChatGPT tended to suggest unnecessary diagnostic tests; (3) When new information required re‐evaluation, ChatGPT responses demonstrated inaccurate understanding and inappropriate modifications. In terms of performance, the mean number of words utilized in ChatGPT answers was 27–41 times greater than that utilized by both experts and novices; and responses were provided approximately 4 times faster than those of novices and twice faster than expert nurses. ChatGPT responses maintained logical structure and clarity.

Conclusions

A generative AI tool demonstrated indecisiveness and a tendency towards over‐triage compared to human clinicians. Impact The study shows that it is important to approach the implementation of ChatGPT as a nurse's digital assistant with caution. More study is needed to optimize the model's training and algorithms to provide accurate healthcare support that aids clinical decision‐making. Reporting method This study adhered to relevant EQUATOR guidelines for reporting observational studies. Patient or public contribution Patients were not directly involved in the conduct of this study.

Subjects

MeSH terms (MEDLINE)

Clinical Decision-MakingArtificial IntelligenceStudents, NursingClinical CompetenceHumansCross-Sectional StudiesAdultFemaleMaleMiddle AgedSurveys and QuestionnairesYoung Adult

Author keywords

ChatGPTClinical decision‐makingGenerative AINoviceNurse educationNurses

Authors and institutions

  • Nursing Department, Steyer School of Health Professions, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel.

ORCID profiles: Mor Saban, Ilana Dubovi

Cite

APA

Saban, M., & Dubovi, I. (2025). A comparative vignette study: Evaluating the potential role of a generative AI model in enhancing clinical decision‐making in nursing. Journal of Advanced Nursing, 81(11), 7489-7499. https://doi.org/10.1111/jan.16101

Vancouver

Saban M, Dubovi I. A comparative vignette study: Evaluating the potential role of a generative AI model in enhancing clinical decision‐making in nursing. Journal of Advanced Nursing. 2025;81(11):7489-7499. doi:10.1111/jan.16101

BibTeX
@article{Saban2025,
  author = {Saban, Mor and Dubovi, Ilana},
  title = {A comparative vignette study: Evaluating the potential role of a generative AI model in enhancing clinical decision‐making in nursing},
  journal = {Journal of Advanced Nursing},
  year = {2025},
  volume = {81},
  number = {11},
  pages = {7489--7499},
  doi = {10.1111/jan.16101}
}
Start for free →