Exploring ChatGPT’s Clinical Ethics Ability: A pilot study
Journal of Health Ethics · 2024
DOI: 10.18785/jhe.2001.05 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Health Ethics, 2024. Verfasst von Daniel Jenkins und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Themen: Künstliche Intelligenz in der Pflege, Ethik in der Pflege
Abstract (Originalsprache)
Background
Artificial Intelligence (AI), particularly public models like ChatGPT, has revolutionized the generation of human-like thought processes and text. Across healthcare, the integration of AI in decision-making processes is increasingly pervasive. However, the application of AI in ethical decision-making remains relatively unexplored.
Methods
Ethics consultation notes from a tertiary academic medical center were de-identified. We trained ChatGPT using three separate ‘chats’ with one, two, or five unique notes and asked it to produce an ethical analysis/discussion and recommendations for a test case. We conducted this same series again but gave ChatGPT only the ethical analysis/discussion and recommendation sections from the training notes to learn from. Two independent raters scored ChatGPT’s ethics consultation documentation using the validated Ethics Consult Quality Assessment Tool (ECQAT).
Results
When trained with full notes ChatGPT’s ECQAT overall holistic rating score for each ‘chat’ was 2.5 for one note, 1.5 for two, and 2.5 for five. When trained using only the ethical analysis/discussion and recommendation sections, ChatGPT scored 3 for one note, 2 for two, and 1 for five.
Conclusion
ChatGPT's variable performance, influenced by training data, highlights its poor baseline ability and the need for targeted training. While initial improvement was observed with example consultations, complexity and scale affected performance adversely. The findings emphasize the importance of human oversight, as ChatGPT alone is unable to match human expertise. ChatGPT does exhibit potential for substantial improvement with better training and further research is needed to successfully make use of this powerful and widely accessible tool.
Zitieren
APA
Jenkins, D., Vercler, C., Barnosky, A., & Firn, J. (2024). Exploring ChatGPT’s Clinical Ethics Ability: A pilot study. Journal of Health Ethics. https://doi.org/10.18785/jhe.2001.05
Vancouver
Jenkins D, Vercler C, Barnosky A, Firn J. Exploring ChatGPT’s Clinical Ethics Ability: A pilot study. Journal of Health Ethics. 2024. doi:10.18785/jhe.2001.05
BibTeX
@article{Jenkins2024,
author = {Jenkins, Daniel and Vercler, Christian and Barnosky, Andrew and Firn, Janice},
title = {Exploring ChatGPT’s Clinical Ethics Ability: A pilot study},
journal = {Journal of Health Ethics},
year = {2024},
doi = {10.18785/jhe.2001.05}
}
EUVIMED