EUVIMEDEUVIMED entdecken
Crossref

Exploring ChatGPT’s Clinical Ethics Ability: A pilot study

Daniel Jenkins, Christian Vercler, Andrew Barnosky, Janice Firn

Journal of Health Ethics · 2024

DOI: 10.18785/jhe.2001.05 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Health Ethics, 2024. Verfasst von Daniel Jenkins und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial Intelligence (AI), particularly public models like ChatGPT, has revolutionized the generation of human-like thought processes and text. Across healthcare, the integration of AI in decision-making processes is increasingly pervasive. However, the application of AI in ethical decision-making remains relatively unexplored.

Methods

Ethics consultation notes from a tertiary academic medical center were de-identified. We trained ChatGPT using three separate ‘chats’ with one, two, or five unique notes and asked it to produce an ethical analysis/discussion and recommendations for a test case. We conducted this same series again but gave ChatGPT only the ethical analysis/discussion and recommendation sections from the training notes to learn from. Two independent raters scored ChatGPT’s ethics consultation documentation using the validated Ethics Consult Quality Assessment Tool (ECQAT).

Results

When trained with full notes ChatGPT’s ECQAT overall holistic rating score for each ‘chat’ was 2.5 for one note, 1.5 for two, and 2.5 for five. When trained using only the ethical analysis/discussion and recommendation sections, ChatGPT scored 3 for one note, 2 for two, and 1 for five.

Conclusion

ChatGPT's variable performance, influenced by training data, highlights its poor baseline ability and the need for targeted training. While initial improvement was observed with example consultations, complexity and scale affected performance adversely. The findings emphasize the importance of human oversight, as ChatGPT alone is unable to match human expertise. ChatGPT does exhibit potential for substantial improvement with better training and further research is needed to successfully make use of this powerful and widely accessible tool.

Zitieren

APA

Jenkins, D., Vercler, C., Barnosky, A., & Firn, J. (2024). Exploring ChatGPT’s Clinical Ethics Ability: A pilot study. Journal of Health Ethics. https://doi.org/10.18785/jhe.2001.05

Vancouver

Jenkins D, Vercler C, Barnosky A, Firn J. Exploring ChatGPT’s Clinical Ethics Ability: A pilot study. Journal of Health Ethics. 2024. doi:10.18785/jhe.2001.05

BibTeX
@article{Jenkins2024,
  author = {Jenkins, Daniel and Vercler, Christian and Barnosky, Andrew and Firn, Janice},
  title = {Exploring ChatGPT’s Clinical Ethics Ability: A pilot study},
  journal = {Journal of Health Ethics},
  year = {2024},
  doi = {10.18785/jhe.2001.05}
}
Kostenlos starten →