EUVIMEDAtrasti EUVIMED
Qualitative StudieOpen access

AI-Assisted Decision-Making in Long-Term Care: Qualitative Study on Prerequisites for Responsible Innovation

KI-gestützte Entscheidungsfindung in der Langzeitpflege: qualitative Studie zu Voraussetzungen für verantwortungsvolle Innovation

Dirk R M Lukkien iD, Nathalie E Stolwijk iD, Sima Ipakchian Askari iD, Bob M Hofstede iD, Henk Herman Nap iD, Wouter P C Boon iD, Alexander Peine iD, Ellen H M Moors iD, Mirella M N Minkman iD

JMIR Nursing · 2024-07-25 · 7 · e55962

DOI: 10.2196/55962 ↗

Auf einen Blick

24 Fachpersonen aus der niederländischen Langzeitpflege beschrieben Chancen und Risiken von AI-DSSs. Die Bewertungen waren abgewogen und von mehreren Voraussetzungen für den verantwortungsvollen Einsatz geprägt.

Fragestellung

Welche Voraussetzungen für eine verantwortungsvolle KI-gestützte Entscheidungsfindung in der Pflege sehen Pflegefachpersonen und andere Stakeholder in der Langzeitpflege?

Methode

Semistrukturierte Interviews mit 24 Fachpersonen in der niederländischen Langzeitpflege; thematische Analyse anhand von 2 Szenarien und 6 Prinzipien verantwortlicher KI.

Ergebnisse

Identifiziert wurden Chancen und Risiken u. a. bei früher Bedarfserkennung, Pflegeplanung, Shared Decision-Making und Arbeitsbelastung. Daraus ergaben sich 7 Kategorien von Voraussetzungen für verantwortliche KI-gestützte Entscheidungsfindung.

Schlussfolgerung der Autor:innen

Die Chancen KI-gestützter Entscheidungsfindung können je nach Design und Einsatz zu Nachteilen werden. Die Autor:innen empfehlen, den verantwortungsvollen Einsatz als Balanceakt zu betrachten und mehrere Akteure einzubeziehen.

Kernaussagen

  • Bewertungen von AI-DSSs waren weder rein positiv noch negativ
  • 7 Voraussetzungen für verantwortliche KI-gestützte Entscheidungsfindung wurden benannt
  • Design und Einsatz können Chancen in Nachteile verwandeln

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

At a glance

Qualitative Studie in JMIR Nursing, published online on 2024-07-25. Written by Dirk R M Lukkien and 8 co-authors. Institution: Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands. Major MEDLINE topics: Qualitative Research, Artificial Intelligence, Long-Term Care, Decision Making. Cited 43 times so far (Crossref); 80 references. The full text is freely available in PubMed Central.

Auf einen BlickSantraukaSubjectsBibliografiniai duomenysCiteRelated studies

Abstract (original language)

Background

Although the use of artificial intelligence (AI)–based technologies, such as AI-based decision support systems (AI-DSSs), can help sustain and improve the quality and efficiency of care, their deployment creates ethical and social challenges. In recent years, a growing prevalence of high-level guidelines and frameworks for responsible AI innovation has been observed. However, few studies have specified the responsible embedding of AI-based technologies, such as AI-DSSs, in specific contexts, such as the nursing process in long-term care (LTC) for older adults.

Objective

Prerequisites for responsible AI-assisted decision-making in nursing practice were explored from the perspectives of nurses and other professional stakeholders in LTC.

Methods

Semistructured interviews were conducted with 24 care professionals in Dutch LTC, including nurses, care coordinators, data specialists, and care centralists. A total of 2 imaginary scenarios about AI-DSSs were developed beforehand and used to enable participants articulate their expectations regarding the opportunities and risks of AI-assisted decision-making. In addition, 6 high-level principles for responsible AI were used as probing themes to evoke further consideration of the risks associated with using AI-DSSs in LTC. Furthermore, the participants were asked to brainstorm possible strategies and actions in the design, implementation, and use of AI-DSSs to address or mitigate these risks. A thematic analysis was performed to identify the opportunities and risks of AI-assisted decision-making in nursing practice and the associated prerequisites for responsible innovation in this area.

Results

The stance of care professionals on the use of AI-DSSs is not a matter of purely positive or negative expectations but rather a nuanced interplay of positive and negative elements that lead to a weighed perception of the prerequisites for responsible AI-assisted decision-making. Both opportunities and risks were identified in relation to the early identification of care needs, guidance in devising care strategies, shared decision-making, and the workload of and work experience of caregivers. To optimally balance the opportunities and risks of AI-assisted decision-making, seven categories of prerequisites for responsible AI-assisted decision-making in nursing practice were identified: (1) regular deliberation on data collection; (2) a balanced proactive nature of AI-DSSs; (3) incremental advancements aligned with trust and experience; (4) customization for all user groups, including clients and caregivers; (5) measures to counteract bias and narrow perspectives; (6) human-centric learning loops; and (7) the routinization of using AI-DSSs.

Conclusions

The opportunities of AI-assisted decision-making in nursing practice could turn into drawbacks depending on the specific shaping of the design and deployment of AI-DSSs. Therefore, we recommend considering the responsible use of AI-DSSs as a balancing act. Moreover, considering the interrelatedness of the identified prerequisites, we call for various actors, including developers and users of AI-DSSs, to cohesively address the different factors important to the responsible embedding of AI-DSSs in practice.

Subjects

MeSH terms (MEDLINE)

Qualitative ResearchArtificial IntelligenceLong-Term CareDecision MakingHumansFemaleMaleAdultMiddle AgedNetherlandsInterviews as Topic

Author keywords

decision support systemsethicslong-term careresponsible innovationstakeholder perspectives

Authors and institutions

  • Vilans Centre of Expertise of Long Term Care, Utrecht, Netherlands.
  • Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, Netherlands.
  • Human Technology Interaction, Eindhoven University of Technology, Eindhoven, Netherlands.
  • Faculty of Humanities, Open University of The Netherlands, Heerlen, Netherlands.
  • TIAS School for Business and Society, Tilburg University, Tilburg, Netherlands.

ORCID profiles: Dirk R M Lukkien, Nathalie E Stolwijk, Sima Ipakchian Askari, Bob M Hofstede, Henk Herman Nap, Wouter P C Boon, Alexander Peine, Ellen H M Moors, Mirella M N Minkman

Cite

APA

Lukkien, D. R. M., Stolwijk, N. E., Ipakchian Askari, S., Hofstede, B. M., Nap, H. H., Boon, W. P. C., Peine, A., Moors, E. H. M., & Minkman, M. M. N. (2024). AI-Assisted Decision-Making in Long-Term Care: Qualitative Study on Prerequisites for Responsible Innovation. JMIR Nursing, 7, e55962. https://doi.org/10.2196/55962

Vancouver

Lukkien DRM, Stolwijk NE, Ipakchian Askari S, Hofstede BM, Nap HH, Boon WPC, et al. AI-Assisted Decision-Making in Long-Term Care: Qualitative Study on Prerequisites for Responsible Innovation. JMIR Nursing. 2024;7:e55962. doi:10.2196/55962

BibTeX
@article{Lukkien2024,
  author = {Lukkien, Dirk R M and Stolwijk, Nathalie E and Ipakchian Askari, Sima and Hofstede, Bob M and Nap, Henk Herman and Boon, Wouter P C and Peine, Alexander and Moors, Ellen H M and Minkman, Mirella M N},
  title = {AI-Assisted Decision-Making in Long-Term Care: Qualitative Study on Prerequisites for Responsible Innovation},
  journal = {JMIR Nursing},
  year = {2024},
  volume = {7},
  pages = {e55962},
  doi = {10.2196/55962}
}
Start for free →