Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation
JMIR Human Factors · 10.04.2024 · 11 · e46698
DOI: 10.2196/46698 ↗Kurz gefasst
Mixed-Methods-Studie in der Zeitschrift JMIR Human Factors, online erschienen am 10.04.2024. Verfasst von Christin Hoffmann und 14 weiteren Autor:innen. Beteiligte Einrichtung: National Institute for Health and Care Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical School: Pop…. Hauptthemen laut MEDLINE: Research Design, Benchmarking. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 109 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Improving shared decision-making (SDM) for patients has become a health policy priority in many countries. Achieving high-quality SDM is particularly important for approximately 313 million surgical treatment decisions patients make globally every year. Large-scale monitoring of surgical patients’ experience of SDM in real time is needed to identify the failings of SDM before surgery is performed. We developed a novel approach to automating real-time data collection using an electronic measurement system to address this. Examining usability will facilitate its optimization and wider implementation to inform interventions aimed at improving SDM.
Objective
This study examined the usability of an electronic real-time measurement system to monitor surgical patients’ experience of SDM. We aimed to evaluate the metrics and indicators relevant to system effectiveness, system efficiency, and user satisfaction.
Methods
We performed a mixed methods usability evaluation using multiple participant cohorts. The measurement system was implemented in a large UK hospital to measure patients’ experience of SDM electronically before surgery using 2 validated measures (CollaboRATE and SDM-Q-9). Quantitative data (collected between April 1 and December 31, 2021) provided measurement system metrics to assess system effectiveness and efficiency. We included adult patients booked for urgent and elective surgery across 7 specialties and excluded patients without the capacity to consent for medical procedures, those without access to an internet-enabled device, and those undergoing emergency or endoscopic procedures. Additional groups of service users (group 1: public members who had not engaged with the system; group 2: a subset of patients who completed the measurement system) completed user-testing sessions and semistructured interviews to assess system effectiveness and user satisfaction. We conducted quantitative data analysis using descriptive statistics and calculated the task completion rate and survey response rate (system effectiveness) as well as the task completion time, task efficiency, and relative efficiency (system efficiency). Qualitative thematic analysis identified indicators of and barriers to good usability (user satisfaction).
Results
A total of 2254 completed surveys were returned to the measurement system. A total of 25 service users (group 1: n=9; group 2: n=16) participated in user-testing sessions and interviews. The task completion rate was high (169/171, 98.8%) and the survey response rate was good (2254/5794, 38.9%). The median task completion time was 3 (IQR 2-13) minutes, suggesting good system efficiency and effectiveness. The qualitative findings emphasized good user satisfaction. The identified themes suggested that the measurement system is acceptable, easy to use, and easy to access. Service users identified potential barriers and solutions to acceptability and ease of access.
Conclusions
A mixed methods evaluation of an electronic measurement system for automated, real-time monitoring of patients’ experience of SDM showed that usability among patients was high. Future pilot work will optimize the system for wider implementation to ultimately inform intervention development to improve SDM. International Registered Report Identifier (IRRID) RR2-10.1136/bmjopen-2023-079155
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- National Institute for Health and Care Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical School: Population Health Sciences, University of Bristol, Bristol, United Kingdo…
- Patient representative, Bristol, United Kingdom.
- North Bristol NHS Trust, Bristol, United Kingdom.
- Improvement Academy, Bradford Royal Infirmary, Bradford Teaching Hospitals NHS Foundation Trust, Bradford, United Kingdom.
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, United Kingdom.
- Leeds Unit of Complex Intervention Development (LUCID), Leeds Institute of Health Sciences, School of Medicine, University of Leeds, Leeds, United Kingdom.
ORCID-Profile: Christin Hoffmann, Kerry Avery, Rhiannon Macefield, Tadeáš Dvořák, Jane Blazeby, Della Hopkins, Shireen Hickey, Ben Gibbison, Leila Rooshenas, Adam Williams, Jonathan Aning, Hilary L Bekker, Angus Gk McNair
Zitieren
APA
Hoffmann, C., Avery, K., Macefield, R., Dvořák, T., Snelgrove, V., Blazeby, J., Hopkins, D., Hickey, S., Gibbison, B., Rooshenas, L., Williams, A., Aning, J., Bekker, H. L., McNair, A. G., & ALPACA Study Team (2024). Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation. JMIR Human Factors, 11, e46698. https://doi.org/10.2196/46698
Vancouver
Hoffmann C, Avery K, Macefield R, Dvořák T, Snelgrove V, Blazeby J, et al. Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation. JMIR Human Factors. 2024;11:e46698. doi:10.2196/46698
BibTeX
@article{Hoffmann2024,
author = {Hoffmann, Christin and Avery, Kerry and Macefield, Rhiannon and Dvořák, Tadeáš and Snelgrove, Val and Blazeby, Jane and Hopkins, Della and Hickey, Shireen and Gibbison, Ben and Rooshenas, Leila and Williams, Adam and Aning, Jonathan and Bekker, Hilary L and McNair, Angus Gk and ALPACA Study Team, ALPACA Study Team},
title = {Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation},
journal = {JMIR Human Factors},
year = {2024},
volume = {11},
pages = {e46698},
doi = {10.2196/46698}
}
EUVIMED