Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study
JMIR Human Factors · 2024
DOI: 10.2196/57243 ↗At a glance
Journal article in JMIR Human Factors, 2024. Written by Parmiss Kiani and 6 co-authors. Institution: Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada. Major MEDLINE topics: Ergonomics, Mentoring. Cited 9 times so far (Crossref); 19 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Telementoring studies found technical challenges in achieving accurate and stable annotations during live surgery using commercially available telestration software intraoperatively. To address the gap, a wireless handheld telestration device was developed to facilitate dynamic user interaction with live video streams.
Objective
This study aims to find the perceived usability, ergonomics, and educational value of a first-generation handheld wireless telestration platform.
Methods
A prototype was developed with four core hand-held functions: (1) free-hand annotation, (2) cursor navigation, (3) overlay and manipulation (rotation) of ghost (avatar) instrumentation, and (4) hand-held video feed navigation on a remote monitor. This device uses a proprietary augmented reality platform. Surgeons and trainees were invited to test the core functions of the platform by performing standardized tasks. Usability and ergonomics were evaluated with a validated system usability scale and a 5-point Likert scale survey, which also evaluated the perceived educational value of the device.
Results
In total, 10 people (9 surgeons and 1 senior resident; 5 male and 5 female) participated. Participants strongly agreed or agreed (SA/A) that it was easy to perform annotations (SA/A 9, 90% and neutral 0, 0%), video feed navigation (SA/A 8, 80% and neutral 1, 10%), and manipulation of ghost (avatar) instruments on the monitor (SA/A 6, 60% and neutral 3, 30%). Regarding ergonomics, 40% (4) of participants agreed or strongly agreed (neutral 4, 40%) that the device was physically comfortable to use and hold. These results are consistent with open-ended comments on the device’s size and weight. The average system usability scale was 70 (SD 12.5; median 75, IQR 63-84) indicating an above average usability score. Participants responded favorably to the device’s perceived educational value, particularly for postoperative coaching (agree 6, 60%, strongly agree 4, 40%).
Conclusions
This study presents the preliminary usability results of a novel first-generation telestration tool customized for use in surgical coaching. Favorable usability and perceived educational value were reported. Future iterations of the device should focus on incorporating user feedback and additional studies should be conducted to evaluate its effectiveness for improving surgical education. Ultimately, such tools can be incorporated into pedagogical models of surgical coaching to optimize feedback and training.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada.
- Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
- Department of Surgery, University of Toronto, Toronto, ON, Canada.
ORCID profiles: Parmiss Kiani, Roberta Dolling-Boreham, Mohamed Saif Hameed, Caterina Masino, Andras Fecso, Allan Okrainec, Amin Madani
Cite
APA
Kiani, P., Dolling-Boreham, R., Hameed, M. S., Masino, C., Fecso, A., Okrainec, A., & Madani, A. (2024). Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study. JMIR Human Factors. https://doi.org/10.2196/57243
Vancouver
Kiani P, Dolling-Boreham R, Hameed MS, Masino C, Fecso A, Okrainec A, et al. Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study. JMIR Human Factors. 2024. doi:10.2196/57243
BibTeX
@article{Kiani2024,
author = {Kiani, Parmiss and Dolling-Boreham, Roberta and Hameed, Mohamed Saif and Masino, Caterina and Fecso, Andras and Okrainec, Allan and Madani, Amin},
title = {Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study},
journal = {JMIR Human Factors},
year = {2024},
doi = {10.2196/57243}
}
EUVIMED