EUVIMEDOpdag EUVIMED
Open access

Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study

Parmiss Kiani iD, Roberta Dolling-Boreham iD, Mohamed Saif Hameed iD, Caterina Masino iD, Andras Fecso iD, Allan Okrainec iD, Amin Madani iD

JMIR Human Factors · 2024

DOI: 10.2196/57243 ↗

At a glance

Journal article in JMIR Human Factors, 2024. Written by Parmiss Kiani and 6 co-authors. Institution: Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada. Major MEDLINE topics: Ergonomics, Mentoring. Cited 9 times so far (Crossref); 19 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Telementoring studies found technical challenges in achieving accurate and stable annotations during live surgery using commercially available telestration software intraoperatively. To address the gap, a wireless handheld telestration device was developed to facilitate dynamic user interaction with live video streams.

Objective

This study aims to find the perceived usability, ergonomics, and educational value of a first-generation handheld wireless telestration platform.

Methods

A prototype was developed with four core hand-held functions: (1) free-hand annotation, (2) cursor navigation, (3) overlay and manipulation (rotation) of ghost (avatar) instrumentation, and (4) hand-held video feed navigation on a remote monitor. This device uses a proprietary augmented reality platform. Surgeons and trainees were invited to test the core functions of the platform by performing standardized tasks. Usability and ergonomics were evaluated with a validated system usability scale and a 5-point Likert scale survey, which also evaluated the perceived educational value of the device.

Results

In total, 10 people (9 surgeons and 1 senior resident; 5 male and 5 female) participated. Participants strongly agreed or agreed (SA/A) that it was easy to perform annotations (SA/A 9, 90% and neutral 0, 0%), video feed navigation (SA/A 8, 80% and neutral 1, 10%), and manipulation of ghost (avatar) instruments on the monitor (SA/A 6, 60% and neutral 3, 30%). Regarding ergonomics, 40% (4) of participants agreed or strongly agreed (neutral 4, 40%) that the device was physically comfortable to use and hold. These results are consistent with open-ended comments on the device’s size and weight. The average system usability scale was 70 (SD 12.5; median 75, IQR 63-84) indicating an above average usability score. Participants responded favorably to the device’s perceived educational value, particularly for postoperative coaching (agree 6, 60%, strongly agree 4, 40%).

Conclusions

This study presents the preliminary usability results of a novel first-generation telestration tool customized for use in surgical coaching. Favorable usability and perceived educational value were reported. Future iterations of the device should focus on incorporating user feedback and additional studies should be conducted to evaluate its effectiveness for improving surgical education. Ultimately, such tools can be incorporated into pedagogical models of surgical coaching to optimize feedback and training.

Subjects

MeSH terms (MEDLINE)

ErgonomicsMentoringHumansFemaleMaleAdultUser-Computer InterfaceTelemedicineSurveys and Questionnaires

Author keywords

ARaugmented realitydigital healthdigital interventiondigital interventionsdigital technologyminimally invasive surgerysurgeonsurgeonssurgerysurgicalsurgical coachingsurgical teachingsurgical trainingsurgical training technology

Authors and institutions

  • Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada.
  • Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
  • Department of Surgery, University of Toronto, Toronto, ON, Canada.

ORCID profiles: Parmiss Kiani, Roberta Dolling-Boreham, Mohamed Saif Hameed, Caterina Masino, Andras Fecso, Allan Okrainec, Amin Madani

Cite

APA

Kiani, P., Dolling-Boreham, R., Hameed, M. S., Masino, C., Fecso, A., Okrainec, A., & Madani, A. (2024). Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study. JMIR Human Factors. https://doi.org/10.2196/57243

Vancouver

Kiani P, Dolling-Boreham R, Hameed MS, Masino C, Fecso A, Okrainec A, et al. Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study. JMIR Human Factors. 2024. doi:10.2196/57243

BibTeX
@article{Kiani2024,
  author = {Kiani, Parmiss and Dolling-Boreham, Roberta and Hameed, Mohamed Saif and Masino, Caterina and Fecso, Andras and Okrainec, Allan and Madani, Amin},
  title = {Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study},
  journal = {JMIR Human Factors},
  year = {2024},
  doi = {10.2196/57243}
}
Start for free →