The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction
IEEE Access · 2026 · 14 · 110586-110601
DOI: 10.1109/access.2026.3711373 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Tianyu Song und 5 weiteren Autor:innen. Die Arbeit nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: state of Bavaria through Bayerische Forschungsstiftung.
Abstract (Originalsprache)
Recent robotics advancements have enabled novel applications in medicine, such as automating ultrasound acquisition to support sonographers and enable remote operation. However, a key challenge is the lack of haptic and perceptual transparency regarding the robot’s decisions and actions, which may undermine trust and user acceptance. In this study, we propose a multisensory feedback system to enhance physician–robot interaction during robotic ultrasound procedures. The system provides real-time feedback on the force exerted by the robot on the patient and was developed following a user-centered approach, informed by clinical domain expertise, to support usability and clinical relevance. In a simulated Extended Reality (XR) environment, we evaluated the impact of different feedback conditions—including two sonification strategies, one visual feedback method, and their combinations. A user study with 30 participants, including three practicing clinicians, was conducted to assess these modalities. Results showed that multisensory feedback significantly reduced cognitive load (NASA-TLX: A1 +V vs. V, $p\lt 0.001$ ; A2 +V vs. V, $p\lt 0.01$ ), improved usability (SUS: A1 +V vs. V, $p\lt 0.001$ ; A2 +V vs. V, $p\lt 0.001$ ) and perceived ease of use (SEQ: A1 +V vs. V, $p\lt 0.01$ ; A2 +V vs. V, $p\lt 0.01$ ). While visual feedback alone yielded better performance in force monitoring, the multisensory conditions supported better focus on the primary task of image analysis. These findings suggest that multisensory feedback can enhance user experience and support interaction factors associated with trust formation, such as reduced workload and improved awareness of robot behavior, especially with further training and adaptation. Given the predominantly non-clinical sample and the use of abstract visual targets, these results should be read as an exploratory, preclinical validation of multisensory human–robot interaction rather than as evidence of clinical efficacy.
Förderung
- state of Bavaria through Bayerische Forschungsstiftung
Zitieren
APA
Song, T., Matinfar, S., Schutz, L., Li, F., Eck, U., & Navab, N. (2026). The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction. IEEE Access, 14, 110586-110601. https://doi.org/10.1109/access.2026.3711373
Vancouver
Song T, Matinfar S, Schutz L, Li F, Eck U, Navab N. The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction. IEEE Access. 2026;14:110586-110601. doi:10.1109/access.2026.3711373
BibTeX
@article{Song2026,
author = {Song, Tianyu and Matinfar, Sasan and Schutz, Laura and Li, Feng and Eck, Ulrich and Navab, Nassir},
title = {The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {110586--110601},
doi = {10.1109/access.2026.3711373}
}
EUVIMED