EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction

Tianyu Song, Sasan Matinfar, Laura Schutz, Feng Li, Ulrich Eck, Nassir Navab

IEEE Access · 2026 · 14 · 110586-110601

DOI: 10.1109/access.2026.3711373 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Tianyu Song und 5 weiteren Autor:innen. Die Arbeit nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: state of Bavaria through Bayerische Forschungsstiftung.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent robotics advancements have enabled novel applications in medicine, such as automating ultrasound acquisition to support sonographers and enable remote operation. However, a key challenge is the lack of haptic and perceptual transparency regarding the robot’s decisions and actions, which may undermine trust and user acceptance. In this study, we propose a multisensory feedback system to enhance physician–robot interaction during robotic ultrasound procedures. The system provides real-time feedback on the force exerted by the robot on the patient and was developed following a user-centered approach, informed by clinical domain expertise, to support usability and clinical relevance. In a simulated Extended Reality (XR) environment, we evaluated the impact of different feedback conditions—including two sonification strategies, one visual feedback method, and their combinations. A user study with 30 participants, including three practicing clinicians, was conducted to assess these modalities. Results showed that multisensory feedback significantly reduced cognitive load (NASA-TLX: A1 +V vs. V, $p\lt 0.001$ ; A2 +V vs. V, $p\lt 0.01$ ), improved usability (SUS: A1 +V vs. V, $p\lt 0.001$ ; A2 +V vs. V, $p\lt 0.001$ ) and perceived ease of use (SEQ: A1 +V vs. V, $p\lt 0.01$ ; A2 +V vs. V, $p\lt 0.01$ ). While visual feedback alone yielded better performance in force monitoring, the multisensory conditions supported better focus on the primary task of image analysis. These findings suggest that multisensory feedback can enhance user experience and support interaction factors associated with trust formation, such as reduced workload and improved awareness of robot behavior, especially with further training and adaptation. Given the predominantly non-clinical sample and the use of abstract visual targets, these results should be read as an exploratory, preclinical validation of multisensory human–robot interaction rather than as evidence of clinical efficacy.

Förderung

  • state of Bavaria through Bayerische Forschungsstiftung

Zitieren

APA

Song, T., Matinfar, S., Schutz, L., Li, F., Eck, U., & Navab, N. (2026). The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction. IEEE Access, 14, 110586-110601. https://doi.org/10.1109/access.2026.3711373

Vancouver

Song T, Matinfar S, Schutz L, Li F, Eck U, Navab N. The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction. IEEE Access. 2026;14:110586-110601. doi:10.1109/access.2026.3711373

BibTeX
@article{Song2026,
  author = {Song, Tianyu and Matinfar, Sasan and Schutz, Laura and Li, Feng and Eck, Ulrich and Navab, Nassir},
  title = {The Impact of Multisensory Feedback on Supporting Physicians in Robotic Ultrasound Interaction},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {110586--110601},
  doi = {10.1109/access.2026.3711373}
}
Kostenlos starten →