Gaze-based music generation system for users with severe speech motor impairment
Journal of Rehabilitation and Assistive Technologies Engineering · 2026-08 · 13
DOI: 10.1177/20556683261476038 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Rehabilitation and Assistive Technologies Engineering, online erschienen am 07.08.2026. Verfasst von Taishin Aoki und 5 weiteren Autor:innen. Beteiligte Einrichtung: Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc), Bengaluru, India. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Users with Severe Speech Motor Impairment (SSMI) face difficulties interacting with digital systems due to limited speech and motor control. To address this, we present an eye gaze-based system that enables users with SSMI to generate short music using eye gaze control. The system combines a webcam-based eye-tracking with a music generation system that transforms user-selected images into music. A user study was conducted with 15 participants with SSMI across 74 sessions. The results show that the participants were able to interact with the system using gaze-based control, with an average engagement time of 61.38 seconds per session. Eye-tracking calibration accuracy varied across participants, reflecting individual differences in gaze control. These findings demonstrate the feasibility of gaze-based generative music interaction as an accessible assistive system for users with SSMI.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc), Bengaluru, India.
- Shimane University, Matsue, Shimane, Japan.
- Mercedes-Benz Research & Development, Bengaluru, India.
- Indian Institute of Technology, Kanpur, India.
ORCID-Profile: Taishin Aoki, Yash Kumar Sahu, Himanshu Vishwakarma
Zitieren
APA
Aoki, T., Sahu, Y. K., Vishwakarma, H., Murthy, L. R. D., Prabhakar, G., & Biswas, P. (2026). Gaze-based music generation system for users with severe speech motor impairment. Journal of Rehabilitation and Assistive Technologies Engineering, 13. https://doi.org/10.1177/20556683261476038
Vancouver
Aoki T, Sahu YK, Vishwakarma H, Murthy LRD, Prabhakar G, Biswas P. Gaze-based music generation system for users with severe speech motor impairment. Journal of Rehabilitation and Assistive Technologies Engineering. 2026;13. doi:10.1177/20556683261476038
BibTeX
@article{Aoki2026,
author = {Aoki, Taishin and Sahu, Yash Kumar and Vishwakarma, Himanshu and Murthy, L R D and Prabhakar, Gowdham and Biswas, Pradipta},
title = {Gaze-based music generation system for users with severe speech motor impairment},
journal = {Journal of Rehabilitation and Assistive Technologies Engineering},
year = {2026},
volume = {13},
doi = {10.1177/20556683261476038}
}
EUVIMED