EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Gaze-based music generation system for users with severe speech motor impairment

Taishin Aoki iD, Yash Kumar Sahu iD, Himanshu Vishwakarma iD, L R D Murthy, Gowdham Prabhakar, Pradipta Biswas

Journal of Rehabilitation and Assistive Technologies Engineering · 2026-08 · 13

DOI: 10.1177/20556683261476038 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Rehabilitation and Assistive Technologies Engineering, online erschienen am 07.08.2026. Verfasst von Taishin Aoki und 5 weiteren Autor:innen. Beteiligte Einrichtung: Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc), Bengaluru, India. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Users with Severe Speech Motor Impairment (SSMI) face difficulties interacting with digital systems due to limited speech and motor control. To address this, we present an eye gaze-based system that enables users with SSMI to generate short music using eye gaze control. The system combines a webcam-based eye-tracking with a music generation system that transforms user-selected images into music. A user study was conducted with 15 participants with SSMI across 74 sessions. The results show that the participants were able to interact with the system using gaze-based control, with an average engagement time of 61.38 seconds per session. Eye-tracking calibration accuracy varied across participants, reflecting individual differences in gaze control. These findings demonstrate the feasibility of gaze-based generative music interaction as an accessible assistive system for users with SSMI.

Schlagwörter

Stichwörter der Autor:innen

assistive technologyeye trackinggaze-based interactiongenerative AImusic generationuser engagement

Autor:innen und Institutionen

  • Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc), Bengaluru, India.
  • Shimane University, Matsue, Shimane, Japan.
  • Mercedes-Benz Research & Development, Bengaluru, India.
  • Indian Institute of Technology, Kanpur, India.

ORCID-Profile: Taishin Aoki, Yash Kumar Sahu, Himanshu Vishwakarma

Zitieren

APA

Aoki, T., Sahu, Y. K., Vishwakarma, H., Murthy, L. R. D., Prabhakar, G., & Biswas, P. (2026). Gaze-based music generation system for users with severe speech motor impairment. Journal of Rehabilitation and Assistive Technologies Engineering, 13. https://doi.org/10.1177/20556683261476038

Vancouver

Aoki T, Sahu YK, Vishwakarma H, Murthy LRD, Prabhakar G, Biswas P. Gaze-based music generation system for users with severe speech motor impairment. Journal of Rehabilitation and Assistive Technologies Engineering. 2026;13. doi:10.1177/20556683261476038

BibTeX
@article{Aoki2026,
  author = {Aoki, Taishin and Sahu, Yash Kumar and Vishwakarma, Himanshu and Murthy, L R D and Prabhakar, Gowdham and Biswas, Pradipta},
  title = {Gaze-based music generation system for users with severe speech motor impairment},
  journal = {Journal of Rehabilitation and Assistive Technologies Engineering},
  year = {2026},
  volume = {13},
  doi = {10.1177/20556683261476038}
}
Kostenlos starten →