EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition

Sergio Garcia, Francisco Gomez-Donoso, Miguel Cazorla

Applied Sciences · 19.12.2024 · 14 (24) · 11914

DOI: 10.3390/app142411914 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 19.12.2024. Verfasst von Sergio Garcia und 2 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Spanish Ministry of Science, Innovation and Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a study on enhancing human–robot interaction (HRI) through multimodal emotional recognition within social robotics. Using the humanoid robot Pepper as a testbed, we integrate visual, auditory, and textual analysis to improve emotion recognition accuracy and contextual understanding. The proposed framework combines pretrained neural networks with fine-tuning techniques tailored to specific users, demonstrating that high accuracy in emotion recognition can be achieved by adapting the models to the individual emotional expressions of each user. This approach addresses the inherent variability in emotional expression across individuals, making it feasible to deploy personalized emotion recognition systems. Our experiments validate the effectiveness of this methodology, achieving high precision in multimodal emotion recognition through fine-tuning, while maintaining adaptability in real-world scenarios. These enhancements significantly improve Pepper’s interactive and empathetic capabilities, allowing it to engage more naturally with users in assistive, educational, and healthcare settings. This study not only advances the field of HRI but also provides a reproducible framework for integrating multimodal emotion recognition into commercial humanoid robots, bridging the gap between research prototypes and practical applications.

Förderung

  • Spanish Ministry of Science, Innovation and Universities

Zitieren

APA

Garcia, S., Gomez-Donoso, F., & Cazorla, M. (2024). Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition. Applied Sciences, 14(24), 11914. https://doi.org/10.3390/app142411914

Vancouver

Garcia S, Gomez-Donoso F, Cazorla M. Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition. Applied Sciences. 2024;14(24):11914. doi:10.3390/app142411914

BibTeX
@article{Garcia2024,
  author = {Garcia, Sergio and Gomez-Donoso, Francisco and Cazorla, Miguel},
  title = {Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {24},
  pages = {11914},
  doi = {10.3390/app142411914}
}
Kostenlos starten →