Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition
Applied Sciences · 19.12.2024 · 14 (24) · 11914
DOI: 10.3390/app142411914 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 19.12.2024. Verfasst von Sergio Garcia und 2 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Spanish Ministry of Science, Innovation and Universities.
Abstract (Originalsprache)
This paper presents a study on enhancing human–robot interaction (HRI) through multimodal emotional recognition within social robotics. Using the humanoid robot Pepper as a testbed, we integrate visual, auditory, and textual analysis to improve emotion recognition accuracy and contextual understanding. The proposed framework combines pretrained neural networks with fine-tuning techniques tailored to specific users, demonstrating that high accuracy in emotion recognition can be achieved by adapting the models to the individual emotional expressions of each user. This approach addresses the inherent variability in emotional expression across individuals, making it feasible to deploy personalized emotion recognition systems. Our experiments validate the effectiveness of this methodology, achieving high precision in multimodal emotion recognition through fine-tuning, while maintaining adaptability in real-world scenarios. These enhancements significantly improve Pepper’s interactive and empathetic capabilities, allowing it to engage more naturally with users in assistive, educational, and healthcare settings. This study not only advances the field of HRI but also provides a reproducible framework for integrating multimodal emotion recognition into commercial humanoid robots, bridging the gap between research prototypes and practical applications.
Förderung
- Spanish Ministry of Science, Innovation and Universities
Zitieren
APA
Garcia, S., Gomez-Donoso, F., & Cazorla, M. (2024). Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition. Applied Sciences, 14(24), 11914. https://doi.org/10.3390/app142411914
Vancouver
Garcia S, Gomez-Donoso F, Cazorla M. Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition. Applied Sciences. 2024;14(24):11914. doi:10.3390/app142411914
BibTeX
@article{Garcia2024,
author = {Garcia, Sergio and Gomez-Donoso, Francisco and Cazorla, Miguel},
title = {Enhancing Human–Robot Interaction: Development of Multimodal Robotic Assistant for User Emotion Recognition},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {24},
pages = {11914},
doi = {10.3390/app142411914}
}
EUVIMED