Multimodal perception-driven decision-making for human-robot interaction: a survey
Frontiers in Robotics and AI · 22.08.2025 · 12
DOI: 10.3389/frobt.2025.1604472 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Frontiers in Robotics and AI, online erschienen am 22.08.2025. Verfasst von Wenzheng Zhao und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA, United States. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 86 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Multimodal perception is essential for enabling robots to understand and interact with complex environments and human users by integrating diverse sensory data, such as vision, language, and tactile information. This capability plays a crucial role in decision-making in dynamic, complex environments. This survey provides a comprehensive review of advancements in multimodal perception and its integration with decision-making in robotics from year 2004–2024. We systematically summarize existing multimodal perception-driven decision-making (MPDDM) frameworks, highlighting their advantages in dynamic environments and the methodologies employed in human-robot interaction (HRI). Beyond reviewing these frameworks, we analyze key challenges in multimodal perception and decision-making, focusing on technical integration and sensor noise, adaptation, domain generalization, and safety and robustness. Finally, we outline future research directions, emphasizing the need for adaptive multimodal fusion techniques, more efficient learning paradigms, and human-trusted decision-making frameworks to advance the HRI field.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA, United States.
Zitieren
APA
Zhao, W., Gangaraju, K., & Yuan, F. (2025). Multimodal perception-driven decision-making for human-robot interaction: a survey. Frontiers in Robotics and AI, 12. https://doi.org/10.3389/frobt.2025.1604472
Vancouver
Zhao W, Gangaraju K, Yuan F. Multimodal perception-driven decision-making for human-robot interaction: a survey. Frontiers in Robotics and AI. 2025;12. doi:10.3389/frobt.2025.1604472
BibTeX
@article{Zhao2025,
author = {Zhao, Wenzheng and Gangaraju, Kruthika and Yuan, Fengpei},
title = {Multimodal perception-driven decision-making for human-robot interaction: a survey},
journal = {Frontiers in Robotics and AI},
year = {2025},
volume = {12},
doi = {10.3389/frobt.2025.1604472}
}
EUVIMED