EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems
IEEE Transactions on Consumer Electronics · 2026-08 · 72 (3) · 6508-6515
DOI: 10.1109/tce.2026.3679325 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2026-08. Verfasst von Xianxun Zhu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 36 Literaturangaben.
Abstract (Originalsprache)
Multimodal sentiment analysis has achieved strong performance in controlled settings by integrating visual, acoustic, and textual signals. However, real-world consumer electronic systems operate under dynamic conditions with noisy, asynchronous, and partially observable inputs, challenging conventional models that assume reliable multimodal data. In this paper, we reformulate multimodal sentiment analysis as an embodied affect perception problem and propose EUPA, an uncertainty-aware framework that models modality reliability and performs confidence-guided temporal updates for online inference. EUPA dynamically regulates unreliable inputs and maintains a belief-based representation to support robust perception under evolving conditions. To evaluate this setting, we introduce an embodied evaluation protocol on CMU-MOSI and CMU-MOSEI with simulated modality dropout and temporal misalignment. Experimental results demonstrate improved robustness and temporal stability over existing methods, highlighting the potential of EUPA for real-world affect-aware applications.
Zitieren
APA
Zhu, X., Wang, R., Cascone, L., E, X., & Chen, H. (2026). EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems. IEEE Transactions on Consumer Electronics, 72(3), 6508-6515. https://doi.org/10.1109/tce.2026.3679325
Vancouver
Zhu X, Wang R, Cascone L, E X, Chen H. EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems. IEEE Transactions on Consumer Electronics. 2026;72(3):6508-6515. doi:10.1109/tce.2026.3679325
BibTeX
@article{Zhu2026,
author = {Zhu, Xianxun and Wang, Rui and Cascone, Lucia and E, Xiaosong and Chen, Hui},
title = {EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems},
journal = {IEEE Transactions on Consumer Electronics},
year = {2026},
volume = {72},
number = {3},
pages = {6508--6515},
doi = {10.1109/tce.2026.3679325}
}
EUVIMED