EUVIMEDEUVIMED entdecken
Crossref

EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems

Xianxun Zhu, Rui Wang, Lucia Cascone, Xiaosong E, Hui Chen

IEEE Transactions on Consumer Electronics · 2026-08 · 72 (3) · 6508-6515

DOI: 10.1109/tce.2026.3679325 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2026-08. Verfasst von Xianxun Zhu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 36 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal sentiment analysis has achieved strong performance in controlled settings by integrating visual, acoustic, and textual signals. However, real-world consumer electronic systems operate under dynamic conditions with noisy, asynchronous, and partially observable inputs, challenging conventional models that assume reliable multimodal data. In this paper, we reformulate multimodal sentiment analysis as an embodied affect perception problem and propose EUPA, an uncertainty-aware framework that models modality reliability and performs confidence-guided temporal updates for online inference. EUPA dynamically regulates unreliable inputs and maintains a belief-based representation to support robust perception under evolving conditions. To evaluate this setting, we introduce an embodied evaluation protocol on CMU-MOSI and CMU-MOSEI with simulated modality dropout and temporal misalignment. Experimental results demonstrate improved robustness and temporal stability over existing methods, highlighting the potential of EUPA for real-world affect-aware applications.

Zitieren

APA

Zhu, X., Wang, R., Cascone, L., E, X., & Chen, H. (2026). EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems. IEEE Transactions on Consumer Electronics, 72(3), 6508-6515. https://doi.org/10.1109/tce.2026.3679325

Vancouver

Zhu X, Wang R, Cascone L, E X, Chen H. EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems. IEEE Transactions on Consumer Electronics. 2026;72(3):6508-6515. doi:10.1109/tce.2026.3679325

BibTeX
@article{Zhu2026,
  author = {Zhu, Xianxun and Wang, Rui and Cascone, Lucia and E, Xiaosong and Chen, Hui},
  title = {EUPA: Embodied Uncertainty-Aware Multimodal Affect Perception for Consumer Electronic Systems},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2026},
  volume = {72},
  number = {3},
  pages = {6508--6515},
  doi = {10.1109/tce.2026.3679325}
}
Kostenlos starten →