Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition
Electronics Letters · 2026-01 · 62 (1)
DOI: 10.1049/ell2.70680 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics Letters, online erschienen am 30.07.2026. Verfasst von Ling Tong und 3 weiteren Autor:innen. Die Arbeit nennt 17 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Humanities and Social Science Fund of Ministry of Education of China.
Abstract (Originalsprache)
Multimodal emotion recognition (MER) systems must balance competing learning objectives, namely classification, feature disentanglement and cross‐modal alignment, yet existing frameworks rely on manually tuned loss weights, limiting adaptability across diverse input conditions. To remedy this, we propose MER‐MTL, a multitask learning framework that integrates modality reconstruction as auxiliary tasks and adopts the homoscedastic uncertainty strategy to learn loss weights end‐to‐end. Experiments on CMU‐MOSI show that MER‐MTL achieves 43.29% seven‐class accuracy under aligned conditions, a statistically significant improvement over our DMD reimplementation (37.50%, = 0.009). Under unaligned conditions, MER‐MTL maintains its advantage (+5.22%, = 0.003). The uncertainty‐aware mechanism also reduces prediction variance by up to 48% across random seeds, demonstrating improved training stability. The source code is available at https://github.com/tangtangma/MER‐MTL .
Förderung
- Humanities and Social Science Fund of Ministry of Education of China
Zitieren
APA
Tong, L., Li, Y., Cai, H., & Yan, H. (2026). Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition. Electronics Letters, 62(1). https://doi.org/10.1049/ell2.70680
Vancouver
Tong L, Li Y, Cai H, Yan H. Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition. Electronics Letters. 2026;62(1). doi:10.1049/ell2.70680
BibTeX
@article{Tong2026,
author = {Tong, Ling and Li, Yang and Cai, Hao and Yan, Hao},
title = {Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition},
journal = {Electronics Letters},
year = {2026},
volume = {62},
number = {1},
doi = {10.1049/ell2.70680}
}
EUVIMED