EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition

Ling Tong, Yang Li, Hao Cai, Hao Yan

Electronics Letters · 2026-01 · 62 (1)

DOI: 10.1049/ell2.70680 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics Letters, online erschienen am 30.07.2026. Verfasst von Ling Tong und 3 weiteren Autor:innen. Die Arbeit nennt 17 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Humanities and Social Science Fund of Ministry of Education of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal emotion recognition (MER) systems must balance competing learning objectives, namely classification, feature disentanglement and cross‐modal alignment, yet existing frameworks rely on manually tuned loss weights, limiting adaptability across diverse input conditions. To remedy this, we propose MER‐MTL, a multitask learning framework that integrates modality reconstruction as auxiliary tasks and adopts the homoscedastic uncertainty strategy to learn loss weights end‐to‐end. Experiments on CMU‐MOSI show that MER‐MTL achieves 43.29% seven‐class accuracy under aligned conditions, a statistically significant improvement over our DMD reimplementation (37.50%, = 0.009). Under unaligned conditions, MER‐MTL maintains its advantage (+5.22%, = 0.003). The uncertainty‐aware mechanism also reduces prediction variance by up to 48% across random seeds, demonstrating improved training stability. The source code is available at https://github.com/tangtangma/MER‐MTL .

Förderung

  • Humanities and Social Science Fund of Ministry of Education of China

Zitieren

APA

Tong, L., Li, Y., Cai, H., & Yan, H. (2026). Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition. Electronics Letters, 62(1). https://doi.org/10.1049/ell2.70680

Vancouver

Tong L, Li Y, Cai H, Yan H. Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition. Electronics Letters. 2026;62(1). doi:10.1049/ell2.70680

BibTeX
@article{Tong2026,
  author = {Tong, Ling and Li, Yang and Cai, Hao and Yan, Hao},
  title = {Adaptive Multitask Learning With Uncertainty‐Aware Loss Balancing for Multimodal Emotion Recognition},
  journal = {Electronics Letters},
  year = {2026},
  volume = {62},
  number = {1},
  doi = {10.1049/ell2.70680}
}
Kostenlos starten →