EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dimensional Emotion-Guided Conditional Modulation for Context-Aware Multimodal Driver Affect Recognition

Wei Shen, Xingang Mou, Jing Yi, Songqing Le

Applied Sciences · 28.04.2026 · 16 (9) · 4312

DOI: 10.3390/app16094312 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 28.04.2026. Verfasst von Wei Shen und 3 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Major Science and Technology Project of Guangxi.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Driver emotion recognition constitutes a fundamental pillar of intelligent cockpit systems, playing a pivotal role in enhancing driving safety and optimizing human–machine interaction. Despite the integration of vehicle sensor data in recent multimodal approaches, conventional fusion paradigms frequently encounter performance degradation due to the inherent noise and weak semantic correlation between vehicle telemetry and emotional states. To address these challenges, this study introduces a Dimensional Emotion-Guided Multi-task (DEGM) framework, a novel architecture designed to explicitly formalize the asymmetric roles of visual and vehicular modalities. Rather than employing simplistic feature concatenation, the proposed method maps multivariate vehicle data into a continuous Valence–Arousal–Dominance (VAD) space to characterize latent emotional tendencies within specific driving contexts. These predicted dimensions subsequently serve as semantic priors to conditionally modulate global facial representations through a Feature-wise Linear Modulation (FiLM) mechanism, facilitating robust and interpretable cross-modal interaction. Furthermore, the framework adopts a multi-task learning strategy that jointly optimizes discrete emotion classification and continuous dimension regression, leveraging the latter as a structural regularizer to refine the latent feature space. Comprehensive evaluations on the public PPB driving emotion dataset demonstrate that the proposed DEGM achieves a competitive accuracy of 87.50% and a weighted F1-score of 0.8727. The results validate that our framework provides a lightweight and robust paradigm for context-aware affect sensing, demonstrating strong potential for practical deployment in intelligent transportation systems.

Förderung

  • Major Science and Technology Project of Guangxi

Zitieren

APA

Shen, W., Mou, X., Yi, J., & Le, S. (2026). Dimensional Emotion-Guided Conditional Modulation for Context-Aware Multimodal Driver Affect Recognition. Applied Sciences, 16(9), 4312. https://doi.org/10.3390/app16094312

Vancouver

Shen W, Mou X, Yi J, Le S. Dimensional Emotion-Guided Conditional Modulation for Context-Aware Multimodal Driver Affect Recognition. Applied Sciences. 2026;16(9):4312. doi:10.3390/app16094312

BibTeX
@article{Shen2026,
  author = {Shen, Wei and Mou, Xingang and Yi, Jing and Le, Songqing},
  title = {Dimensional Emotion-Guided Conditional Modulation for Context-Aware Multimodal Driver Affect Recognition},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {9},
  pages = {4312},
  doi = {10.3390/app16094312}
}
Kostenlos starten →