EUVIMEDEUVIMED entdecken
Crossref

GLF-STAF: A Global-Local-Facial Spatio-Temporal Attention Fusion Approach for Driver Emotion Recognition

Jingyuan Li, Lie Yang, Chen Lv, Yuan Chu, Yahui Liu

IEEE Transactions on Consumer Electronics · 2025-05 · 71 (2) · 3486-3497

DOI: 10.1109/tce.2025.3540321 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-05. Verfasst von Jingyuan Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 49 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Driver emotion recognition is crucial for improving human-vehicle interaction and driving safety. Existing studies often neglect the temporal dynamics of facial expressions and rarely consider combining global and local facial features. To address these limitations, this paper proposes a global-local-facial spatio-temporal attention fusion (GLF-STAF) approach for driver emotion recognition using video data. The method captures both global and local facial expression changes while integrating spatial and temporal facial features. The proposed framework comprises three key stages. First, global facial keypoints and local facial regions are extracted from consecutive video frames. To reduce redundant information and improve data discriminability, a multi-class joint spatial filter is applied to the extracted keypoints. Second, a spatio-temporal parallel framework is employed to effectively utilize both spatial and temporal features. Third, a gated fusion block is incorporated to dynamically integrate spatial and temporal information flows. Additionally, to enhance the data distinction among different emotion classes, an angular center loss function with an additive gap cost is designed. Experimental results demonstrate that the GLF-STAF approach achieves satisfactory performance in driver emotion recognition. This approach has the potential to enhance the capabilities of onboard driver monitoring systems, contributing to advancements in consumer electronics and in-vehicle technology.

Zitieren

APA

Li, J., Yang, L., Lv, C., Chu, Y., & Liu, Y. (2025). GLF-STAF: A Global-Local-Facial Spatio-Temporal Attention Fusion Approach for Driver Emotion Recognition. IEEE Transactions on Consumer Electronics, 71(2), 3486-3497. https://doi.org/10.1109/tce.2025.3540321

Vancouver

Li J, Yang L, Lv C, Chu Y, Liu Y. GLF-STAF: A Global-Local-Facial Spatio-Temporal Attention Fusion Approach for Driver Emotion Recognition. IEEE Transactions on Consumer Electronics. 2025;71(2):3486-3497. doi:10.1109/tce.2025.3540321

BibTeX
@article{Li2025,
  author = {Li, Jingyuan and Yang, Lie and Lv, Chen and Chu, Yuan and Liu, Yahui},
  title = {GLF-STAF: A Global-Local-Facial Spatio-Temporal Attention Fusion Approach for Driver Emotion Recognition},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2025},
  volume = {71},
  number = {2},
  pages = {3486--3497},
  doi = {10.1109/tce.2025.3540321}
}
Kostenlos starten →