EUVIMEDEUVIMED entdecken
Crossref

MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection

Shiqing Zhang, Xingnan Zhang, Xiaoming Zhao, Jiangxiong Fang, Mingyue Niu, Ziping Zhao, Jun Yu, Qi Tian

IEEE Transactions on Affective Computing · 2024-07 · 15 (3) · 1078-1089

DOI: 10.1109/taffc.2023.3312263 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2024-07. Verfasst von Shiqing Zhang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 66-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Zhejiang Provincial National Science Foundation of China, Alibaba Group through Alibaba Research Fellow (ARF) Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning based video depression analysis has been recently an interesting and challenging topic. Most of existing works focus on learning single-scale facial dynamics of participants for depression detection. Besides, they usually adopt expensive deep learning models with high computational complexity, resulting in difficulty in real-time clinical applications. To address these two issues, this work proposes a lightweight Multi-scale Temporal Difference Attention Networks (MTDAN) integrating the temporal difference and attention mechanism to model both short-term and long-term temporal facial behaviors for automated video depression detection. Initially, two simple yet effective sub-branches, i.e., a Short-term Temporal Difference Attention Network (ST-TDAN), and a Long-term Temporal Difference Attention Network (LT-TDAN), are designed to perform individually short-term and long-term depressive behavior modeling. Then, a simple Interactive Multi-head Attention Fusion (IMHAF) strategy is employed for integrating short-term and long-term spatiotemporal features, followed by a linear fully-collected layer for depression score prediction. Experiments on two public AVEC2013 and AVEC2014 datasets show that our proposed method not only achieves highly competitive performance to state-of-the-art methods, but also has much smaller computational complexity than them on video depression detection tasks.

Förderung

  • National Natural Science Foundation of China
  • Zhejiang Provincial National Science Foundation of China
  • Alibaba Group through Alibaba Research Fellow (ARF) Program

Zitieren

APA

Zhang, S., Zhang, X., Zhao, X., Fang, J., Niu, M., Zhao, Z., Yu, J., & Tian, Q. (2024). MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection. IEEE Transactions on Affective Computing, 15(3), 1078-1089. https://doi.org/10.1109/taffc.2023.3312263

Vancouver

Zhang S, Zhang X, Zhao X, Fang J, Niu M, Zhao Z, et al. MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection. IEEE Transactions on Affective Computing. 2024;15(3):1078-1089. doi:10.1109/taffc.2023.3312263

BibTeX
@article{Zhang2024,
  author = {Zhang, Shiqing and Zhang, Xingnan and Zhao, Xiaoming and Fang, Jiangxiong and Niu, Mingyue and Zhao, Ziping and Yu, Jun and Tian, Qi},
  title = {MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection},
  journal = {IEEE Transactions on Affective Computing},
  year = {2024},
  volume = {15},
  number = {3},
  pages = {1078--1089},
  doi = {10.1109/taffc.2023.3312263}
}
Kostenlos starten →