MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection
IEEE Transactions on Affective Computing · 2024-07 · 15 (3) · 1078-1089
DOI: 10.1109/taffc.2023.3312263 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2024-07. Verfasst von Shiqing Zhang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 66-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Zhejiang Provincial National Science Foundation of China, Alibaba Group through Alibaba Research Fellow (ARF) Program.
Themen: Depression
Abstract (Originalsprache)
Deep learning based video depression analysis has been recently an interesting and challenging topic. Most of existing works focus on learning single-scale facial dynamics of participants for depression detection. Besides, they usually adopt expensive deep learning models with high computational complexity, resulting in difficulty in real-time clinical applications. To address these two issues, this work proposes a lightweight Multi-scale Temporal Difference Attention Networks (MTDAN) integrating the temporal difference and attention mechanism to model both short-term and long-term temporal facial behaviors for automated video depression detection. Initially, two simple yet effective sub-branches, i.e., a Short-term Temporal Difference Attention Network (ST-TDAN), and a Long-term Temporal Difference Attention Network (LT-TDAN), are designed to perform individually short-term and long-term depressive behavior modeling. Then, a simple Interactive Multi-head Attention Fusion (IMHAF) strategy is employed for integrating short-term and long-term spatiotemporal features, followed by a linear fully-collected layer for depression score prediction. Experiments on two public AVEC2013 and AVEC2014 datasets show that our proposed method not only achieves highly competitive performance to state-of-the-art methods, but also has much smaller computational complexity than them on video depression detection tasks.
Förderung
- National Natural Science Foundation of China
- Zhejiang Provincial National Science Foundation of China
- Alibaba Group through Alibaba Research Fellow (ARF) Program
Zitieren
APA
Zhang, S., Zhang, X., Zhao, X., Fang, J., Niu, M., Zhao, Z., Yu, J., & Tian, Q. (2024). MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection. IEEE Transactions on Affective Computing, 15(3), 1078-1089. https://doi.org/10.1109/taffc.2023.3312263
Vancouver
Zhang S, Zhang X, Zhao X, Fang J, Niu M, Zhao Z, et al. MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection. IEEE Transactions on Affective Computing. 2024;15(3):1078-1089. doi:10.1109/taffc.2023.3312263
BibTeX
@article{Zhang2024,
author = {Zhang, Shiqing and Zhang, Xingnan and Zhao, Xiaoming and Fang, Jiangxiong and Niu, Mingyue and Zhao, Ziping and Yu, Jun and Tian, Qi},
title = {MTDAN: A Lightweight Multi-Scale Temporal Difference Attention Networks for Automated Video Depression Detection},
journal = {IEEE Transactions on Affective Computing},
year = {2024},
volume = {15},
number = {3},
pages = {1078--1089},
doi = {10.1109/taffc.2023.3312263}
}
EUVIMED