Channel Attention for Sensor-Based Activity Recognition: Embedding Features into all Frequencies in DCT Domain
IEEE Transactions on Knowledge and Data Engineering · 01.12.2023 · 35 (12) · 12497-12512
DOI: 10.1109/tkde.2023.3277839 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Knowledge and Data Engineering, erschienen am 01.12.2023. Verfasst von Shige Xu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 66-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Industry-Academia Cooperation Innovation Fund Projection of Jiangsu Province, Natural Science Foundation of Jiangsu Province.
Abstract (Originalsprache)
During recent years, channel attention has attracted great interest in deep learning community. Despite significant success, it has been rarely exploited in ubiquitous human activity recognition (HAR) scenario. To decrease computational overhead, the channel attention often uses global averaging pooling (GAP) to compress each channel into a simple scalar. It is well known that GAP is equal to the lowest frequency component. Despite obvious lightweight advantage, such compression process inevitably causes severe information loss. In this paper, we propose a novel multi-frequency channel attention framework for activity recognition tasks. Considering various sensing frequencies of human activities, an intuition solution is to convert the time series from time domain to frequency domain. Instead of GAP, the discrete cosine transform (DCT) is used to compress channels. We prove that GAP can be seen as a special case of DCT, which uses the lowest frequency component only and leaves out all other frequency components unused. DCT is able to better compress channels by fully exploiting other frequency components discarded by GAP. Despite multiple frequency components used, each channel will still be represented by a scalar in order to maintain the same computational overhead. Using two frequency screening criteria, our method is able to achieve state-of-the-art results on four benchmark HAR datasets. Extensive ablation studies are conducted, which provides a better interpretability of deep model behaviors. Finally, actual inference is evaluated on an embedded platform.
Förderung
- National Natural Science Foundation of China
- Industry-Academia Cooperation Innovation Fund Projection of Jiangsu Province
- Natural Science Foundation of Jiangsu Province
Zitieren
APA
Xu, S., Zhang, L., Tang, Y., Han, C., Wu, H., & Song, A. (2023). Channel Attention for Sensor-Based Activity Recognition: Embedding Features into all Frequencies in DCT Domain. IEEE Transactions on Knowledge and Data Engineering, 35(12), 12497-12512. https://doi.org/10.1109/tkde.2023.3277839
Vancouver
Xu S, Zhang L, Tang Y, Han C, Wu H, Song A. Channel Attention for Sensor-Based Activity Recognition: Embedding Features into all Frequencies in DCT Domain. IEEE Transactions on Knowledge and Data Engineering. 2023;35(12):12497-12512. doi:10.1109/tkde.2023.3277839
BibTeX
@article{Xu2023,
author = {Xu, Shige and Zhang, Lei and Tang, Yin and Han, Chaolei and Wu, Hao and Song, Aiguo},
title = {Channel Attention for Sensor-Based Activity Recognition: Embedding Features into all Frequencies in DCT Domain},
journal = {IEEE Transactions on Knowledge and Data Engineering},
year = {2023},
volume = {35},
number = {12},
pages = {12497--12512},
doi = {10.1109/tkde.2023.3277839}
}
EUVIMED