Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition
Computational Intelligence · 2026-04 · 42 (2)
DOI: 10.1111/coin.70225 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Intelligence, online erschienen am 26.03.2026. Verfasst von Shuo Xiao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Sensor‐based Human Activity Recognition (HAR) has consistently remained a prominent research focus in domains such as human‐object interaction, health monitoring, and healthcare. In recent years, diverse deep learning models (DLM) such as CNN, LSTM, and Transformer have garnered significant interest from researchers as an effective solution for HAR. Nevertheless, a significant research gap persists: although most existing approaches primarily emphasize temporal dependency, they have not sufficiently explored two critical aspects—frequency domain features and spatial relationships among sensor axes. These elements can serve as natural data augmentation and provide complementary information that is crucial for distinguishing similar activities. Therefore, building upon previous work, we attempt to address this gap by strengthening the incorporation of frequency dependency and spatial information, proposing a more robust and accurate DLM for HAR—termed the Time‐Frequency Transformer (TF Transformer). TF Transformer performs shallow feature extraction by leveraging the time‐frequency dependency of sensor signals in the main channel. It then employs stacked Transformer encoders for deep feature modeling, and finally aggregates the time‐over‐sensor features extracted from the auxiliary channel to accomplish human activity recognition. Additionally, our network model integrates attention mechanism to assign weights to each sensor axis, enabling the accommodation of multimodal data and amplification of valuable information to enhance classification and recognition accuracy. Our method is evaluated on three publicly available datasets, namely PAMAP2, Opportunity, and Skoda, achieving Macro F1‐scores of 0.99, 0.73, and 0.96, respectively. Extensive experimental results demonstrate that, compared to state‐of‐the‐art approaches, our model exhibits higher accuracy and superior robustness.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Xiao, S., Deng, J., Fang, C., Tang, C., & Huang, Z. (2026). Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition. Computational Intelligence, 42(2). https://doi.org/10.1111/coin.70225
Vancouver
Xiao S, Deng J, Fang C, Tang C, Huang Z. Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition. Computational Intelligence. 2026;42(2). doi:10.1111/coin.70225
BibTeX
@article{Xiao2026,
author = {Xiao, Shuo and Deng, Jiukai and Fang, Changshuo and Tang, Chaogang and Huang, Zhenzhen},
title = {Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition},
journal = {Computational Intelligence},
year = {2026},
volume = {42},
number = {2},
doi = {10.1111/coin.70225}
}
EUVIMED