EUVIMEDEUVIMED entdecken
Crossref

Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition

Shuo Xiao, Jiukai Deng, Changshuo Fang, Chaogang Tang, Zhenzhen Huang

Computational Intelligence · 2026-04 · 42 (2)

DOI: 10.1111/coin.70225 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Intelligence, online erschienen am 26.03.2026. Verfasst von Shuo Xiao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sensor‐based Human Activity Recognition (HAR) has consistently remained a prominent research focus in domains such as human‐object interaction, health monitoring, and healthcare. In recent years, diverse deep learning models (DLM) such as CNN, LSTM, and Transformer have garnered significant interest from researchers as an effective solution for HAR. Nevertheless, a significant research gap persists: although most existing approaches primarily emphasize temporal dependency, they have not sufficiently explored two critical aspects—frequency domain features and spatial relationships among sensor axes. These elements can serve as natural data augmentation and provide complementary information that is crucial for distinguishing similar activities. Therefore, building upon previous work, we attempt to address this gap by strengthening the incorporation of frequency dependency and spatial information, proposing a more robust and accurate DLM for HAR—termed the Time‐Frequency Transformer (TF Transformer). TF Transformer performs shallow feature extraction by leveraging the time‐frequency dependency of sensor signals in the main channel. It then employs stacked Transformer encoders for deep feature modeling, and finally aggregates the time‐over‐sensor features extracted from the auxiliary channel to accomplish human activity recognition. Additionally, our network model integrates attention mechanism to assign weights to each sensor axis, enabling the accommodation of multimodal data and amplification of valuable information to enhance classification and recognition accuracy. Our method is evaluated on three publicly available datasets, namely PAMAP2, Opportunity, and Skoda, achieving Macro F1‐scores of 0.99, 0.73, and 0.96, respectively. Extensive experimental results demonstrate that, compared to state‐of‐the‐art approaches, our model exhibits higher accuracy and superior robustness.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Xiao, S., Deng, J., Fang, C., Tang, C., & Huang, Z. (2026). Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition. Computational Intelligence, 42(2). https://doi.org/10.1111/coin.70225

Vancouver

Xiao S, Deng J, Fang C, Tang C, Huang Z. Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition. Computational Intelligence. 2026;42(2). doi:10.1111/coin.70225

BibTeX
@article{Xiao2026,
  author = {Xiao, Shuo and Deng, Jiukai and Fang, Changshuo and Tang, Chaogang and Huang, Zhenzhen},
  title = {Time‐Frequency Transformer: A Network for Sensor‐Based Human Activity Recognition},
  journal = {Computational Intelligence},
  year = {2026},
  volume = {42},
  number = {2},
  doi = {10.1111/coin.70225}
}
Kostenlos starten →