EUVIMEDEUVIMED entdecken
Crossref

Harformer: a channel-separated embedding unsupervised model for sensor-based human activity recognition

Zhouyang Wang, Lingfei Mo, Yaojie Zhu

Measurement Science and Technology · 30.09.2025 · 36 (9) · 095702

DOI: 10.1088/1361-6501/ae03de ↗

Kurz gefasst

Fachartikel in der Zeitschrift Measurement Science and Technology, online erschienen am 17.09.2025. Verfasst von Zhouyang Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sensor-based human activity recognition (HAR) has garnered significant attention due to its wide range of applications, from healthcare to smart environments. Facing the challenge of difficult label collection in the HAR field, self-supervised learning has attracted significant attention due to its capability to extract features from data without relying on labels. Transformer-based models have achieved promising results in time-series tasks owing to their powerful performance. However, how to efficiently embed time-series data into tokens understandable by Transformer models remains a research-worthy problem. To reduce the parameters of the embedding layer in Transformer models and improve the feature extraction ability of the embedding layer for HAR data, in this paper, we propose Harformer, a novel unsupervised model that leverages a channel-separated mixed embedding (CSME) module and a patch-masking reconstruction strategy. The CSME module provides lightweight embeddings, significantly reducing computational complexity compared to traditional methods. By employing a reconstruction task as the unsupervised learning objective, Harformer effectively learns informative representations, achieving state-of-the-art performance on three public datasets: DSADS, PAMAP2, and MHEALTH. Experimental results demonstrate Harformer’s superiority over existing unsupervised models, with an average accuracy of 86.18% and an F 1 score of 85.21%. Fine-tuning experiments further underscore the robustness of the pre-trained encoder, maintaining competitive performance with as little as 10% labelled data. Ablation studies validate the effectiveness of the CSME module, which outperforms convolutional neural network- and fully connected network-based embeddings while requiring fewer parameters. Harformer not only advances the state-of-the-art in unsupervised HAR but also lays a foundation for incorporating its components into diverse Transformer-based architectures. Future work will explore the generalisability of the CSME module across different Transformer encoder variants and time-series tasks, further expanding its applicability.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Wang, Z., Mo, L., & Zhu, Y. (2025). Harformer: a channel-separated embedding unsupervised model for sensor-based human activity recognition. Measurement Science and Technology, 36(9), 095702. https://doi.org/10.1088/1361-6501/ae03de

Vancouver

Wang Z, Mo L, Zhu Y. Harformer: a channel-separated embedding unsupervised model for sensor-based human activity recognition. Measurement Science and Technology. 2025;36(9):095702. doi:10.1088/1361-6501/ae03de

BibTeX
@article{Wang2025,
  author = {Wang, Zhouyang and Mo, Lingfei and Zhu, Yaojie},
  title = {Harformer: a channel-separated embedding unsupervised model for sensor-based human activity recognition},
  journal = {Measurement Science and Technology},
  year = {2025},
  volume = {36},
  number = {9},
  pages = {095702},
  doi = {10.1088/1361-6501/ae03de}
}
Kostenlos starten →