EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SelfPAB: large-scale pre-training on accelerometer data for human activity recognition

Aleksej Logacjov, Sverre Herland, Astrid Ustad, Kerstin Bach

Applied Intelligence · 2024-03 · 54 (6) · 4545-4563

DOI: 10.1007/s10489-024-05322-3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Intelligence, online erschienen am 28.03.2024. Verfasst von Aleksej Logacjov und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NTNU Helse.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Annotating accelerometer-based physical activity data remains a challenging task, limiting the creation of robust supervised machine learning models due to the scarcity of large, labeled, free-living human activity recognition (HAR) datasets. Researchers are exploring self-supervised learning (SSL) as an alternative to relying solely on labeled data approaches. However, there has been limited exploration of the impact of large-scale, unlabeled datasets for SSL pre-training on downstream HAR performance, particularly utilizing more than one accelerometer. To address this gap, a transformer encoder network is pre-trained on various amounts of unlabeled, dual-accelerometer data from the HUNT4 dataset: 10, 100, 1k, 10k, and 100k hours. The objective is to reconstruct masked segments of signal spectrograms. This pre-trained model, termed SelfPAB, serves as a feature extractor for downstream supervised HAR training across five datasets (HARTH, HAR70+, PAMAP2, Opportunity, and RealWorld). SelfPAB outperforms purely supervised baselines and other SSL methods, demonstrating notable enhancements, especially for activities with limited training data. Results show that more pre-training data improves downstream HAR performance, with the 100k-hour model exhibiting the highest performance. It surpasses purely supervised baselines by absolute F1-score improvements of 7.1% (HARTH), 14% (HAR70+), and an average of 11.26% across the PAMAP2, Opportunity, and RealWorld datasets. Compared to related SSL methods, SelfPAB displays absolute F1-score enhancements of 10.4% (HARTH), 18.8% (HAR70+), and 16% (average across PAMAP2, Opportunity, RealWorld).

Förderung

  • NTNU Helse

Zitieren

APA

Logacjov, A., Herland, S., Ustad, A., & Bach, K. (2024). SelfPAB: large-scale pre-training on accelerometer data for human activity recognition. Applied Intelligence, 54(6), 4545-4563. https://doi.org/10.1007/s10489-024-05322-3

Vancouver

Logacjov A, Herland S, Ustad A, Bach K. SelfPAB: large-scale pre-training on accelerometer data for human activity recognition. Applied Intelligence. 2024;54(6):4545-4563. doi:10.1007/s10489-024-05322-3

BibTeX
@article{Logacjov2024,
  author = {Logacjov, Aleksej and Herland, Sverre and Ustad, Astrid and Bach, Kerstin},
  title = {SelfPAB: large-scale pre-training on accelerometer data for human activity recognition},
  journal = {Applied Intelligence},
  year = {2024},
  volume = {54},
  number = {6},
  pages = {4545--4563},
  doi = {10.1007/s10489-024-05322-3}
}
Kostenlos starten →