SelfPAB: large-scale pre-training on accelerometer data for human activity recognition
Applied Intelligence · 2024-03 · 54 (6) · 4545-4563
DOI: 10.1007/s10489-024-05322-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Intelligence, online erschienen am 28.03.2024. Verfasst von Aleksej Logacjov und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NTNU Helse.
Abstract (Originalsprache)
Annotating accelerometer-based physical activity data remains a challenging task, limiting the creation of robust supervised machine learning models due to the scarcity of large, labeled, free-living human activity recognition (HAR) datasets. Researchers are exploring self-supervised learning (SSL) as an alternative to relying solely on labeled data approaches. However, there has been limited exploration of the impact of large-scale, unlabeled datasets for SSL pre-training on downstream HAR performance, particularly utilizing more than one accelerometer. To address this gap, a transformer encoder network is pre-trained on various amounts of unlabeled, dual-accelerometer data from the HUNT4 dataset: 10, 100, 1k, 10k, and 100k hours. The objective is to reconstruct masked segments of signal spectrograms. This pre-trained model, termed SelfPAB, serves as a feature extractor for downstream supervised HAR training across five datasets (HARTH, HAR70+, PAMAP2, Opportunity, and RealWorld). SelfPAB outperforms purely supervised baselines and other SSL methods, demonstrating notable enhancements, especially for activities with limited training data. Results show that more pre-training data improves downstream HAR performance, with the 100k-hour model exhibiting the highest performance. It surpasses purely supervised baselines by absolute F1-score improvements of 7.1% (HARTH), 14% (HAR70+), and an average of 11.26% across the PAMAP2, Opportunity, and RealWorld datasets. Compared to related SSL methods, SelfPAB displays absolute F1-score enhancements of 10.4% (HARTH), 18.8% (HAR70+), and 16% (average across PAMAP2, Opportunity, RealWorld).
Förderung
- NTNU Helse
Zitieren
APA
Logacjov, A., Herland, S., Ustad, A., & Bach, K. (2024). SelfPAB: large-scale pre-training on accelerometer data for human activity recognition. Applied Intelligence, 54(6), 4545-4563. https://doi.org/10.1007/s10489-024-05322-3
Vancouver
Logacjov A, Herland S, Ustad A, Bach K. SelfPAB: large-scale pre-training on accelerometer data for human activity recognition. Applied Intelligence. 2024;54(6):4545-4563. doi:10.1007/s10489-024-05322-3
BibTeX
@article{Logacjov2024,
author = {Logacjov, Aleksej and Herland, Sverre and Ustad, Astrid and Bach, Kerstin},
title = {SelfPAB: large-scale pre-training on accelerometer data for human activity recognition},
journal = {Applied Intelligence},
year = {2024},
volume = {54},
number = {6},
pages = {4545--4563},
doi = {10.1007/s10489-024-05322-3}
}
EUVIMED