EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Physical Activity Recognition Based on Deep Learning Using Photoplethysmography and Wearable Inertial Sensors

Narit Hnoohom, Sakorn Mekruksavanich, Anuchit Jitpattanakul

Electronics · 2023-01-30 · 12 (3) · 693

DOI: 10.3390/electronics12030693 ↗

At a glance

Journal article in Electronics, published online on 2023-01-30. Written by Narit Hnoohom and 2 co-authors. Cited 45 times so far (Crossref); 44 references. The full text is freely available (open access, CC BY 4.0). Funded by: Thammasat University Research fund under the TSRI, Thailand Science Research and Innovation Fund, University of Phayao.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Human activity recognition (HAR) extensively uses wearable inertial sensors since this data source provides the most information for non-visual datasets’ time series. HAR research has advanced significantly in recent years due to the proliferation of wearable devices with sensors. To improve recognition performance, HAR researchers have extensively investigated other sources of biosignals, such as a photoplethysmograph (PPG), for this task. PPG sensors measure the rate at which blood flows through the body, and this rate is regulated by the heart’s pumping action, which constantly occurs throughout the body. Even though detecting body movement and gestures was not initially the primary purpose of PPG signals, we propose an innovative method for extracting relevant features from the PPG signal and use deep learning (DL) to predict physical activities. To accomplish the purpose of our study, we developed a deep residual network referred to as PPG-NeXt, designed based on convolutional operation, shortcut connections, and aggregated multi-branch transformation to efficiently identify different types of daily life activities from the raw PPG signal. The proposed model achieved more than 90% prediction F1-score from experimental results using only PPG data on the three benchmark datasets. Moreover, our results indicate that combining PPG and acceleration signals can enhance activity recognition. Although, both biosignals—electrocardiography (ECG) and PPG—can differentiate between stationary activities (such as sitting) and non-stationary activities (such as cycling and walking) with a level of success that is considered sufficient. Overall, our results propose that combining features from the ECG signal can be helpful in situations where pure tri-axial acceleration (3D-ACC) models have trouble differentiating between activities with relative motion (e.g., walking, stair climbing) but significant differences in their heart rate signatures.

Funding

  • Thammasat University Research fund under the TSRI
  • Thailand Science Research and Innovation Fund
  • University of Phayao
  • National Science, Research and Innovation Fund (NSRF)
  • King Mongkut’s University of Technology North Bangkok

Cite

APA

Hnoohom, N., Mekruksavanich, S., & Jitpattanakul, A. (2023). Physical Activity Recognition Based on Deep Learning Using Photoplethysmography and Wearable Inertial Sensors. Electronics, 12(3), 693. https://doi.org/10.3390/electronics12030693

Vancouver

Hnoohom N, Mekruksavanich S, Jitpattanakul A. Physical Activity Recognition Based on Deep Learning Using Photoplethysmography and Wearable Inertial Sensors. Electronics. 2023;12(3):693. doi:10.3390/electronics12030693

BibTeX
@article{Hnoohom2023,
  author = {Hnoohom, Narit and Mekruksavanich, Sakorn and Jitpattanakul, Anuchit},
  title = {Physical Activity Recognition Based on Deep Learning Using Photoplethysmography and Wearable Inertial Sensors},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {3},
  pages = {693},
  doi = {10.3390/electronics12030693}
}
Start for free →