Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera
Sensors · 2023
DOI: 10.3390/s23136079 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Wen-Nung Lie und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering, Center for Innovative Research on Aging Society (CIRAS), and Advanced Institute of Manufacturing with High-Tech…. Hauptthemen laut MEDLINE: Face, Algorithms. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education (MOE), Ministry of Science and Technology (MOST) in Taiwan.
Abstract (Originalsprache)
This paper presents an RGB-NIR (Near Infrared) dual-modality technique to analyze the remote photoplethysmogram (rPPG) signal and hence estimate the heart rate (in beats per minute), from a facial image sequence. Our main innovative contribution is the introduction of several denoising techniques such as Modified Amplitude Selective Filtering (MASF), Wavelet Decomposition (WD), and Robust Principal Component Analysis (RPCA), which take advantage of RGB and NIR band characteristics to uncover the rPPG signals effectively through this Independent Component Analysis (ICA)-based algorithm. Two datasets, of which one is the public PURE dataset and the other is the CCUHR dataset built with a popular Intel RealSense D435 RGB-D camera, are adopted in our experiments. Facial video sequences in the two datasets are diverse in nature with normal brightness, under-illumination (i.e., dark), and facial motion. Experimental results show that the proposed method has reached competitive accuracies among the state-of-the-art methods even at a shorter video length. For example, our method achieves MAE = 4.45 bpm (beats per minute) and RMSE = 6.18 bpm for RGB-NIR videos of 10 and 20 s in the CCUHR dataset and MAE = 3.24 bpm and RMSE = 4.1 bpm for RGB videos of 60-s in the PURE dataset. Our system has the advantages of accessible and affordable hardware, simple and fast computations, and wide realistic applications.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical Engineering, Center for Innovative Research on Aging Society (CIRAS), and Advanced Institute of Manufacturing with High-Tech Innovations (AIM-HI), National Chung Cheng University, Chia-Yi 621, T…
ORCID-Profile: Wen-Nung Lie, Chun-Yu Lai
Förderung
- Ministry of Education (MOE)
- Ministry of Science and Technology (MOST) in Taiwan
Zitieren
APA
Lie, W. N., Le, D. Q., Lai, C. Y., & Fang, Y. S. (2023). Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera. Sensors. https://doi.org/10.3390/s23136079
Vancouver
Lie WN, Le DQ, Lai CY, Fang YS. Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera. Sensors. 2023. doi:10.3390/s23136079
BibTeX
@article{Lie2023,
author = {Lie, Wen-Nung and Le, Dao-Quang and Lai, Chun-Yu and Fang, Yu-Shin},
title = {Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23136079}
}
EUVIMED