EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera

Wen-Nung Lie iD, Dao-Quang Le, Chun-Yu Lai iD, Yu-Shin Fang

Sensors · 2023

DOI: 10.3390/s23136079 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Wen-Nung Lie und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering, Center for Innovative Research on Aging Society (CIRAS), and Advanced Institute of Manufacturing with High-Tech…. Hauptthemen laut MEDLINE: Face, Algorithms. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education (MOE), Ministry of Science and Technology (MOST) in Taiwan.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents an RGB-NIR (Near Infrared) dual-modality technique to analyze the remote photoplethysmogram (rPPG) signal and hence estimate the heart rate (in beats per minute), from a facial image sequence. Our main innovative contribution is the introduction of several denoising techniques such as Modified Amplitude Selective Filtering (MASF), Wavelet Decomposition (WD), and Robust Principal Component Analysis (RPCA), which take advantage of RGB and NIR band characteristics to uncover the rPPG signals effectively through this Independent Component Analysis (ICA)-based algorithm. Two datasets, of which one is the public PURE dataset and the other is the CCUHR dataset built with a popular Intel RealSense D435 RGB-D camera, are adopted in our experiments. Facial video sequences in the two datasets are diverse in nature with normal brightness, under-illumination (i.e., dark), and facial motion. Experimental results show that the proposed method has reached competitive accuracies among the state-of-the-art methods even at a shorter video length. For example, our method achieves MAE = 4.45 bpm (beats per minute) and RMSE = 6.18 bpm for RGB-NIR videos of 10 and 20 s in the CCUHR dataset and MAE = 3.24 bpm and RMSE = 4.1 bpm for RGB videos of 60-s in the PURE dataset. Our system has the advantages of accessible and affordable hardware, simple and fast computations, and wide realistic applications.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FaceAlgorithmsHeart RateMotionLightingPhotoplethysmographySignal Processing, Computer-Assisted

Stichwörter der Autor:innen

RGB-NIR dual modalitiesfacial image sequenceheart rate estimationremote PPGrobust PCA

Autor:innen und Institutionen

  • Department of Electrical Engineering, Center for Innovative Research on Aging Society (CIRAS), and Advanced Institute of Manufacturing with High-Tech Innovations (AIM-HI), National Chung Cheng University, Chia-Yi 621, T…

ORCID-Profile: Wen-Nung Lie, Chun-Yu Lai

Förderung

  • Ministry of Education (MOE)
  • Ministry of Science and Technology (MOST) in Taiwan

Zitieren

APA

Lie, W. N., Le, D. Q., Lai, C. Y., & Fang, Y. S. (2023). Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera. Sensors. https://doi.org/10.3390/s23136079

Vancouver

Lie WN, Le DQ, Lai CY, Fang YS. Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera. Sensors. 2023. doi:10.3390/s23136079

BibTeX
@article{Lie2023,
  author = {Lie, Wen-Nung and Le, Dao-Quang and Lai, Chun-Yu and Fang, Yu-Shin},
  title = {Heart Rate Estimation from Facial Image Sequences of a Dual-Modality RGB-NIR Camera},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23136079}
}
Kostenlos starten →