EUVIMEDEUVIMED entdecken
Crossref

Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos

Jianwei Li, Zitong Yu, Jingang Shi

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (1) · 1334-1342

DOI: 10.1609/aaai.v37i1.25217 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Jianwei Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote photoplethysmography (rPPG) enables non-contact heart rate (HR) estimation from facial videos which gives significant convenience compared with traditional contact-based measurements. In the real-world long-term health monitoring scenario, the distance of the participants and their head movements usually vary by time, resulting in the inaccurate rPPG measurement due to the varying face resolution and complex motion artifacts. Different from the previous rPPG models designed for a constant distance between camera and participants, in this paper, we propose two plug-and-play blocks (i.e., physiological signal feature extraction block (PFE) and temporal face alignment block (TFA)) to alleviate the degradation of changing distance and head motion. On one side, guided with representative-area information, PFE adaptively encodes the arbitrary resolution facial frames to the fixed-resolution facial structure features. On the other side, leveraging the estimated optical flow, TFA is able to counteract the rPPG signal confusion caused by the head movement thus benefit the motion-robust rPPG signal recovery. Besides, we also train the model with a cross-resolution constraint using a two-stream dual-resolution framework, which further helps PFE learn resolution-robust facial rPPG features. Extensive experiments on three benchmark datasets (UBFC-rPPG, COHFACE and PURE) demonstrate the superior performance of the proposed method. One highlight is that with PFE and TFA, the off-the-shelf spatio-temporal rPPG models can predict more robust rPPG signals under both varying face resolution and severe head movement scenarios. The codes are available at https://github.com/LJWGIT/Arbitrary_Resolution_rPPG.

Zitieren

APA

Li, J., Yu, Z., & Shi, J. (2023). Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos. Proceedings of the AAAI Conference on Artificial Intelligence, 37(1), 1334-1342. https://doi.org/10.1609/aaai.v37i1.25217

Vancouver

Li J, Yu Z, Shi J. Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(1):1334-1342. doi:10.1609/aaai.v37i1.25217

BibTeX
@article{Li2023,
  author = {Li, Jianwei and Yu, Zitong and Shi, Jingang},
  title = {Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {1},
  pages = {1334--1342},
  doi = {10.1609/aaai.v37i1.25217}
}
Kostenlos starten →