EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG

Marko Savic, Guoying Zhao

IEEE Transactions on Circuits and Systems for Video Technology · 2025-08 · 35 (8) · 7911-7924

DOI: 10.1109/tcsvt.2025.3544676 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-08. Verfasst von Marko Savic und 1 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Council of Finland Academy Professor Project EmotionAI, ICT 2023 Project TrustFace, University of Oulu and the Research Council of Finland Profi 7.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote photoplethysmography (rPPG) uses RGB facial videos to measure cardiac signals. It holds promise for future applications in telemedicine, affective computing, liveness-based face anti-spoofing, driver monitoring, etc. Supervised deep learning methods have been leading in performance but are severely limited by data availability, as recording face videos with ground truth physiological signals is expensive. Recent self-supervised methods aim to solve the data issue but struggle to learn robust features from data in challenging scenarios. These scenarios are characterized by overwhelming environmental noise caused by head movements, illumination variations, and recording device changes. We propose RS+rPPG, a novel contrastive method that effectively leverages a large set of eleven rPPG priors, enabling strong self-supervision even with challenging data. RS+rPPG comprehensively exploits intra-data and inter-data information present in videos via diverse augmentations and learning constraints. We extensively experimented on seven rPPG datasets and demonstrated that RS+rPPG can outperform state-of-the-art supervised methods without using any labels. Additionally, we demonstrate the high generalization capability, demographic fairness, and mixed-data stability of our method.

Förderung

  • Research Council of Finland Academy Professor Project EmotionAI
  • ICT 2023 Project TrustFace
  • University of Oulu and the Research Council of Finland Profi 7
  • HORIZON-MSCA-SE-2022 Project ACMod

Zitieren

APA

Savic, M., & Zhao, G. (2025). RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG. IEEE Transactions on Circuits and Systems for Video Technology, 35(8), 7911-7924. https://doi.org/10.1109/tcsvt.2025.3544676

Vancouver

Savic M, Zhao G. RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(8):7911-7924. doi:10.1109/tcsvt.2025.3544676

BibTeX
@article{Savic2025,
  author = {Savic, Marko and Zhao, Guoying},
  title = {RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2025},
  volume = {35},
  number = {8},
  pages = {7911--7924},
  doi = {10.1109/tcsvt.2025.3544676}
}
Kostenlos starten →