RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG
IEEE Transactions on Circuits and Systems for Video Technology · 2025-08 · 35 (8) · 7911-7924
DOI: 10.1109/tcsvt.2025.3544676 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-08. Verfasst von Marko Savic und 1 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Council of Finland Academy Professor Project EmotionAI, ICT 2023 Project TrustFace, University of Oulu and the Research Council of Finland Profi 7.
Abstract (Originalsprache)
Remote photoplethysmography (rPPG) uses RGB facial videos to measure cardiac signals. It holds promise for future applications in telemedicine, affective computing, liveness-based face anti-spoofing, driver monitoring, etc. Supervised deep learning methods have been leading in performance but are severely limited by data availability, as recording face videos with ground truth physiological signals is expensive. Recent self-supervised methods aim to solve the data issue but struggle to learn robust features from data in challenging scenarios. These scenarios are characterized by overwhelming environmental noise caused by head movements, illumination variations, and recording device changes. We propose RS+rPPG, a novel contrastive method that effectively leverages a large set of eleven rPPG priors, enabling strong self-supervision even with challenging data. RS+rPPG comprehensively exploits intra-data and inter-data information present in videos via diverse augmentations and learning constraints. We extensively experimented on seven rPPG datasets and demonstrated that RS+rPPG can outperform state-of-the-art supervised methods without using any labels. Additionally, we demonstrate the high generalization capability, demographic fairness, and mixed-data stability of our method.
Förderung
- Research Council of Finland Academy Professor Project EmotionAI
- ICT 2023 Project TrustFace
- University of Oulu and the Research Council of Finland Profi 7
- HORIZON-MSCA-SE-2022 Project ACMod
Zitieren
APA
Savic, M., & Zhao, G. (2025). RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG. IEEE Transactions on Circuits and Systems for Video Technology, 35(8), 7911-7924. https://doi.org/10.1109/tcsvt.2025.3544676
Vancouver
Savic M, Zhao G. RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(8):7911-7924. doi:10.1109/tcsvt.2025.3544676
BibTeX
@article{Savic2025,
author = {Savic, Marko and Zhao, Guoying},
title = {RS+rPPG: Robust Strongly Self-Supervised Learning for rPPG},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {8},
pages = {7911--7924},
doi = {10.1109/tcsvt.2025.3544676}
}
EUVIMED