EUVIMEDEUVIMED entdecken
Crossref

CodePhys: Robust Video-Based Remote Physiological Measurement Through Latent Codebook Querying

Shuyang Chu, Menghan Xia, Mengyao Yuan, Xin Liu, Tapio Seppanen, Guoying Zhao, Jingang Shi

IEEE Journal of Biomedical and Health Informatics · 2025-07 · 29 (7) · 4932-4945

DOI: 10.1109/jbhi.2025.3540134 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Journal of Biomedical and Health Informatics, 2025-07. Verfasst von Shuyang Chu und 6 weiteren Autor:innen. Hauptthemen laut MEDLINE: Photoplethysmography, Video Recording, Signal Processing, Computer-Assisted. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 77 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shaanxi Key Laboratory of Information Communication Network, Research Council of Finland.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote photoplethysmography (rPPG) aims to measure non-contact physiological signals from facial videos, which has shown great potential in many applications. Most existing methods directly extract video-based rPPG features by designing neural networks for heart rate estimation. Although they can achieve acceptable results, the recovery of rPPG signal faces intractable challenges when interference from real-world scenarios takes place on facial video. Specifically, facial videos are inevitably affected by non-physiological factors (e.g., camera device noise, defocus, and motion blur), leading to the distortion of extracted rPPG signals. Recent rPPG extraction methods are easily affected by interference and degradation, resulting in noisy rPPG signals. In this paper, we propose a novel method named CodePhys, which innovatively treats rPPG measurement as a code query task in a noise-free proxy space (i.e., codebook) constructed by ground-truth PPG signals. We consider noisy rPPG features as queries and generate high-fidelity rPPG features by matching them with noise-free PPG features from the codebook. Our approach also incorporates a spatial-aware encoder network with a spatial attention mechanism to highlight physiologically active areas and uses a distillation loss to reduce the influence of non-periodic visual interference. Experimental results on four benchmark datasets demonstrate that CodePhys outperforms state-of-the-art methods in both intra-dataset and cross-dataset settings.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PhotoplethysmographyVideo RecordingSignal Processing, Computer-AssistedHumansAlgorithmsFaceAdultMaleFemaleHeart RateYoung Adult

Förderung

  • National Natural Science Foundation of China
  • Shaanxi Key Laboratory of Information Communication Network
  • Research Council of Finland
  • Research Council of Finland Academy Professor project EmotionAI
  • University of Oulu and Research Council of Finland

Zitieren

APA

Chu, S., Xia, M., Yuan, M., Liu, X., Seppanen, T., Zhao, G., & Shi, J. (2025). CodePhys: Robust Video-Based Remote Physiological Measurement Through Latent Codebook Querying. IEEE Journal of Biomedical and Health Informatics, 29(7), 4932-4945. https://doi.org/10.1109/jbhi.2025.3540134

Vancouver

Chu S, Xia M, Yuan M, Liu X, Seppanen T, Zhao G, et al. CodePhys: Robust Video-Based Remote Physiological Measurement Through Latent Codebook Querying. IEEE Journal of Biomedical and Health Informatics. 2025;29(7):4932-4945. doi:10.1109/jbhi.2025.3540134

BibTeX
@article{Chu2025,
  author = {Chu, Shuyang and Xia, Menghan and Yuan, Mengyao and Liu, Xin and Seppanen, Tapio and Zhao, Guoying and Shi, Jingang},
  title = {CodePhys: Robust Video-Based Remote Physiological Measurement Through Latent Codebook Querying},
  journal = {IEEE Journal of Biomedical and Health Informatics},
  year = {2025},
  volume = {29},
  number = {7},
  pages = {4932--4945},
  doi = {10.1109/jbhi.2025.3540134}
}
Kostenlos starten →