EUVIMEDEUVIMED entdecken
Crossref

PhysMLE: Generalizable and Priors-Inclusive Multi-Task Remote Physiological Measurement

Jiyao Wang, Hao Lu, Ange Wang, Xiao Yang, Yingcong Chen, Dengbo He, Kaishun Wu

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-06 · 47 (6) · 4908-4925

DOI: 10.1109/tpami.2025.3545598 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-06. Verfasst von Jiyao Wang und 6 weiteren Autor:innen. Hauptthemen laut MEDLINE: Photoplethysmography, Signal Processing, Computer-Assisted, Remote Sensing Technology. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 93 Literaturangaben. Gefördert von: Natural Science Foundation of Guangdong Province of China, National Natural Science Foundation of China, Guangzhou Municipal Science and Technology Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote photoplethysmography (rPPG) has been widely applied to measure heart rate from face videos. To increase the generalizability of the algorithms, domain generalization (DG) attracted increasing attention in rPPG. However, when rPPG is extended to simultaneously measure more vital signs (e.g., respiration and blood oxygen saturation), achieving generalizability brings new challenges. Although partial features shared among different physiological signals can benefit multi-task learning, the sparse and imbalanced target label space brings the seesaw effect over task-specific feature learning. To resolve this problem, we designed an end-to-end Mixture of Low-rank Experts for multi-task remote Physiological measurement (PhysMLE), which is based on multiple low-rank experts with a novel router mechanism, thereby enabling the model to adeptly handle both specifications and correlations within tasks. Additionally, we introduced prior knowledge from physiology among tasks to overcome the imbalance of label space under real-world multi-task physiological measurement. For fair and comprehensive evaluations, this paper proposed a large-scale multi-task generalization benchmark, named Multi-Source Synsemantic Domain Generalization (MSSDG) protocol. Extensive experiments with MSSDG and intra-dataset have shown the effectiveness and efficiency of PhysMLE. In addition, a new dataset was collected and made publicly available to meet the needs of the MSSDG. The code and data are available at https://github.com/WJULYW/PhysMLE.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PhotoplethysmographySignal Processing, Computer-AssistedRemote Sensing TechnologyHumansAlgorithmsHeart RateMachine Learning

Förderung

  • Natural Science Foundation of Guangdong Province of China
  • National Natural Science Foundation of China
  • Guangzhou Municipal Science and Technology Project
  • Guangdong Provincial Key Lab of Integrated Communication, Sensing and Computation for Ubiquitous Internet of Things

Zitieren

APA

Wang, J., Lu, H., Wang, A., Yang, X., Chen, Y., He, D., & Wu, K. (2025). PhysMLE: Generalizable and Priors-Inclusive Multi-Task Remote Physiological Measurement. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(6), 4908-4925. https://doi.org/10.1109/tpami.2025.3545598

Vancouver

Wang J, Lu H, Wang A, Yang X, Chen Y, He D, et al. PhysMLE: Generalizable and Priors-Inclusive Multi-Task Remote Physiological Measurement. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(6):4908-4925. doi:10.1109/tpami.2025.3545598

BibTeX
@article{Wang2025,
  author = {Wang, Jiyao and Lu, Hao and Wang, Ange and Yang, Xiao and Chen, Yingcong and He, Dengbo and Wu, Kaishun},
  title = {PhysMLE: Generalizable and Priors-Inclusive Multi-Task Remote Physiological Measurement},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {6},
  pages = {4908--4925},
  doi = {10.1109/tpami.2025.3545598}
}
Kostenlos starten →