EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MDAR: A Multiscale Features-Based Network for Remotely Measuring Human Heart Rate Utilizing Dual-Branch Architecture and Alternating Frame Shifts in Facial Videos

Linhua Zhang iD, Jinchang Ren, Shuang Zhao, Peng Wu iD

Sensors · 2024

DOI: 10.3390/s24216791 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Linhua Zhang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Engineering, Taiyuan Institute of Technology, Taiyuan 030008, China. Hauptthemen laut MEDLINE: Heart Rate, Photoplethysmography, Face. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: General project of Key R & D Plan of Shanxi Province, high-technology field, General project of Key R & D Plan of Shanxi Province.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote photoplethysmography (rPPG) refers to a non-contact technique that measures heart rate through analyzing the subtle signal changes of facial blood flow captured by video sensors. It is widely used in contactless medical monitoring, remote health management, and activity monitoring, providing a more convenient and non-invasive way to monitor heart health. However, factors such as ambient light variations, facial movements, and differences in light absorption and reflection pose challenges to deep learning-based methods. To solve these difficulties, we put forward a measurement network of heart rate based on multiscale features. In this study, we designed and implemented a dual-branch signal processing framework that combines static and dynamic features, proposing a novel and efficient method for feature fusion, enhancing the robustness and reliability of the signal. Furthermore, we proposed an alternate time-shift module to enhance the model’s temporal depth. To integrate the features extracted at different scales, we utilized a multiscale feature fusion method, enabling the model to accurately capture subtle changes in blood flow. We conducted cross-validation on three public datasets: UBFC-rPPG, PURE, and MMPD. The results demonstrate that MDAR not only ensures fast inference speed but also significantly improves performance. The two main indicators, MAE and MAPE, achieved improvements of at least 30.6% and 30.2%, respectively, surpassing state-of-the-art methods. These conclusions highlight the potential advantages of MDAR for practical applications.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Heart RatePhotoplethysmographyFaceHumansSignal Processing, Computer-AssistedMonitoring, PhysiologicVideo RecordingDeep LearningAlgorithms

Stichwörter der Autor:innen

alternating frame shiftsdual-branch architecturemultiscale featuresrPPG

Autor:innen und Institutionen

  • Department of Computer Engineering, Taiyuan Institute of Technology, Taiyuan 030008, China.
  • School of Computer Science and Technology, Taiyuan Normal University, Jinzhong 030619, China.
  • School of Computing, Engineering and Technology, Robert Gordon University, Aberdeen AB10 7QB, UK.
  • School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044, China.

ORCID-Profile: Linhua Zhang, Peng Wu

Förderung

  • General project of Key R & D Plan of Shanxi Province, high-technology field
  • General project of Key R & D Plan of Shanxi Province

Zitieren

APA

Zhang, L., Ren, J., Zhao, S., & Wu, P. (2024). MDAR: A Multiscale Features-Based Network for Remotely Measuring Human Heart Rate Utilizing Dual-Branch Architecture and Alternating Frame Shifts in Facial Videos. Sensors. https://doi.org/10.3390/s24216791

Vancouver

Zhang L, Ren J, Zhao S, Wu P. MDAR: A Multiscale Features-Based Network for Remotely Measuring Human Heart Rate Utilizing Dual-Branch Architecture and Alternating Frame Shifts in Facial Videos. Sensors. 2024. doi:10.3390/s24216791

BibTeX
@article{Zhang2024,
  author = {Zhang, Linhua and Ren, Jinchang and Zhao, Shuang and Wu, Peng},
  title = {MDAR: A Multiscale Features-Based Network for Remotely Measuring Human Heart Rate Utilizing Dual-Branch Architecture and Alternating Frame Shifts in Facial Videos},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24216791}
}
Kostenlos starten →