EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Thermal-Guided Activity Gating for Multi-Modal Remote Physiological Measurement

Hafsa Iqbal, Muhammad Ammar Ul Hassan, Gabriel Costache, Joseph Lemley

IEEE Open Journal of the Computer Society · 2026 · 7 · 1607-1618

DOI: 10.1109/ojcs.2026.3738629 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Open Journal of the Computer Society, 2026. Verfasst von Hafsa Iqbal und 3 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Chips JU, Enterprise Ireland International Research Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote photoplethysmography (rPPG) enables physiological signal estimation from facial video but remains sensitive to various factors such as illumination variation, motion artifacts, and spatial indiscrimination, where non-skin regions contribute equally to learned features despite carrying no pulsatile information. We propose a multi-modal rPPG estimation framework that integrates RGB and thermal modalities and introduces an unsupervised ActivityGate spatial gating module that constructs a subject-specific thermal activity map to suppress non-skin activations before the temporal transformer encoder. The proposed framework is further extended to simultaneous heart rate (HR) and breathing rate (BR) estimation via task-specific heads supervised by scalar frequency losses without requiring ground-truth waveforms. Evaluated on iBVP and SIM1 public datasets, the proposed model outperforms existing RGBT methods by 75.3% in MAE, with the ActivityGate alone attaining 71.9% MAE improvement on iBVP and 13.8% (HR) and 61.0% (BR) MAE improvements on SIM1 over the gate-free baseline at a negligible parameter overhead of $+0.25\%$ for RGBT fusion, of which the ActivityGate itself contributes only 0.0006%.

Förderung

  • Chips JU
  • Enterprise Ireland International Research Fund

Zitieren

APA

Iqbal, H., Hassan, M. A. U., Costache, G., & Lemley, J. (2026). Thermal-Guided Activity Gating for Multi-Modal Remote Physiological Measurement. IEEE Open Journal of the Computer Society, 7, 1607-1618. https://doi.org/10.1109/ojcs.2026.3738629

Vancouver

Iqbal H, Hassan MAU, Costache G, Lemley J. Thermal-Guided Activity Gating for Multi-Modal Remote Physiological Measurement. IEEE Open Journal of the Computer Society. 2026;7:1607-1618. doi:10.1109/ojcs.2026.3738629

BibTeX
@article{Iqbal2026,
  author = {Iqbal, Hafsa and Hassan, Muhammad Ammar Ul and Costache, Gabriel and Lemley, Joseph},
  title = {Thermal-Guided Activity Gating for Multi-Modal Remote Physiological Measurement},
  journal = {IEEE Open Journal of the Computer Society},
  year = {2026},
  volume = {7},
  pages = {1607--1618},
  doi = {10.1109/ojcs.2026.3738629}
}
Kostenlos starten →