EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

VMEMSTNet: Thermodynamics-Inspired Cross-Modal Translation for Robust Ultra-Low-Resolution Thermal Recognition

Yonghan Dai, Suoyang Zhang, Yue Fei, Huimin Zhang, Nan Zhang, Xiaofeng Zhou

AI for Engineering · 2026

DOI: 10.3390/aieng1030012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AI for Engineering, 2026. Verfasst von Yonghan Dai und 5 weiteren Autor:innen. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Shanghai, National Key R&D Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Ultra-low-resolution (ULR) thermal array sensors (e.g., 8×8) offer a privacy-preserving and cost-effective paradigm for intelligent edge perception. However, extracting robust spatial features is severely hindered by extreme spatial aliasing, background thermal interference, and environmental temperature drift. In this paper, we propose VMEMSTNet, an ultra-lightweight framework that tackles the ULR perception bottleneck through a thermodynamics-inspired cross-modal learning strategy. Rather than treating ULR recognition purely as a computer vision task, our approach integrates the underlying sensing physics. To bridge the resolution gap, we leverage a high-resolution visual modality strictly as offline cross-modal guidance. Specifically, a YOLOv8n-seg teacher provides spatial shape priors via Gaussian thermal diffusion—explicitly mimicking physical heat dissipation for spatial knowledge translation—while a MobileNetV2 teacher guides semantic probability distillation. Furthermore, a thermodynamics-inspired preprocessing pipeline fuses dynamic quantile-based normalization with absolute temperature difference (ΔT) to maintain contrast consistency across environmental drifts. Using hand gesture recognition as a representative spatial classification task, experimental results demonstrate that VMEMSTNet achieves 95.7% accuracy. Remarkably, it outperforms heavier generic edge models while utilizing only 20.0 k parameters and 0.135 MFLOPs. By effectively decoupling spatial semantics from thermodynamic noise, this work establishes a robust, hardware-aware deployment pathway for ULR thermal perception on resource-constrained microcontrollers.

Förderung

  • Natural Science Foundation of Shanghai
  • National Key R&D Program of China

Zitieren

APA

Dai, Y., Zhang, S., Fei, Y., Zhang, H., Zhang, N., & Zhou, X. (2026). VMEMSTNet: Thermodynamics-Inspired Cross-Modal Translation for Robust Ultra-Low-Resolution Thermal Recognition. AI for Engineering. https://doi.org/10.3390/aieng1030012

Vancouver

Dai Y, Zhang S, Fei Y, Zhang H, Zhang N, Zhou X. VMEMSTNet: Thermodynamics-Inspired Cross-Modal Translation for Robust Ultra-Low-Resolution Thermal Recognition. AI for Engineering. 2026. doi:10.3390/aieng1030012

BibTeX
@article{Dai2026,
  author = {Dai, Yonghan and Zhang, Suoyang and Fei, Yue and Zhang, Huimin and Zhang, Nan and Zhou, Xiaofeng},
  title = {VMEMSTNet: Thermodynamics-Inspired Cross-Modal Translation for Robust Ultra-Low-Resolution Thermal Recognition},
  journal = {AI for Engineering},
  year = {2026},
  doi = {10.3390/aieng1030012}
}
Kostenlos starten →