Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer
Sensors · 29.11.2024 · 24 (23) · 7658
DOI: 10.3390/s24237658 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 29.11.2024. Verfasst von Zi Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, Ch…. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Commission of Shanghai Municipality Technology Plan Project; Preliminary Research Project on Civil Aerospace Technology; National Key Re…, Science and Technology Commission of Shanghai Municipality Technology Plan Project, Preliminary Research Project on Civil Aerospace Technology.
Abstract (Originalsprache)
Long-wave infrared (LWIR) spectral imaging plays a critical role in various applications such as gas monitoring, mineral exploration, and fire detection. Recent advancements in computational spectral imaging, powered by advanced algorithms, have enabled the acquisition of high-quality spectral images in real time, such as with the Uncooled Snapshot Infrared Spectrometer (USIRS). However, the USIRS system faces challenges, particularly a low spectral resolution and large amount of data noise, which can degrade the image quality. Deep learning has emerged as a promising solution to these challenges, as it is particularly effective at handling noisy data and has demonstrated significant success in hyperspectral imaging tasks. Nevertheless, the application of deep learning in LWIR imaging is hindered by the severe scarcity of long-wave hyperspectral image data, which limits the training of robust models. Moreover, existing networks that rely on convolutional layers or attention mechanisms struggle to effectively capture both local and global spectral correlations. To address these limitations, we propose the pixel-based Hierarchical Spectral Transformer (HST), a novel deep learning architecture that learns from publicly available single-pixel long-wave infrared spectral databases. The HST is designed to achieve a high spectral resolution for LWIR spectral image reconstruction, enhancing both the local and global contextual understanding of the spectral data. We evaluated the performance of the proposed method on both simulated and real-world LWIR data, demonstrating the robustness and effectiveness of the HST in improving the spectral resolution and mitigating noise, even with limited data.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China.
- University of Chinese Academy of Sciences, Beijing 100049, China.
- School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China.
- Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, China.
ORCID-Profile: Zi Wang, Liyin Yuan, Chunlai Li, Jianyu Wang
Förderung
- Science and Technology Commission of Shanghai Municipality Technology Plan Project; Preliminary Research Project on Civil Aerospace Technology; National Key Re…
- Science and Technology Commission of Shanghai Municipality Technology Plan Project
- Preliminary Research Project on Civil Aerospace Technology
- National Key Research and Development Program of China
Zitieren
APA
Wang, Z., Yang, Y., Yuan, L., Li, C., & Wang, J. (2024). Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer. Sensors, 24(23), 7658. https://doi.org/10.3390/s24237658
Vancouver
Wang Z, Yang Y, Yuan L, Li C, Wang J. Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer. Sensors. 2024;24(23):7658. doi:10.3390/s24237658
BibTeX
@article{Wang2024,
author = {Wang, Zi and Yang, Yang and Yuan, Liyin and Li, Chunlai and Wang, Jianyu},
title = {Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer},
journal = {Sensors},
year = {2024},
volume = {24},
number = {23},
pages = {7658},
doi = {10.3390/s24237658}
}
EUVIMED