Visible and NIR microscopic hyperspectrum reconstruction from RGB images with deep convolutional neural networks
Optics Express · 29.01.2024 · 32 (3) · 4400
DOI: 10.1364/oe.510718 ↗Kurz gefasst
Fachartikel in der Zeitschrift Optics Express, online erschienen am 25.01.2024. Verfasst von Kunshen Feng und 9 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 27 Literaturangaben. Gefördert von: College Students Innovative and Entrepreneurial Training Program, Laboratory of Lingnan Modern Agriculture project, Overseas Expertise Introduction Project for Discipline Innovation.
Abstract (Originalsprache)
We investigate the microscopic hyperspectral reconstruction from RGB images with a deep convolutional neural network (DCNN) in this paper. Based on the microscopic hyperspectral imaging system, a homemade dataset consisted of microscopic hyperspectral and RGB image pairs is constructed. For considering the importance of spectral correlation between neighbor spectral bands in microscopic hyperspectrum reconstruction, the 2D convolution is replaced by 3D convolution in the DCNN framework, and a metric (weight factor) used to evaluate the performance reconstructed hyperspectrum is also introduced into the loss function used in training. The effects of the dimension of convolution kernel and the weight factor in the loss function on the performance of the reconstruction model are studied. The overall results indicate that our model can show better performance than the traditional models applied to reconstruct the hyperspectral images based on DCNN for the public and the homemade microscopic datasets. In addition, we furthermore explore the microscopic hyperspectrum reconstruction from RGB images in infrared region, and the results show that the model proposed in this paper has great potential to expand the reconstructed hyperspectrum wavelength range from the visible to near infrared bands.
Förderung
- College Students Innovative and Entrepreneurial Training Program
- Laboratory of Lingnan Modern Agriculture project
- Overseas Expertise Introduction Project for Discipline Innovation
- Basic and Applied Basic Research Foundation of Guangdong Province
- National Natural Science Foundation of China
- Special Project for Research and Development in Key areas of Guangdong Province
Zitieren
APA
Feng, K., Li, J., Li, M., Gao, S., Deng, W., Xu, H., Zhao, J., Lan, Y., Long, Y., & Deng, H. (2024). Visible and NIR microscopic hyperspectrum reconstruction from RGB images with deep convolutional neural networks. Optics Express, 32(3), 4400. https://doi.org/10.1364/oe.510718
Vancouver
Feng K, Li J, Li M, Gao S, Deng W, Xu H, et al. Visible and NIR microscopic hyperspectrum reconstruction from RGB images with deep convolutional neural networks. Optics Express. 2024;32(3):4400. doi:10.1364/oe.510718
BibTeX
@article{Feng2024,
author = {Feng, Kunshen and Li, Junfeng and Li, Ming and Gao, Shilong and Deng, Weiqi and Xu, Haitao and Zhao, Jing and Lan, Yubin and Long, Yongbing and Deng, Haidong},
title = {Visible and NIR microscopic hyperspectrum reconstruction from RGB images with deep convolutional neural networks},
journal = {Optics Express},
year = {2024},
volume = {32},
number = {3},
pages = {4400},
doi = {10.1364/oe.510718}
}
EUVIMED