Improving prediction model robustness with virtual sample construction for near-infrared spectra analysis
Analytica Chimica Acta · 2023-10 · 1279 · 341763
DOI: 10.1016/j.aca.2023.341763 ↗Kurz gefasst
Fachartikel in der Zeitschrift Analytica Chimica Acta, 2023-10. Verfasst von Yong Hao und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechatronics and Vehicle Engineering, East China Jiaotong University, Nanchang, 330013, China; Key Laboratory of Conveyance Equipment of th…. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Jiangxi Province.
Abstract (Originalsprache)
In a qualitative analysis of near-infrared spectroscopy (NIRS), when the samples to be analyzed are difficult to obtain or there are few counterexamples, the robustness of the models is poor, resulting in the decline of the generalization ability of the models. In this case, the effective method is to construct virtual samples to achieve the balance of categories. In this contribution, three virtual spectrum construction strategies including Synthetic Minority Oversampling Technique (SMOTE), Adaptive Synthetic Sampling (ADASYN), and Deep Convolutional Generative Adversarial Network (DCGAN) were explored to deal with the problem of insufficient or imbalanced sample numbers in NIRS analysis. The strategies were tested with the melamine and Yali pears two spectral datasets. The PLS-DA and Correct Recognition Rate (CRR) were used for discriminant model construction and accuracy evaluation, respectively. The results show that SMOTE, ADASYN, and DCGAN processing strategies can all improve the global CRR (CRRglob). The SMOTE and ADASYN can improve the CRR for majority class sample (CRRmaj), but the CRR for minority class sample (CRRmin) has decreased. For the DCGAN method, the CRRglob, CRRmaj, and CRRmin were all improved. The standard deviation of the results of the multiple parallel calculations demonstrates the robustness of DCGAN generation method. Therefore, the DCGAN method has good reliability and practicability, and can increase the robustness and generalization ability of the NIRS model.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechatronics and Vehicle Engineering, East China Jiaotong University, Nanchang, 330013, China; Key Laboratory of Conveyance Equipment of the Ministry of Education, Nanchang, 330013, China. Electronic address:…
- School of Mechatronics and Vehicle Engineering, East China Jiaotong University, Nanchang, 330013, China.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangxi Province
Zitieren
APA
Hao, Y., Li, X., & Zhang, C. (2023). Improving prediction model robustness with virtual sample construction for near-infrared spectra analysis. Analytica Chimica Acta, 1279, 341763. https://doi.org/10.1016/j.aca.2023.341763
Vancouver
Hao Y, Li X, Zhang C. Improving prediction model robustness with virtual sample construction for near-infrared spectra analysis. Analytica Chimica Acta. 2023;1279:341763. doi:10.1016/j.aca.2023.341763
BibTeX
@article{Hao2023,
author = {Hao, Yong and Li, Xiyan and Zhang, Chengxiang},
title = {Improving prediction model robustness with virtual sample construction for near-infrared spectra analysis},
journal = {Analytica Chimica Acta},
year = {2023},
volume = {1279},
pages = {341763},
doi = {10.1016/j.aca.2023.341763}
}
EUVIMED