Unsupervised Clustering and Supervised Machine Learning for Lightning Classification: Application to Identifying EIPs for Ground‐Based TGF Detection
Journal of Geophysical Research: Atmospheres · 16.05.2023 · 128 (9)
DOI: 10.1029/2022jd038369 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Geophysical Research: Atmospheres, online erschienen am 03.05.2023. Verfasst von Yunjiao Pu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 50 Literaturangaben.
Abstract (Originalsprache)
We developed a framework merging unsupervised and supervised machine learning to classify lightning radio signals, and applied it to the possible detection of terrestrial gamma‐ray flashes (TGFs). Recent studies have established a tight connection between energetic in‐cloud pulses (EIPs, >150 kA) and a subset of TGFs, enabling continuous and large‐scale ground‐based TGF detection. However, even with a high peak current threshold, it is time‐consuming to manually search for EIPs in a background of many non‐EIP events, and it becomes even more difficult when a lower peak current threshold is used. Machine learning classifiers are an effective tool. Beginning with unsupervised learning, spectral clustering is performed on the low‐dimensional features extracted by an autoencoder from raw radio waveforms, showing that +EIPs naturally constitute a distinct class of waveform and 6%–7% of the total population. The clustering results are used to form a labeled data set (∼10,000 events) to further train supervised convolutional neural network (CNN) that targets for +EIPs. Our CNN models identify on average 95.2% of true +EIPs with accuracy up to 98.7%, representing a powerful tool for +EIP classification. The pretrained CNN classifier is further applied to identify lower peak current EIPs (LEIPs, >50 kA) from a larger data set (∼30,000 events). Among 10 LEIPs coincident with Fermi TGF observations, 2 previously reported TGFs and 2 unreported but suspected TGFs are found, while the majority are not associated with detectable TGFs. In addition, unsupervised clustering is found to reflect characteristics of the ionosphere reflection height and its effect on radio wave propagation.
Zitieren
APA
Pu, Y., Cummer, S. A., Lyu, F., Zheng, Y., Briggs, M. S., Lesage, S., Mailyan, B., & Roberts, O. J. (2023). Unsupervised Clustering and Supervised Machine Learning for Lightning Classification: Application to Identifying EIPs for Ground‐Based TGF Detection. Journal of Geophysical Research: Atmospheres, 128(9). https://doi.org/10.1029/2022jd038369
Vancouver
Pu Y, Cummer SA, Lyu F, Zheng Y, Briggs MS, Lesage S, et al. Unsupervised Clustering and Supervised Machine Learning for Lightning Classification: Application to Identifying EIPs for Ground‐Based TGF Detection. Journal of Geophysical Research: Atmospheres. 2023;128(9). doi:10.1029/2022jd038369
BibTeX
@article{Pu2023,
author = {Pu, Yunjiao and Cummer, Steven A. and Lyu, Fanchao and Zheng, Yu and Briggs, Michael S. and Lesage, Stephen and Mailyan, Bagrat and Roberts, Oliver J.},
title = {Unsupervised Clustering and Supervised Machine Learning for Lightning Classification: Application to Identifying EIPs for Ground‐Based TGF Detection},
journal = {Journal of Geophysical Research: Atmospheres},
year = {2023},
volume = {128},
number = {9},
doi = {10.1029/2022jd038369}
}
EUVIMED