EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Insect Sound Classification Using Dual-Tower Network: A Fusion of Temporal and Spectral Feature Perception

Hangfei He, Junyang Chen, Hongkun Chen, Borui Zeng, Yutong Huang, Yudan Zhaopeng, Xiaoyan Chen

Applied Sciences · 08.04.2024 · 14 (7) · 3116

DOI: 10.3390/app14073116 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 08.04.2024. Verfasst von Hangfei He und 6 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National College Student Innovation Training Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the modern field of biological pest control, especially in the realm of insect population monitoring, deep learning methods have made further advancements. However, due to the small size and elusive nature of insects, visual detection is often impractical. In this context, the recognition of insect sound features becomes crucial. In our study, we introduce a classification module called the “dual-frequency and spectral fusion module (DFSM)”, which enhances the performance of transfer learning models in audio classification tasks. Our approach combines the efficiency of EfficientNet with the hierarchical design of the Dual Towers, drawing inspiration from the way the insect neural system processes sound signals. This enables our model to effectively capture spectral features in insect sounds and form multiscale perceptions through inter-tower skip connections. Through detailed qualitative and quantitative evaluations, as well as comparisons with leading traditional insect sound recognition methods, we demonstrate the advantages of our approach in the field of insect sound classification. Our method achieves an accuracy of 80.26% on InsectSet32, surpassing existing state-of-the-art models by 3 percentage points. Additionally, we conducted generalization experiments using three classic audio datasets. The results indicate that DFSM exhibits strong robustness and wide applicability, with minimal performance variations even when handling different input features.

Förderung

  • National College Student Innovation Training Program of China

Zitieren

APA

He, H., Chen, J., Chen, H., Zeng, B., Huang, Y., Zhaopeng, Y., & Chen, X. (2024). Enhancing Insect Sound Classification Using Dual-Tower Network: A Fusion of Temporal and Spectral Feature Perception. Applied Sciences, 14(7), 3116. https://doi.org/10.3390/app14073116

Vancouver

He H, Chen J, Chen H, Zeng B, Huang Y, Zhaopeng Y, et al. Enhancing Insect Sound Classification Using Dual-Tower Network: A Fusion of Temporal and Spectral Feature Perception. Applied Sciences. 2024;14(7):3116. doi:10.3390/app14073116

BibTeX
@article{He2024,
  author = {He, Hangfei and Chen, Junyang and Chen, Hongkun and Zeng, Borui and Huang, Yutong and Zhaopeng, Yudan and Chen, Xiaoyan},
  title = {Enhancing Insect Sound Classification Using Dual-Tower Network: A Fusion of Temporal and Spectral Feature Perception},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {7},
  pages = {3116},
  doi = {10.3390/app14073116}
}
Kostenlos starten →