A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder
Sensors · 2023
DOI: 10.3390/s23198099 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Shaokai Zhang und 5 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronics and Information Engineering, Sichuan University, Chengdu 610041, China. Hauptthemen laut MEDLINE: Ecosystem, Recognition, Psychology. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Institutes of the National Natural Science Foundation of China, Key Research and Development Program of Sichuan, National Natural Science Foundation of China.
Abstract (Originalsprache)
Birds play a vital role in the study of ecosystems and biodiversity. Accurate bird identification helps monitor biodiversity, understand the functions of ecosystems, and develop effective conservation strategies. However, previous bird sound recognition methods often relied on single features and overlooked the spatial information associated with these features, leading to low accuracy. Recognizing this gap, the present study proposed a bird sound recognition method that employs multiple convolutional neural-based networks and a transformer encoder to provide a reliable solution for identifying and classifying birds based on their unique sounds. We manually extracted various acoustic features as model inputs, and feature fusion was applied to obtain the final set of feature vectors. Feature fusion combines the deep features extracted by various networks, resulting in a more comprehensive feature set, thereby improving recognition accuracy. The multiple integrated acoustic features, such as mel frequency cepstral coefficients (MFCC), chroma features (Chroma) and Tonnetz features, were encoded by a transformer encoder. The transformer encoder effectively extracted the positional relationships between bird sound features, resulting in enhanced recognition accuracy. The experimental results demonstrated the exceptional performance of our method with an accuracy of 97.99%, a recall of 96.14%, an F1 score of 96.88% and a precision of 97.97% on the Birdsdata dataset. Furthermore, our method achieved an accuracy of 93.18%, a recall of 92.43%, an F1 score of 93.14% and a precision of 93.25% on the Cornell Bird Challenge 2020 (CBC) dataset.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Electronics and Information Engineering, Sichuan University, Chengdu 610041, China.
- College of Computer Science, Sichuan University, Chengdu 610041, China.
ORCID-Profile: Yuan Gao, Qijun Zhao, Fan Pan
Förderung
- National Institutes of the National Natural Science Foundation of China
- Key Research and Development Program of Sichuan
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Zhang, S., Gao, Y., Cai, J., Yang, H., Zhao, Q., & Pan, F. (2023). A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder. Sensors. https://doi.org/10.3390/s23198099
Vancouver
Zhang S, Gao Y, Cai J, Yang H, Zhao Q, Pan F. A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder. Sensors. 2023. doi:10.3390/s23198099
BibTeX
@article{Zhang2023,
author = {Zhang, Shaokai and Gao, Yuan and Cai, Jianmin and Yang, Hangxiao and Zhao, Qijun and Pan, Fan},
title = {A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23198099}
}
EUVIMED