EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder

Shaokai Zhang, Yuan Gao iD, Jianmin Cai, Hangxiao Yang, Qijun Zhao iD, Fan Pan iD

Sensors · 2023

DOI: 10.3390/s23198099 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Shaokai Zhang und 5 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronics and Information Engineering, Sichuan University, Chengdu 610041, China. Hauptthemen laut MEDLINE: Ecosystem, Recognition, Psychology. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Institutes of the National Natural Science Foundation of China, Key Research and Development Program of Sichuan, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Birds play a vital role in the study of ecosystems and biodiversity. Accurate bird identification helps monitor biodiversity, understand the functions of ecosystems, and develop effective conservation strategies. However, previous bird sound recognition methods often relied on single features and overlooked the spatial information associated with these features, leading to low accuracy. Recognizing this gap, the present study proposed a bird sound recognition method that employs multiple convolutional neural-based networks and a transformer encoder to provide a reliable solution for identifying and classifying birds based on their unique sounds. We manually extracted various acoustic features as model inputs, and feature fusion was applied to obtain the final set of feature vectors. Feature fusion combines the deep features extracted by various networks, resulting in a more comprehensive feature set, thereby improving recognition accuracy. The multiple integrated acoustic features, such as mel frequency cepstral coefficients (MFCC), chroma features (Chroma) and Tonnetz features, were encoded by a transformer encoder. The transformer encoder effectively extracted the positional relationships between bird sound features, resulting in enhanced recognition accuracy. The experimental results demonstrated the exceptional performance of our method with an accuracy of 97.99%, a recall of 96.14%, an F1 score of 96.88% and a precision of 97.97% on the Birdsdata dataset. Furthermore, our method achieved an accuracy of 93.18%, a recall of 92.43%, an F1 score of 93.14% and a precision of 93.25% on the Cornell Bird Challenge 2020 (CBC) dataset.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EcosystemRecognition, PsychologyAnimalsSoundAcousticsBirds

Stichwörter der Autor:innen

biodiversitybird sound recognitionfeature fusionmultiple acoustic features

Autor:innen und Institutionen

  • College of Electronics and Information Engineering, Sichuan University, Chengdu 610041, China.
  • College of Computer Science, Sichuan University, Chengdu 610041, China.

ORCID-Profile: Yuan Gao, Qijun Zhao, Fan Pan

Förderung

  • National Institutes of the National Natural Science Foundation of China
  • Key Research and Development Program of Sichuan
  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Zhang, S., Gao, Y., Cai, J., Yang, H., Zhao, Q., & Pan, F. (2023). A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder. Sensors. https://doi.org/10.3390/s23198099

Vancouver

Zhang S, Gao Y, Cai J, Yang H, Zhao Q, Pan F. A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder. Sensors. 2023. doi:10.3390/s23198099

BibTeX
@article{Zhang2023,
  author = {Zhang, Shaokai and Gao, Yuan and Cai, Jianmin and Yang, Hangxiao and Zhao, Qijun and Pan, Fan},
  title = {A Novel Bird Sound Recognition Method Based on Multifeature Fusion and a Transformer Encoder},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23198099}
}
Kostenlos starten →