AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild
Animals · 09.07.2026 · 16 (14) · 2130
DOI: 10.3390/ani16142130 ↗Kurz gefasst
Fachartikel in der Zeitschrift Animals, online erschienen am 09.07.2026. Verfasst von Xiaodong Zhao und 2 weiteren Autor:innen. Beteiligte Einrichtung: Henan Forestry Information Engineering Technology Research Center, Henan Forestry Vocational College, Luoyang 471002, China. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2026 Henan Provincial University-Enterprise Collaborative Innovation Project, Open Fund of The Key Laboratory of Urban Ecological Environment Simulation and Protection, Ministry of Ecology and Environment of the People's Republic of China, 2026 Henan Provincial University–Enterprise Collaborative Innovation Project.
Abstract (Originalsprache)
Automated bird monitoring plays a crucial role in ecoinformatics and biodiversity conservation. Despite significant advancements in fine-grained visual classification, targets in complex wild environments frequently encounter interferences such as long capture distances, severe visual occlusion, and strong background noise, rendering single-modal perception highly susceptible to performance bottlenecks. To advance research in audiovisual multimodal bird classification, this paper introduces AVB81, a multimodal dataset tailored for fine-grained bird recognition. Covering 81 bird species in North America, the dataset comprises 3247 fixed-length 10 s field videos, meticulously supplemented with 5418 independent audios and 7083 high-quality static images. Based on this dataset, we systematically conduct single-modal performance evaluations and cross-paradigm audiovisual fusion experiments, establishing a comprehensive and in-depth multimodal evaluation benchmark. The experimental results demonstrate that in video classification tasks, audiovisual multimodal fusion methods significantly outperform single-modal baselines. Notably, the mid-fusion strategy based on deep semantic spaces achieves the optimal performance. Furthermore, the experiments objectively reveal the formidable challenges associated with audio recognition within videos captured in complex wild habitats. Overall, AVB81 exhibits exceptional adaptability for multimodal research, providing a highly challenging evaluation benchmark for multimodal semantic modeling in complex scenarios and laying a solid data foundation for the development and validation of next-generation intelligent ecological monitoring systems.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Henan Forestry Information Engineering Technology Research Center, Henan Forestry Vocational College, Luoyang 471002, China.
- Multimodal Eco Data Intelligence Analysis Laboratory, School of Technology, Beijing Forestry University, Beijing 100083, China.
- State Key Laboratory of Efficient Production of Forest Resources, Beijing Forestry University, Beijing 100083, China.
ORCID-Profile: Jiangjian Xie
Förderung
- 2026 Henan Provincial University-Enterprise Collaborative Innovation Project
- Open Fund of The Key Laboratory of Urban Ecological Environment Simulation and Protection, Ministry of Ecology and Environment of the People's Republic of China
- 2026 Henan Provincial University–Enterprise Collaborative Innovation Project
- Beijing Natural Science Foundation
- Open Fund of The Key Laboratory of Urban Ecological Environment Simulation and Protection, Ministry of Ecology and Environment of the People’s Republic of China
Zitieren
APA
Zhao, X., Xie, S., & Xie, J. (2026). AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild. Animals, 16(14), 2130. https://doi.org/10.3390/ani16142130
Vancouver
Zhao X, Xie S, Xie J. AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild. Animals. 2026;16(14):2130. doi:10.3390/ani16142130
BibTeX
@article{Zhao2026,
author = {Zhao, Xiaodong and Xie, Shanshan and Xie, Jiangjian},
title = {AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild},
journal = {Animals},
year = {2026},
volume = {16},
number = {14},
pages = {2130},
doi = {10.3390/ani16142130}
}
EUVIMED