EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild

Xiaodong Zhao, Shanshan Xie, Jiangjian Xie iD

Animals · 09.07.2026 · 16 (14) · 2130

DOI: 10.3390/ani16142130 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Animals, online erschienen am 09.07.2026. Verfasst von Xiaodong Zhao und 2 weiteren Autor:innen. Beteiligte Einrichtung: Henan Forestry Information Engineering Technology Research Center, Henan Forestry Vocational College, Luoyang 471002, China. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2026 Henan Provincial University-Enterprise Collaborative Innovation Project, Open Fund of The Key Laboratory of Urban Ecological Environment Simulation and Protection, Ministry of Ecology and Environment of the People's Republic of China, 2026 Henan Provincial University–Enterprise Collaborative Innovation Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated bird monitoring plays a crucial role in ecoinformatics and biodiversity conservation. Despite significant advancements in fine-grained visual classification, targets in complex wild environments frequently encounter interferences such as long capture distances, severe visual occlusion, and strong background noise, rendering single-modal perception highly susceptible to performance bottlenecks. To advance research in audiovisual multimodal bird classification, this paper introduces AVB81, a multimodal dataset tailored for fine-grained bird recognition. Covering 81 bird species in North America, the dataset comprises 3247 fixed-length 10 s field videos, meticulously supplemented with 5418 independent audios and 7083 high-quality static images. Based on this dataset, we systematically conduct single-modal performance evaluations and cross-paradigm audiovisual fusion experiments, establishing a comprehensive and in-depth multimodal evaluation benchmark. The experimental results demonstrate that in video classification tasks, audiovisual multimodal fusion methods significantly outperform single-modal baselines. Notably, the mid-fusion strategy based on deep semantic spaces achieves the optimal performance. Furthermore, the experiments objectively reveal the formidable challenges associated with audio recognition within videos captured in complex wild habitats. Overall, AVB81 exhibits exceptional adaptability for multimodal research, providing a highly challenging evaluation benchmark for multimodal semantic modeling in complex scenarios and laying a solid data foundation for the development and validation of next-generation intelligent ecological monitoring systems.

Schlagwörter

Stichwörter der Autor:innen

audiovisual fusionfine-grained bird classificationwildlife intelligent monitoring

Autor:innen und Institutionen

  • Henan Forestry Information Engineering Technology Research Center, Henan Forestry Vocational College, Luoyang 471002, China.
  • Multimodal Eco Data Intelligence Analysis Laboratory, School of Technology, Beijing Forestry University, Beijing 100083, China.
  • State Key Laboratory of Efficient Production of Forest Resources, Beijing Forestry University, Beijing 100083, China.

ORCID-Profile: Jiangjian Xie

Förderung

  • 2026 Henan Provincial University-Enterprise Collaborative Innovation Project
  • Open Fund of The Key Laboratory of Urban Ecological Environment Simulation and Protection, Ministry of Ecology and Environment of the People's Republic of China
  • 2026 Henan Provincial University–Enterprise Collaborative Innovation Project
  • Beijing Natural Science Foundation
  • Open Fund of The Key Laboratory of Urban Ecological Environment Simulation and Protection, Ministry of Ecology and Environment of the People’s Republic of China

Zitieren

APA

Zhao, X., Xie, S., & Xie, J. (2026). AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild. Animals, 16(14), 2130. https://doi.org/10.3390/ani16142130

Vancouver

Zhao X, Xie S, Xie J. AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild. Animals. 2026;16(14):2130. doi:10.3390/ani16142130

BibTeX
@article{Zhao2026,
  author = {Zhao, Xiaodong and Xie, Shanshan and Xie, Jiangjian},
  title = {AVB81: A Fine-Grained Audiovisual Dataset and Benchmark for Bird Classification in the Wild},
  journal = {Animals},
  year = {2026},
  volume = {16},
  number = {14},
  pages = {2130},
  doi = {10.3390/ani16142130}
}
Kostenlos starten →