EUVIMEDEUVIMED entdecken
Crossref

AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning

Jirong Zha, Yuxuan Fan, Tianyu Zhang, Geng Chen, Yingfeng Chen, Chen Gao, Xinlei Chen

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (2) · 1507-1515

DOI: 10.1609/aaai.v40i2.37126 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Jirong Zha und 6 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal Large Language Models (MLLMs) have shown promise in single-agent vision tasks, yet benchmarks for evaluating multi-agent collaborative perception remain scarce. This gap is critical, as multi-drone systems provide enhanced coverage, robustness, and collaboration compared to single-sensor setups. Existing multi-image benchmarks mainly target basic perception tasks using high-quality single-agent images, thus failing to evaluate MLLMs in more complex, egocentric collaborative scenarios, especially under real-world degraded perception conditions. To address these challenges, we introduce AirCopBench, the first comprehensive benchmark designed to evaluate MLLMs in embodied aerial collaborative perception under challenging perceptual conditions. AirCopBench includes 14.6k+ questions derived from both simulator and real-world data, spanning four key task dimensions: Scene Understanding, Object Understanding, Perception Assessment, and Collaborative Decision, across 14 task types. We construct the benchmark using data from challenging degraded-perception scenarios with annotated collaborative events, generating large-scale questions through model-, rule-, and human-based methods under rigorous quality control. Evaluations on 40 MLLMs show significant performance gaps in collaborative perception tasks, with the best model trailing humans by 24.38% on average and exhibiting inconsistent results across tasks. Fine-tuning experiments further confirm the feasibility of sim-to-real transfer in aerial collaborative perception.

Zitieren

APA

Zha, J., Fan, Y., Zhang, T., Chen, G., Chen, Y., Gao, C., & Chen, X. (2026). AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(2), 1507-1515. https://doi.org/10.1609/aaai.v40i2.37126

Vancouver

Zha J, Fan Y, Zhang T, Chen G, Chen Y, Gao C, et al. AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(2):1507-1515. doi:10.1609/aaai.v40i2.37126

BibTeX
@article{Zha2026,
  author = {Zha, Jirong and Fan, Yuxuan and Zhang, Tianyu and Chen, Geng and Chen, Yingfeng and Gao, Chen and Chen, Xinlei},
  title = {AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {2},
  pages = {1507--1515},
  doi = {10.1609/aaai.v40i2.37126}
}
Kostenlos starten →