To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images
IET Computer Vision · 2024-12 · 18 (8) · 1193-1208
DOI: 10.1049/cvi2.12318 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Computer Vision, online erschienen am 24.11.2024. Verfasst von Tomer Gadot und 6 weiteren Autor:innen. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 223 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Whitehead Institute for Biomedical Research, Massachusetts Institute of Technology, Wildlife Conservation Society, Gordon and Betty Moore Foundation.
Abstract (Originalsprache)
Camera traps facilitate non‐invasive wildlife monitoring, but their widespread adoption has created a data processing bottleneck: a camera trap survey can create millions of images, and the labour required to review those images strains the resources of conservation organisations. AI is a promising approach for accelerating image review, but AI tools for camera trap data are imperfect; in particular, classifying small animals remains difficult, and accuracy falls off outside the ecosystems in which a model was trained. It has been proposed that incorporating an object detector into an image analysis pipeline may help address these challenges, but the benefit of object detection has not been systematically evaluated in the literature. In this work, the authors assess the hypothesis that classifying animals cropped from camera trap images using a species‐agnostic detector yields better accuracy than classifying whole images. We find that incorporating an object detection stage into an image classification pipeline yields a macro‐average F1 improvement of around 25% on a large, long‐tailed dataset; this improvement is reproducible on a large public dataset and a smaller public benchmark dataset. The authors describe a classification architecture that performs well for both whole and detector‐cropped images, and demonstrate that this architecture yields state‐of‐the‐art benchmark accuracy.
Förderung
- Whitehead Institute for Biomedical Research, Massachusetts Institute of Technology
- Wildlife Conservation Society
- Gordon and Betty Moore Foundation
Zitieren
APA
Gadot, T., Istrate, Ș., Kim, H., Morris, D., Beery, S., Birch, T., & Ahumada, J. (2024). To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images. IET Computer Vision, 18(8), 1193-1208. https://doi.org/10.1049/cvi2.12318
Vancouver
Gadot T, Istrate Ș, Kim H, Morris D, Beery S, Birch T, et al. To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images. IET Computer Vision. 2024;18(8):1193-1208. doi:10.1049/cvi2.12318
BibTeX
@article{Gadot2024,
author = {Gadot, Tomer and Istrate, Ștefan and Kim, Hyungwon and Morris, Dan and Beery, Sara and Birch, Tanya and Ahumada, Jorge},
title = {To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images},
journal = {IET Computer Vision},
year = {2024},
volume = {18},
number = {8},
pages = {1193--1208},
doi = {10.1049/cvi2.12318}
}
EUVIMED