EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images

Tomer Gadot, Ștefan Istrate, Hyungwon Kim, Dan Morris, Sara Beery, Tanya Birch, Jorge Ahumada

IET Computer Vision · 2024-12 · 18 (8) · 1193-1208

DOI: 10.1049/cvi2.12318 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Computer Vision, online erschienen am 24.11.2024. Verfasst von Tomer Gadot und 6 weiteren Autor:innen. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 223 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Whitehead Institute for Biomedical Research, Massachusetts Institute of Technology, Wildlife Conservation Society, Gordon and Betty Moore Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Camera traps facilitate non‐invasive wildlife monitoring, but their widespread adoption has created a data processing bottleneck: a camera trap survey can create millions of images, and the labour required to review those images strains the resources of conservation organisations. AI is a promising approach for accelerating image review, but AI tools for camera trap data are imperfect; in particular, classifying small animals remains difficult, and accuracy falls off outside the ecosystems in which a model was trained. It has been proposed that incorporating an object detector into an image analysis pipeline may help address these challenges, but the benefit of object detection has not been systematically evaluated in the literature. In this work, the authors assess the hypothesis that classifying animals cropped from camera trap images using a species‐agnostic detector yields better accuracy than classifying whole images. We find that incorporating an object detection stage into an image classification pipeline yields a macro‐average F1 improvement of around 25% on a large, long‐tailed dataset; this improvement is reproducible on a large public dataset and a smaller public benchmark dataset. The authors describe a classification architecture that performs well for both whole and detector‐cropped images, and demonstrate that this architecture yields state‐of‐the‐art benchmark accuracy.

Förderung

  • Whitehead Institute for Biomedical Research, Massachusetts Institute of Technology
  • Wildlife Conservation Society
  • Gordon and Betty Moore Foundation
  • Google

Zitieren

APA

Gadot, T., Istrate, Ș., Kim, H., Morris, D., Beery, S., Birch, T., & Ahumada, J. (2024). To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images. IET Computer Vision, 18(8), 1193-1208. https://doi.org/10.1049/cvi2.12318

Vancouver

Gadot T, Istrate Ș, Kim H, Morris D, Beery S, Birch T, et al. To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images. IET Computer Vision. 2024;18(8):1193-1208. doi:10.1049/cvi2.12318

BibTeX
@article{Gadot2024,
  author = {Gadot, Tomer and Istrate, Ștefan and Kim, Hyungwon and Morris, Dan and Beery, Sara and Birch, Tanya and Ahumada, Jorge},
  title = {To crop or not to crop: Comparing whole‐image and cropped classification on a large dataset of camera trap images},
  journal = {IET Computer Vision},
  year = {2024},
  volume = {18},
  number = {8},
  pages = {1193--1208},
  doi = {10.1049/cvi2.12318}
}
Kostenlos starten →