EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Motion Picture: Leveraging Movement to Enhance AI Object Detection in Ecology

Ben Maslen iD, Gordana Popovic, Dadong Wang, Andrew Jansen, David Warton

Ecology and Evolution · 2025-08 · 15 (8)

DOI: 10.1002/ece3.71996 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Ecology and Evolution, online erschienen am 19.08.2025. Verfasst von Ben Maslen und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematics and Statistics University of New South Wales Sydney New South Wales Australia. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rise of AI has seen an explosion in the use of deep learning methods that automate the analysis of image and video data, saving ecologists vast amounts of time and resources. Ecological imagery poses unique challenges; however, with cryptic species struggling to be detected among poor visibility and diverse environments. We propose leveraging movement information to attempt to improve the predictions produced by a high‐performing object detection algorithm. Frame differencing, background subtraction, optical flow and multi‐object tracking are trialed on four diverse datasets containing over 35,000 annotated images sourced from terrestrial, marine and freshwater habitats. We find that leveraging movement information is useful for smaller sized studies and rarer species, however is not needed for well annotated studies (> 400 annotations per class). Out of the methods that utilise movement, we find that a simple ‘differencing’ of neighbouring frames generally performed the best, whilst attempting to track taxa to boost prediction scores performed poorly. Other studies in this area tend to focus only on 1–2 datasets and a single method that utilises movement information, making it difficult for ecologists to generalise results. Our study provides key lessons for ecologists to determine whether it is useful to incorporate methods that leverage movement information when attempting to automatically predict taxa. We offer straightforward code for practical implementation via our GitHub repository, BenMaslen/MCD, along with an evaluation benchmark dataset called ‘Tassie BRUV’ that can be accessed from the Dryad public repository https://doi.org/10.5061/dryad.sbcc2frf7 .

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencecamera trapscomputer visiondeep learningecologymachine learningmovementunderwater video

Autor:innen und Institutionen

  • School of Mathematics and Statistics University of New South Wales Sydney New South Wales Australia.
  • Evolution and Ecology Research Centre University of New South Wales Sydney New South Wales Australia.
  • Data61, CSIRO Eveleigh New South Wales Australia.
  • Mark Wainwright Analytical Centre University of New South Wales Sydney New South Wales Australia.
  • Department of Climate Change, Energy, Environment and Water Environmental Research Institute of the Supervising Scientist Darwin Northwest Territories Australia.

ORCID-Profile: Ben Maslen

Förderung

  • Australian Research Council

Zitieren

APA

Maslen, B., Popovic, G., Wang, D., Jansen, A., & Warton, D. (2025). The Motion Picture: Leveraging Movement to Enhance AI Object Detection in Ecology. Ecology and Evolution, 15(8). https://doi.org/10.1002/ece3.71996

Vancouver

Maslen B, Popovic G, Wang D, Jansen A, Warton D. The Motion Picture: Leveraging Movement to Enhance AI Object Detection in Ecology. Ecology and Evolution. 2025;15(8). doi:10.1002/ece3.71996

BibTeX
@article{Maslen2025,
  author = {Maslen, Ben and Popovic, Gordana and Wang, Dadong and Jansen, Andrew and Warton, David},
  title = {The Motion Picture: Leveraging Movement to Enhance AI Object Detection in Ecology},
  journal = {Ecology and Evolution},
  year = {2025},
  volume = {15},
  number = {8},
  doi = {10.1002/ece3.71996}
}
Kostenlos starten →