EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Underwater Computer Vision for Ecologists: A Framework for Curating Image Training Datasets for Object Detection

Talen Rimmer iD, Colin Bates, Declan McIntosh iD, Tom Zhang iD, Alexandra Branzan Albu iD, Francis Juanes iD

Sensors · 2026

DOI: 10.3390/s26185869 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Talen Rimmer und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biology, University of Victoria, Victoria, BC V8P 5C2, Canada. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted, Ecology. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Mitacs, Tsawout First Nation, B.C. Salmon Restoration and Innovation Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As marine ecosystems experience accelerating change, there is an urgent need for efficient and scalable biodiversity monitoring tools. We present a 10-step framework for integrating computer vision (CV) tools into long-term underwater biodiversity monitoring, using a case study from coastal British Columbia. Over 9000 h of unbaited remote underwater video footage were collected from two kelp farms and reference sites between March 2022 and June 2023. The framework includes steps for creating an annotated training dataset using unsupervised and supervised CV tools, culminating in the training and validation of a YOLOv8 object detection model. This process produced over 241,000 annotations across 54 pseudo-taxonomic categories (representing both taxa and visually similar groups of fauna), with a focus on fish and gelatinous zooplankton groups. The final model achieved an overall F1 (2 × precision × recall/(precision + recall)) of 0.74 and a mean average precision at 0.5 intersection over union (mAP50) of 0.78. The model had the highest performance on fine-resolution taxa such as Phanerodon vacca (F1 = 0.88) and Aurelia labiata (F1 = 0.90), and lowest performance on pseudo-taxa with limited visual distinctiveness such as Actinopterygii (F1 = 0.60) and Cnidaria (F1 = 0.60). A re-training experiment using annotation thresholds between 25 training images to full dataset availability (~200–24,000 images per group) found that model performance was positively correlated with annotation effort, with F1 averaging 0.84 and mAP50 averaging 0.91 at the maximum training dataset size. Our results suggest that the model is most effective for abundant and visually distinctive taxa, while performance declines for groups with coarse taxonomic resolution. We recommend optimizing annotation effort by targeting genus- or species-level taxa, having at least one broad-level group to capture order-level abundances, and supplementing annotations of rare groups with common but morphologically similar groups, which may further improve model performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Image Processing, Computer-AssistedEcologyAnimalsDetection AlgorithmsBiodiversityFishesEcosystemZooplankton

Stichwörter der Autor:innen

annotation methodsbiodiversityecologyimage annotationobject detectionunderwater imagery

Autor:innen und Institutionen

  • Department of Biology, University of Victoria, Victoria, BC V8P 5C2, Canada.
  • Cascadia Seaweed, Sidney, BC V8L 3A4, Canada.
  • Department of Electrical and Computer Engineering, University of Victoria, Victoria, BC V8P 5C2, Canada.

ORCID-Profile: Talen Rimmer, Declan McIntosh, Tom Zhang, Alexandra Branzan Albu, Francis Juanes

Förderung

  • Mitacs
  • Tsawout First Nation
  • B.C. Salmon Restoration and Innovation Fund

Zitieren

APA

Rimmer, T., Bates, C., McIntosh, D., Zhang, T., Branzan Albu, A., & Juanes, F. (2026). Underwater Computer Vision for Ecologists: A Framework for Curating Image Training Datasets for Object Detection. Sensors. https://doi.org/10.3390/s26185869

Vancouver

Rimmer T, Bates C, McIntosh D, Zhang T, Branzan Albu A, Juanes F. Underwater Computer Vision for Ecologists: A Framework for Curating Image Training Datasets for Object Detection. Sensors. 2026. doi:10.3390/s26185869

BibTeX
@article{Rimmer2026,
  author = {Rimmer, Talen and Bates, Colin and McIntosh, Declan and Zhang, Tom and Branzan Albu, Alexandra and Juanes, Francis},
  title = {Underwater Computer Vision for Ecologists: A Framework for Curating Image Training Datasets for Object Detection},
  journal = {Sensors},
  year = {2026},
  doi = {10.3390/s26185869}
}
Kostenlos starten →