EUVIMEDEUVIMED entdecken
Crossref

A cross-domain challenge with panoptic segmentation in agriculture

Michael Halstead, Patrick Zimmer, Chris McCool

The International Journal of Robotics Research · 2024-07 · 43 (8) · 1151-1174

DOI: 10.1177/02783649241227448 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 18.01.2024. Verfasst von Michael Halstead und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: Deutsche Forschungsge-meinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy, Bundesanstalt fur Landwirtschaft und Ernahrung - WeedAI.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automation in agriculture is a growing area of research with fundamental societal importance as farmers are expected to produce more and better crop with fewer resources. A key enabling factor is robotic vision techniques allowing us to sense and then interact with the environment. A limiting factor for these robotic vision systems is their cross-domain performance, that is, their ability to operate in a large range of environments. In this paper, we propose the use of auxiliary tasks to enhance cross-domain performance without the need for extra data. We perform experiments using four datasets (two in a glasshouse and two in arable farmland) for four cross-domain evaluations. These experiments demonstrate the effectiveness of our auxiliary tasks to improve network generalisability. In glasshouse experiments, our approach improves the panoptic quality of things from 10.4 to 18.5 and in arable farmland from 16.0 to 27.5; where a score of 100 is the best. To further evaluate the generalisability of our approach, we perform an ablation study using the large Crop and Weed dataset (CAW) where we improve cross-domain performance (panoptic quality of things) from 12.8 to 30.6 for the CAW dataset to our novel WeedAI dataset, and 21.2 to 36.0 from CAW to the other arable farmland dataset. Although our proposed approaches considerably improve cross-domain performance we still do not generally outperform in-domain trained systems. This highlights the potential room for improvement in this area and the importance of cross-domain research for robotic vision systems.

Förderung

  • Deutsche Forschungsge-meinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy
  • Bundesanstalt fur Landwirtschaft und Ernahrung - WeedAI

Zitieren

APA

Halstead, M., Zimmer, P., & McCool, C. (2024). A cross-domain challenge with panoptic segmentation in agriculture. The International Journal of Robotics Research, 43(8), 1151-1174. https://doi.org/10.1177/02783649241227448

Vancouver

Halstead M, Zimmer P, McCool C. A cross-domain challenge with panoptic segmentation in agriculture. The International Journal of Robotics Research. 2024;43(8):1151-1174. doi:10.1177/02783649241227448

BibTeX
@article{Halstead2024,
  author = {Halstead, Michael and Zimmer, Patrick and McCool, Chris},
  title = {A cross-domain challenge with panoptic segmentation in agriculture},
  journal = {The International Journal of Robotics Research},
  year = {2024},
  volume = {43},
  number = {8},
  pages = {1151--1174},
  doi = {10.1177/02783649241227448}
}
Kostenlos starten →