A cross-domain challenge with panoptic segmentation in agriculture
The International Journal of Robotics Research · 2024-07 · 43 (8) · 1151-1174
DOI: 10.1177/02783649241227448 ↗Kurz gefasst
Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 18.01.2024. Verfasst von Michael Halstead und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: Deutsche Forschungsge-meinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy, Bundesanstalt fur Landwirtschaft und Ernahrung - WeedAI.
Abstract (Originalsprache)
Automation in agriculture is a growing area of research with fundamental societal importance as farmers are expected to produce more and better crop with fewer resources. A key enabling factor is robotic vision techniques allowing us to sense and then interact with the environment. A limiting factor for these robotic vision systems is their cross-domain performance, that is, their ability to operate in a large range of environments. In this paper, we propose the use of auxiliary tasks to enhance cross-domain performance without the need for extra data. We perform experiments using four datasets (two in a glasshouse and two in arable farmland) for four cross-domain evaluations. These experiments demonstrate the effectiveness of our auxiliary tasks to improve network generalisability. In glasshouse experiments, our approach improves the panoptic quality of things from 10.4 to 18.5 and in arable farmland from 16.0 to 27.5; where a score of 100 is the best. To further evaluate the generalisability of our approach, we perform an ablation study using the large Crop and Weed dataset (CAW) where we improve cross-domain performance (panoptic quality of things) from 12.8 to 30.6 for the CAW dataset to our novel WeedAI dataset, and 21.2 to 36.0 from CAW to the other arable farmland dataset. Although our proposed approaches considerably improve cross-domain performance we still do not generally outperform in-domain trained systems. This highlights the potential room for improvement in this area and the importance of cross-domain research for robotic vision systems.
Förderung
- Deutsche Forschungsge-meinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy
- Bundesanstalt fur Landwirtschaft und Ernahrung - WeedAI
Zitieren
APA
Halstead, M., Zimmer, P., & McCool, C. (2024). A cross-domain challenge with panoptic segmentation in agriculture. The International Journal of Robotics Research, 43(8), 1151-1174. https://doi.org/10.1177/02783649241227448
Vancouver
Halstead M, Zimmer P, McCool C. A cross-domain challenge with panoptic segmentation in agriculture. The International Journal of Robotics Research. 2024;43(8):1151-1174. doi:10.1177/02783649241227448
BibTeX
@article{Halstead2024,
author = {Halstead, Michael and Zimmer, Patrick and McCool, Chris},
title = {A cross-domain challenge with panoptic segmentation in agriculture},
journal = {The International Journal of Robotics Research},
year = {2024},
volume = {43},
number = {8},
pages = {1151--1174},
doi = {10.1177/02783649241227448}
}
EUVIMED