EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

3D data-augmentation methods for semantic segmentation of tomato plant parts

Bolai Xin, Ji Sun, Harm Bartholomeus, Gert Kootstra

Frontiers in Plant Science · 12.06.2023 · 14

DOI: 10.3389/fpls.2023.1045545 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Plant Science, online erschienen am 12.06.2023. Verfasst von Bolai Xin und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Plant Science, Wageningen University and Research, Wageningen, Netherlands. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

3D semantic segmentation of plant point clouds is an important step towards automatic plant phenotyping and crop modeling. Since traditional hand-designed methods for point-cloud processing face challenges in generalisation, current methods are based on deep neural network that learn to perform the 3D segmentation based on training data. However, these methods require a large annotated training set to perform well. Especially for 3D semantic segmentation, the collection of training data is highly labour intensitive and time consuming. Data augmentation has been shown to improve training on small training sets. However, it is unclear which data-augmentation methods are effective for 3D plant-part segmentation.

Methods

In the proposed work, five novel data-augmentation methods (global cropping, brightness adjustment, leaf translation, leaf rotation, and leaf crossover) were proposed and compared to five existing methods (online down sampling, global jittering, global scaling, global rotation, and global translation). The methods were applied to PointNet++ for 3D semantic segmentation of the point clouds of three cultivars of tomato plants (Merlice, Brioso, and Gardener Delight). The point clouds were segmented into soil base, stick, stemwork, and other bio-structures. Results and disccusion Among the data augmentation methods being proposed in this paper, leaf crossover indicated the most promising result which outperformed the existing ones. Leaf rotation (around Z axis), leaf translation, and cropping also performed well on the 3D tomato plant point clouds, which outperformed most of the existing work apart from global jittering. The proposed 3D data augmentation approaches significantly improve the overfitting caused by the limited training data. The improved plant-part segmentation further enables a more accurate reconstruction of the plant architecture.

Schlagwörter

Stichwörter der Autor:innen

data augmentationdeep learningpoint cloudssemantic segmentationtomato plants

Autor:innen und Institutionen

  • Department of Plant Science, Wageningen University and Research, Wageningen, Netherlands.
  • Laboratory of Geo-Information Science and Remote Sensing, Wageningen University and Research, Wageningen, Netherlands.

Zitieren

APA

Xin, B., Sun, J., Bartholomeus, H., & Kootstra, G. (2023). 3D data-augmentation methods for semantic segmentation of tomato plant parts. Frontiers in Plant Science, 14. https://doi.org/10.3389/fpls.2023.1045545

Vancouver

Xin B, Sun J, Bartholomeus H, Kootstra G. 3D data-augmentation methods for semantic segmentation of tomato plant parts. Frontiers in Plant Science. 2023;14. doi:10.3389/fpls.2023.1045545

BibTeX
@article{Xin2023,
  author = {Xin, Bolai and Sun, Ji and Bartholomeus, Harm and Kootstra, Gert},
  title = {3D data-augmentation methods for semantic segmentation of tomato plant parts},
  journal = {Frontiers in Plant Science},
  year = {2023},
  volume = {14},
  doi = {10.3389/fpls.2023.1045545}
}
Kostenlos starten →