Automatic Branch–Leaf Segmentation and Leaf Phenotypic Parameter Estimation of Pear Trees Based on Three-Dimensional Point Clouds
Sensors · 08.05.2023 · 23 (9) · 4572
DOI: 10.3390/s23094572 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 08.05.2023. Verfasst von Haitao Li und 8 weiteren Autor:innen. Beteiligte Einrichtung: Academy for Advanced Interdisciplinary Studies, Collaborative Innovation Center for Modern Crop Production Co-Sponsored by Province and Ministry, Nan…. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional, Pyrus. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Jiangsu Agriculture Science and Technology Innovation Fund, The interdiscipline project of College of Horticulture in Nanjing Agricultural University.
Abstract (Originalsprache)
The leaf phenotypic traits of plants have a significant impact on the efficiency of canopy photosynthesis. However, traditional methods such as destructive sampling will hinder the continuous monitoring of plant growth, while manual measurements in the field are both time-consuming and laborious. Nondestructive and accurate measurements of leaf phenotypic parameters can be achieved through the use of 3D canopy models and object segmentation techniques. This paper proposed an automatic branch–leaf segmentation pipeline based on lidar point cloud and conducted the automatic measurement of leaf inclination angle, length, width, and area, using pear canopy as an example. Firstly, a three-dimensional model using a lidar point cloud was established using SCENE software. Next, 305 pear tree branches were manually divided into branch points and leaf points, and 45 branch samples were selected as test data. Leaf points were further marked as 572 leaf instances on these test data. The PointNet++ model was used, with 260 point clouds as training input to carry out semantic segmentation of branches and leaves. Using the leaf point clouds in the test dataset as input, a single leaf instance was extracted by means of a mean shift clustering algorithm. Finally, based on the single leaf point cloud, the leaf inclination angle was calculated by plane fitting, while the leaf length, width, and area were calculated by midrib fitting and triangulation. The semantic segmentation model was tested on 45 branches, with a mean Precisionsem, mean Recallsem, mean F1-score, and mean Intersection over Union (IoU) of branches and leaves of 0.93, 0.94, 0.93, and 0.88, respectively. For single leaf extraction, the Precisionins, Recallins, and mean coverage (mCoV) were 0.89, 0.92, and 0.87, respectively. Using the proposed method, the estimated leaf inclination, length, width, and area of pear leaves showed a high correlation with manual measurements, with correlation coefficients of 0.94 (root mean squared error: 4.44°), 0.94 (root mean squared error: 0.43 cm), 0.91 (root mean squared error: 0.39 cm), and 0.93 (root mean squared error: 5.21 cm2), respectively. These results demonstrate that the method can automatically and accurately measure the phenotypic parameters of pear leaves. This has great significance for monitoring pear tree growth, simulating canopy photosynthesis, and optimizing orchard management.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Academy for Advanced Interdisciplinary Studies, Collaborative Innovation Center for Modern Crop Production Co-Sponsored by Province and Ministry, Nanjing Agricultural University, Nanjing 210095, China.
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing 210095, China.
- Centre of Pear Engineering Technology Research, State Key Laboratory of Crop Genetics & Germplasm Enhancement and Utilization, Nanjing Agricultural University, Nanjing 210095, China.
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1 Midori-cho, Tokyo 188-0002, Japan.
ORCID-Profile: Shutian Tao, Wei Guo, Seishi Ninomiya, Yue Mu
Förderung
- National Natural Science Foundation of China
- Jiangsu Agriculture Science and Technology Innovation Fund
- The interdiscipline project of College of Horticulture in Nanjing Agricultural University
- interdisciplinary project of College of Horticulture
- Nanjing Agricultural University
Zitieren
APA
Li, H., Wu, G., Tao, S., Yin, H., Qi, K., Zhang, S., Guo, W., Ninomiya, S., & Mu, Y. (2023). Automatic Branch–Leaf Segmentation and Leaf Phenotypic Parameter Estimation of Pear Trees Based on Three-Dimensional Point Clouds. Sensors, 23(9), 4572. https://doi.org/10.3390/s23094572
Vancouver
Li H, Wu G, Tao S, Yin H, Qi K, Zhang S, et al. Automatic Branch–Leaf Segmentation and Leaf Phenotypic Parameter Estimation of Pear Trees Based on Three-Dimensional Point Clouds. Sensors. 2023;23(9):4572. doi:10.3390/s23094572
BibTeX
@article{Li2023,
author = {Li, Haitao and Wu, Gengchen and Tao, Shutian and Yin, Hao and Qi, Kaijie and Zhang, Shaoling and Guo, Wei and Ninomiya, Seishi and Mu, Yue},
title = {Automatic Branch–Leaf Segmentation and Leaf Phenotypic Parameter Estimation of Pear Trees Based on Three-Dimensional Point Clouds},
journal = {Sensors},
year = {2023},
volume = {23},
number = {9},
pages = {4572},
doi = {10.3390/s23094572}
}
EUVIMED