EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Low-cost monocular RGB-based 3D structural mapping for horticultural plants via semantic scene completion

Ruijun Jing, Rui An, Zhuoxing Li, Jiliang Mu, Jing Liu, Zhiguo Zhao, Ruiyan Ma, Xiujian Chou

Frontiers in Plant Science · 22.07.2026 · 17

DOI: 10.3389/fpls.2026.1825547 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Plant Science, online erschienen am 22.07.2026. Verfasst von Ruijun Jing und 7 weiteren Autor:innen. Beteiligte Einrichtung: School of Instrument and Electronics, North University of China, Taiyuan, China. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Precision agriculture increasingly relies on detailed structural information, such as canopy height and canopy volume, to enhance crop health monitoring and operational safety. However, existing methods based on costly LiDAR or RGB-D sensors are often impractical for large-scale deployment in dynamic and unstructured horticultural environments. Furthermore, conventional 2D segmentation and SLAM-based pipelines typically generate sparse, geometrically inconsistent semantic maps which are insufficient for actionable structural analysis in agricultural applications. To overcome these limitations, we propose a monocular 3D structural mapping framework tailored for horticultural plants via semantic scene completion. At inference, the proposed model takes a single RGB image as input and predicts voxel-wise geometry and semantics, from which task-oriented structural maps, including canopy height, canopy volume, and obstacle-aware traversability layers, are derived. Specifically, we first introduce a Depth-Aware Decoder Module that explicitly recovers depth in the spatial domain and fuses 2D-to-3D features, thereby mitigating depth ambiguity and reducing reliance on accurate pose. Second, an NCS-Guided Geometry Encoder is designed to inject normalized depth into voxel positional embeddings, enabling self-attention to perform global relational modeling within a depth-aware geometric coordinate system. In addition, a Global Encoder is utilized to refine local structural details, while an occupancy head produces the final 3D semantic completion outputs. We construct a horticultural 3D semantic scene dataset using an RGB-D sensor, which serves as a benchmark for evaluating our method, while the deployed model remains RGB-only. Extensive quantitative and qualitative experiments are conducted on both the Semantic-KITTI dataset and our dataset. On our dataset, the method achieves 82.31% occupancy IoU, 84.26% mIoU, and 86.25% precision. Beyond voxel-level evaluation, manual field measurements further show canopy height MAE values of 0.019-0.026 m and canopy volume proxy relative errors of 8.4%-11.4%. These results demonstrate the effectiveness of our approach in real-world agricultural scenarios, providing actionable structural insights for crop monitoring and autonomous robotic operations.

Schlagwörter

Stichwörter der Autor:innen

depth-aware decoder modulegeometry encodermonocular perceptionsemantic scene completionstructural mapping

Autor:innen und Institutionen

  • School of Instrument and Electronics, North University of China, Taiyuan, China.
  • School of Software, Shanxi Agricultural University, Taiyuan, China.
  • College of Plant Protection, Shanxi Agricultural University, Taiyuan, China.
  • Shanxi Key Laboratory of Ferroelectric Physical Micro-nano Devices and Systems, North University of China, Taiyuan, China.
  • School of Automation and Software Engineering, Shanxi University, Taiyuan, China.

Zitieren

APA

Jing, R., An, R., Li, Z., Mu, J., Liu, J., Zhao, Z., Ma, R., & Chou, X. (2026). Low-cost monocular RGB-based 3D structural mapping for horticultural plants via semantic scene completion. Frontiers in Plant Science, 17. https://doi.org/10.3389/fpls.2026.1825547

Vancouver

Jing R, An R, Li Z, Mu J, Liu J, Zhao Z, et al. Low-cost monocular RGB-based 3D structural mapping for horticultural plants via semantic scene completion. Frontiers in Plant Science. 2026;17. doi:10.3389/fpls.2026.1825547

BibTeX
@article{Jing2026,
  author = {Jing, Ruijun and An, Rui and Li, Zhuoxing and Mu, Jiliang and Liu, Jing and Zhao, Zhiguo and Ma, Ruiyan and Chou, Xiujian},
  title = {Low-cost monocular RGB-based 3D structural mapping for horticultural plants via semantic scene completion},
  journal = {Frontiers in Plant Science},
  year = {2026},
  volume = {17},
  doi = {10.3389/fpls.2026.1825547}
}
Kostenlos starten →