Using a synthetic 3D-environment and model-guided scene refinement to train a deep learning model for mapping fine woody debris from RGB-imagery
Forestry: An International Journal of Forest Research · 26.06.2026 · 99 (4)
DOI: 10.1093/forestry/cpag050 ↗Kurz gefasst
Fachartikel in der Zeitschrift Forestry: An International Journal of Forest Research, online erschienen am 10.07.2026. Verfasst von Arvin Fakhri und 1 weiteren Autor:innen. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Deep learning (DL) algorithms are increasingly used for ecological applications, but manual annotation is still one of the main obstacles in ecological DL, especially for pixel-level segmentation in complex environments like the forest floor. Identifying fine woody debris (FWD, twigs, branches, and small tree stems) is important for understanding carbon cycling, fire risk, and habitat structures, but traditional inventories of FWD are tedious and hard to accomplish in a spatially continuous way. Automatic inventory of FWD from forest-floor images taken by a surveyor or an under-canopy drone flight could notably improve efficiency. Here, we present a workflow to train a DL-based model able to map FWD using synthetic training data only. For this, we created a simulation-based approach that produces photorealistic forest-floor images with perfect labels for training our segmentation models. We first built a detailed 3D environment and filled it with realistic elements such as soil, leaves, moss, stones, and a wide variety of woody fragments. We then rendered high-resolution RGB images along with their binary masks under different lighting setups, camera, and sensor conditions. We trained a SegFormer entirely on this synthetic dataset and improved it through an human-in-the-loop generative refinement process. The model’s mistakes showed us where to adjust the simulated scenes, e.g. increasing environmental complexity, changing debris shapes, refining lighting, or adding more occlusion. After five rounds of refining the simulated forests, the model performed very well on real images (600 patches of size 512 × 512 px) it had never seen before. It reached an F1-score of 0.80 and an Intersection over Union of 0.67, all without using any real annotated data. These results suggest that careful ecological simulation, combined with model-guided improvements, can produce training data for DL models, i.e. realistic enough to support accurate FWD segmentation in photos taken in natural forest conditions. Our approach is likely transferable to other applications.
Zitieren
APA
Fakhri, A., & Fassnacht, F. E. (2026). Using a synthetic 3D-environment and model-guided scene refinement to train a deep learning model for mapping fine woody debris from RGB-imagery. Forestry: An International Journal of Forest Research, 99(4). https://doi.org/10.1093/forestry/cpag050
Vancouver
Fakhri A, Fassnacht FE. Using a synthetic 3D-environment and model-guided scene refinement to train a deep learning model for mapping fine woody debris from RGB-imagery. Forestry: An International Journal of Forest Research. 2026;99(4). doi:10.1093/forestry/cpag050
BibTeX
@article{Fakhri2026,
author = {Fakhri, Arvin and Fassnacht, Fabian Ewald},
title = {Using a synthetic 3D-environment and model-guided scene refinement to train a deep learning model for mapping fine woody debris from RGB-imagery},
journal = {Forestry: An International Journal of Forest Research},
year = {2026},
volume = {99},
number = {4},
doi = {10.1093/forestry/cpag050}
}
EUVIMED