EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SegGen: An Unreal Engine 5 Pipeline for Generating Multimodal Semantic Segmentation Datasets

Justin McMillen iD, Yasin Yilmaz iD

Sensors · 06.09.2025 · 25 (17) · 5569

DOI: 10.3390/s25175569 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 06.09.2025. Verfasst von Justin McMillen und 1 weiteren Autor:innen. Beteiligte Einrichtung: Electrical Engineering Department, University of South Florida, Tampa, FL 33620, USA. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: United States Army Corps of Engineers, United States Army Corps of Engineers (USACE) Engineer Research and Development Center (ERDC) Geospatial Research Laboratory (GRL).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Synthetic data has become an increasingly important tool for semantic segmentation, where collecting large-scale annotated datasets is often costly and impractical. Prior work has leveraged computer graphics and game engines to generate training data, but many pipelines remain limited to single modalities and constrained environments or require substantial manual setup. To address these limitations, we present a fully automated pipeline built within Unreal Engine 5 (UE5) that procedurally generates diverse, labeled environments and collects multimodal visual data for semantic segmentation tasks. Our system integrates UE5’s biome-based procedural generation framework with a spline-following drone actor capable of capturing both RGB and depth imagery, alongside pixel-perfect semantic segmentation labels. As a proof of concept, we generated a dataset consisting of 1169 samples across two visual modalities and seven semantic classes. The pipeline supports scalable expansion and rapid environment variation, enabling high-throughput synthetic data generation with minimal human intervention. To validate our approach, we trained benchmark computer vision segmentation models on the synthetic dataset and demonstrated their ability to learn meaningful semantic representations. This work highlights the potential of game-engine-based data generation to accelerate research in multimodal perception and provide reproducible, scalable benchmarks for future segmentation models.

Schlagwörter

Stichwörter der Autor:innen

computer visionmultimodal data fusionsemantic segmentationsynthetic data generation

Autor:innen und Institutionen

  • Electrical Engineering Department, University of South Florida, Tampa, FL 33620, USA.

ORCID-Profile: Justin McMillen, Yasin Yilmaz

Förderung

  • United States Army Corps of Engineers
  • United States Army Corps of Engineers (USACE) Engineer Research and Development Center (ERDC) Geospatial Research Laboratory (GRL)

Zitieren

APA

McMillen, J., & Yilmaz, Y. (2025). SegGen: An Unreal Engine 5 Pipeline for Generating Multimodal Semantic Segmentation Datasets. Sensors, 25(17), 5569. https://doi.org/10.3390/s25175569

Vancouver

McMillen J, Yilmaz Y. SegGen: An Unreal Engine 5 Pipeline for Generating Multimodal Semantic Segmentation Datasets. Sensors. 2025;25(17):5569. doi:10.3390/s25175569

BibTeX
@article{McMillen2025,
  author = {McMillen, Justin and Yilmaz, Yasin},
  title = {SegGen: An Unreal Engine 5 Pipeline for Generating Multimodal Semantic Segmentation Datasets},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {17},
  pages = {5569},
  doi = {10.3390/s25175569}
}
Kostenlos starten →