Language Models as 3D Layout Designers: a Survey
Journal of Design Intelligence · 2026
DOI: 10.64509/jdi.11.51 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Design Intelligence, 2026. Verfasst von Cheng Wan und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Scene design—spanning interior arrangement, virtual environment creation, and simulated asset generation for robotics—requires semantic understanding, physical plausibility, and aesthetic judgement. While traditional approaches rely on expert rules or optimization, Large Language Models (LLMs) promise more flexible, language-grounded reasoning and multimodal grounding. This survey provides a focused definition and task framework for layout agents and proposes a hierarchical categorization based on LLM layout agents' output representation. At the highest level, we distinguish Direct Methods, which predict asset poses (one-stage vs. multi-stage), from Indirect Methods, which emit intermediate representations (constraint-based or programmatic) that are converted to layouts via post-processing. Furthermore, we categorize the evaluation of layout agents into four dimensions: physical plausibility, prompt fidelity, semantic coherence, and aesthetics and realism, and summarize the commonly used evaluation methods. Finally, we review the current challenges faced by layout agents, including the lack of spatial reasoning ability, instability, poor generalization, and low efficiency. By organizing recent progress and identifying gaps, this survey aims to guide future research toward more capable, generalizable LLM layout agents.
Zitieren
APA
Wan, C., Mao, Y., & Liu, Y. (2026). Language Models as 3D Layout Designers: a Survey. Journal of Design Intelligence. https://doi.org/10.64509/jdi.11.51
Vancouver
Wan C, Mao Y, Liu Y. Language Models as 3D Layout Designers: a Survey. Journal of Design Intelligence. 2026. doi:10.64509/jdi.11.51
BibTeX
@article{Wan2026,
author = {Wan, Cheng and Mao, Yongsen and Liu, Yuan},
title = {Language Models as 3D Layout Designers: a Survey},
journal = {Journal of Design Intelligence},
year = {2026},
doi = {10.64509/jdi.11.51}
}
EUVIMED