Imaginarium: Vision-guided High-Quality 3D Scene Layout Generation
ACM Transactions on Graphics · 2025-12 · 44 (6) · 1-24
DOI: 10.1145/3763353 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 04.12.2025. Verfasst von Xiaoming Zhu und 10 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
Generating artistic and coherent 3D scene layouts is crucial in digital content creation. Traditional optimization-based methods are often constrained by cumbersome manual rules, while deep generative models face challenges in producing content with richness and diversity. Furthermore, approaches that utilize large language models frequently lack robustness and fail to accurately capture complex spatial relationships. To address these challenges, this paper presents a novel vision-guided 3D layout generation system. We first construct a high-quality asset library containing 2,037 scene assets and 147 3D scene layouts. Subsequently, we employ an image generation model to expand prompt representations into images, fine-tuning it to align with our asset library. We then develop a robust image parsing module to recover the 3D layout of scenes based on visual semantics and geometric information. Finally, we optimize the scene layout using scene graphs and overall visual semantics to ensure logical coherence and alignment with the images. Extensive user testing demonstrates that our algorithm significantly outperforms existing methods in terms of layout richness and quality. The code and dataset will be available at https://github.com/HiHiAllen/Imaginarium.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Zhu, X., Huang, X., Xie, Q., Deng, Z., Yu, J., Guan, Y., Liu, Z., Zhu, L., Zhao, Q., Liu, L., & Zeng, L. (2025). Imaginarium: Vision-guided High-Quality 3D Scene Layout Generation. ACM Transactions on Graphics, 44(6), 1-24. https://doi.org/10.1145/3763353
Vancouver
Zhu X, Huang X, Xie Q, Deng Z, Yu J, Guan Y, et al. Imaginarium: Vision-guided High-Quality 3D Scene Layout Generation. ACM Transactions on Graphics. 2025;44(6):1-24. doi:10.1145/3763353
BibTeX
@article{Zhu2025,
author = {Zhu, Xiaoming and Huang, Xu and Xie, Qinghongbing and Deng, Zhi and Yu, Junsheng and Guan, Yirui and Liu, Zhongyuan and Zhu, Lin and Zhao, Qijun and Liu, Ligang and Zeng, Long},
title = {Imaginarium: Vision-guided High-Quality 3D Scene Layout Generation},
journal = {ACM Transactions on Graphics},
year = {2025},
volume = {44},
number = {6},
pages = {1--24},
doi = {10.1145/3763353}
}
EUVIMED