WorldGen：从文本到可遍历交互式3D世界生成

摘要

我们推出WorldGen系统，该系统能够直接从文本提示自动创建大规模交互式3D世界。我们的方法将自然语言描述转化为可遍历的完整贴图环境，这些环境可立即在标准游戏引擎中进行探索或编辑。通过结合大语言模型驱动的场景布局推理、程序化生成、基于扩散的3D生成以及对象感知的场景解构技术，WorldGen在创意构想与功能性虚拟空间之间架起桥梁，使创作者无需手动建模或具备专业3D知识即可设计出连贯、可导航的世界。该系统采用完全模块化架构，支持对布局、比例和风格的细粒度控制，生成的世界具有几何一致性、视觉丰富性，并能实现实时高效渲染。这项研究标志着向可大规模生成的可访问世界构建迈出关键一步，推动了3D生成式AI在游戏、模拟和沉浸式社交环境等应用领域的前沿进展。

English

We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descriptions into traversable, fully textured environments that can be immediately explored or edited within standard game engines. By combining LLM-driven scene layout reasoning, procedural generation, diffusion-based 3D generation, and object-aware scene decomposition, WorldGen bridges the gap between creative intent and functional virtual spaces, allowing creators to design coherent, navigable worlds without manual modeling or specialized 3D expertise. The system is fully modular and supports fine-grained control over layout, scale, and style, producing worlds that are geometrically consistent, visually rich, and efficient to render in real time. This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.

WorldGen：从文本到可遍历交互式3D世界生成

WorldGen: From Text to Traversable and Interactive 3D Worlds

摘要

Support