Magpie：面向交互式游戏的实时世界渲染器

摘要

现代游戏开发高度依赖传统的图形渲染管线。高质量视觉内容需要建模、材质制作、动画、光照、特效及运行时优化，这使得美术资产生产成本高昂，并延长了游戏原型的开发周期。近年来，视频基础模型正开始改变电影与视频制作流程，但游戏不同于线性媒体，它不仅需要连续且逼真的画面，还需要稳定且可复现的游戏规则、物体状态及交互结果。我们提出了Magpie，一个面向交互式游戏的实时生成式世界渲染系统。Magpie将游戏逻辑执行与视觉生成相分离。设计师在游戏引擎中定义场景与规则。运行时，游戏引擎解析玩家操作并维护世界状态，而独立的渲染服务器则根据引擎生成的白盒帧来产生视觉输出。Magpie为将生成模型应用于实时游戏渲染提供了系统级的实现路径。它保留了游戏的可设计性与可复现性，并降低了早期游戏原型对完整美术资产的依赖。

English

Modern game development relies heavily on conventional graphics pipelines. High-quality visual content requires modeling, material authoring, animation, lighting, effects, and runtime optimization, making asset production expensive and extending the development cycle of game prototypes. Recently, video foundation models are beginning to change film and video production, but games differ from linear media, they require not only continuous and realistic imagery, but also stable and reproducible gameplay rules, object states, and interaction outcomes. We present Magpie, a real-time generative world-rendering system for interactive games. Magpie separates gameplay execution from visual generation. Designers define scenes and rules in a game engine. At runtime, the Game Engine resolves player actions and maintains world state, while an independent Render Server generates visual output from white-box frames produced by the engine. Magpie provides a system-level implementation path for applying generative models to real-time game rendering. It preserves gameplay designability and reproducibility, and reduces the dependence of early game prototypes on complete visual assets.