遊玩級生成式世界渲染器

摘要

生成式世界渲染器AlayaRenderer接收從物理引擎導出的結構化世界狀態，並合成RGB幀。與透過文字/控制提示生成幀的模型不同，AlayaRenderer在不改變底層世界動態的情況下保留場景結構，這展示了實現互動式世界建模與使用者可控遊玩的一條替代路徑。然而，原始AlayaRenderer的計算成本過高，無法即時部署。本技術報告介紹AlayaRenderer-Flash，這是一個面向即時運算的生成式前向世界渲染器，將AlayaRenderer從0.56 FPS提升至31.54 FPS，達到可遊玩的速度。AlayaRenderer-Flash將原始渲染器重新表述為少步自迴歸串流模型，並引入輕量級蒸餾編解碼器，以實現高效的潛在編碼與幀重建。它保留了教師模型的G-buffer與文字提示介面，同時支援對無界長度輸入串流的連續渲染。我們在G-buffer串流上評估AlayaRenderer-Flash的內容保留、時間一致性、跨視窗穩定性、提示可控性及執行效率。結果顯示，AlayaRenderer-Flash大幅降低推論成本，同時保留教師模型的核⼼渲染能力。透過將AlayaRenderer-Flash與物理引擎整合，我們構建了一個以30 FPS運行的完全可玩生成式世界。

English

Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.