WorldDirector：构建具有持久动态内存的可控世界模拟器

WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory

July 2, 2026

作者: Hanlin Wang, Hao Ouyang, Qiuyu Wang, Wen Wang, Qingyan Bai, Ka Leong Cheng, Yue Yu, Yixuan Li, Yihao Meng, Zichen Liu, Yanhong Zeng, Yujun Shen, Qifeng Chen

cs.AI

摘要

我们提出了WorldDirector，这是一个高度可控的视频世界模型框架，专为持久动态对象记忆和无限制视角探索而设计。与现有将物理动态与像素渲染纠缠在一起、依赖连续视觉观察来维持运动的世界模型不同，我们的框架显式地将语义运动编排与视觉生成解耦。通过利用LLM协调3D轨迹与相机运动，随后将这些编排好的轨迹作为视频生成的控制信号，我们的方法确保了严格的物理逻辑和外观稳定性，成功保留了动态实体的精确视觉身份，即使它们长时间离开视野后重新进入场景也能保持。实验结果表明，我们的方法支持合成复杂且扩展的事件，具有前所未有的可控性和持久动态对象记忆。项目页面：https://worlddirector.github.io/

English

We present WorldDirector, a highly controllable video world model framework designed for persistent dynamic object memory and unrestricted viewpoint exploration. Unlike existing world models that entangle physical dynamics with pixel rendering and rely on continuous visual observation to sustain motion, our framework explicitly decouples semantic motion orchestration from visual generation. By leveraging an LLM to coordinate 3D trajectories with camera movements and subsequently employing these orchestrated trajectories as control signals for video generation, our approach ensures strict physical logic and appearance stability, successfully preserving the exact visual identities of dynamic entities even when they re-enter the scene after prolonged periods out of view. Experimental results demonstrate that our method supports the synthesis of complex and extended events with unprecedented controllability and persistent dynamic object memory. Project Page: https://worlddirector.github.io/