PlayWorld：基于智能体玩家的长时程目标世界模型基准测试

摘要

视频世界模型根据当前观测和用户动作模拟未来状态。近期系统在长序列上展现了令人印象深刻的视频一致性和动作可控性。然而，公平地比较这些交互式模型仍然具有挑战性。在实践中，人类玩家通常通过交互追求长期目标来评估世界模型。例如，用户可能会旋转360度以检查环境是否保持一致，或走入水中观察是否生成逼真的水波纹。为实现相同目标所需的动作序列在不同模型之间可能差异很大，这使得固定动作条件下的评估不适合用于跨模型比较。为解决这一问题，我们采用多模态智能体玩家与世界模型交互，以实现指定的长期目标。基于这一范式，我们推出了PlayWorld，一个提供171个场景的基准测试，每个场景都有明确的目标。为了全面评估性能，我们从四个核心维度对模型进行评测：几何一致性、交互保真度、视野外演化和洞察演化。此外，我们还引入了视频质量和可控性的基础能力指标。对九个最先进世界模型的实验表明，当前模型在长期交互目标上仍然不可靠，尤其是在保持空间一致性和持续状态演化方面。代码和数据可在 https://github.com/kxding/PlayWorld 获取。

English

Video world models simulate future states conditioned on current observations and user actions. Recent systems have demonstrated impressive video consistency and action controllability over long sequences. However, fairly comparing these interactive models remains challenging. In practice, a human player typically evaluates a world model by pursuing long-horizon objectives through interaction. For example, a user may turn around 360 degrees to see whether the environment remains consistent, or walk into the water and inspect whether realistic water ripples are generated. The action sequence required to achieve the same objective may vary substantially between models, making fixed action-conditioned evaluation unsuitable for cross-model comparison. To address this, we employ multi-modal Agent Players to interact with world models toward specified long-horizon objectives. Building on this paradigm, we introduce PlayWorld, a benchmark providing 171 scenarios, each with a specified objective. To evaluate performance thoroughly, we assess models along four core dimensions: geometry consistency, interaction fidelity, out-of-sight evolution, and insight evolution. In addition, we incorporate basic ability metrics for video quality and controllability. Experiments across nine state-of-the-art world models reveal that current models remain unreliable on long-horizon interactive objectives, particularly in maintaining spatial consistency and persistent state evolution. Code and data are available at https://github.com/kxding/PlayWorld.