万动画：统一角色动画与整体复制的角色替换

摘要

我们推出了Wan-Animate，一个统一的角色动画与替换框架。给定一张角色图像和一段参考视频，Wan-Animate能够通过精确复制视频中角色的表情和动作，生成高保真的角色动画视频。此外，它还能将动画角色无缝融入参考视频中，替换原角色，并复制场景的光照和色调，实现环境的自然融合。Wan-Animate基于Wan模型构建。为了适应角色动画任务，我们采用了一种改进的输入范式，以区分参考条件与生成区域。这一设计将多种任务统一为共同的符号表示。我们利用空间对齐的骨骼信号来复制身体动作，并从源图像中提取隐含的面部特征来重现表情，从而生成具有高度可控性和表现力的角色视频。进一步地，为了增强角色替换时的环境融合效果，我们开发了一个辅助的Relighting LoRA模块。该模块在保持角色外观一致性的同时，应用适当的环境光照和色调。实验结果表明，Wan-Animate达到了业界领先的性能。我们承诺将开源模型权重及其源代码。

English

We introduce Wan-Animate, a unified framework for character animation and replacement. Given a character image and a reference video, Wan-Animate can animate the character by precisely replicating the expressions and movements of the character in the video to generate high-fidelity character videos. Alternatively, it can integrate the animated character into the reference video to replace the original character, replicating the scene's lighting and color tone to achieve seamless environmental integration. Wan-Animate is built upon the Wan model. To adapt it for character animation tasks, we employ a modified input paradigm to differentiate between reference conditions and regions for generation. This design unifies multiple tasks into a common symbolic representation. We use spatially-aligned skeleton signals to replicate body motion and implicit facial features extracted from source images to reenact expressions, enabling the generation of character videos with high controllability and expressiveness. Furthermore, to enhance environmental integration during character replacement, we develop an auxiliary Relighting LoRA. This module preserves the character's appearance consistency while applying the appropriate environmental lighting and color tone. Experimental results demonstrate that Wan-Animate achieves state-of-the-art performance. We are committed to open-sourcing the model weights and its source code.

万动画：统一角色动画与整体复制的角色替换

Wan-Animate: Unified Character Animation and Replacement with Holistic Replication

摘要

Support