萬安動畫：統一角色動畫與替換，實現整體複製

摘要

我們介紹了Wan-Animate，這是一個用於角色動畫與替換的統一框架。給定一張角色圖像和一段參考視頻，Wan-Animate能夠通過精確複製視頻中角色的表情和動作來生成高保真度的角色動畫視頻。此外，它還能將動畫角色整合到參考視頻中，替換原有角色，並複製場景的光照和色調，實現無縫的環境融合。Wan-Animate基於Wan模型構建。為了使其適應角色動畫任務，我們採用了一種修改後的輸入範式，以區分參考條件和生成區域。這一設計將多項任務統一為一個共同的符號表示。我們利用空間對齊的骨架信號來複製身體動作，並從源圖像中提取隱含的面部特徵來重現表情，從而生成具有高度可控性和表現力的角色視頻。此外，為了增強角色替換過程中的環境融合效果，我們開發了一個輔助的Relighting LoRA模塊。該模塊在保持角色外觀一致性的同時，應用適當的環境光照和色調。實驗結果表明，Wan-Animate達到了最先進的性能。我們承諾將開源模型權重及其源代碼。

English

We introduce Wan-Animate, a unified framework for character animation and replacement. Given a character image and a reference video, Wan-Animate can animate the character by precisely replicating the expressions and movements of the character in the video to generate high-fidelity character videos. Alternatively, it can integrate the animated character into the reference video to replace the original character, replicating the scene's lighting and color tone to achieve seamless environmental integration. Wan-Animate is built upon the Wan model. To adapt it for character animation tasks, we employ a modified input paradigm to differentiate between reference conditions and regions for generation. This design unifies multiple tasks into a common symbolic representation. We use spatially-aligned skeleton signals to replicate body motion and implicit facial features extracted from source images to reenact expressions, enabling the generation of character videos with high controllability and expressiveness. Furthermore, to enhance environmental integration during character replacement, we develop an auxiliary Relighting LoRA. This module preserves the character's appearance consistency while applying the appropriate environmental lighting and color tone. Experimental results demonstrate that Wan-Animate achieves state-of-the-art performance. We are committed to open-sourcing the model weights and its source code.

萬安動畫：統一角色動畫與替換，實現整體複製

Wan-Animate: Unified Character Animation and Replacement with Holistic Replication

摘要

Support