AnimateDiff-Lightning：跨模型扩散蒸馏

AnimateDiff-Lightning: Cross-Model Diffusion Distillation

March 19, 2024

作者: Shanchuan Lin, Xiao Yang

cs.AI

摘要

我们提出了AnimateDiff-Lightning，用于快速生成视频。我们的模型使用渐进式对抗性扩散蒸馏，实现了在少步骤视频生成方面的最新技术水平。我们讨论了我们对其进行的修改，以适应视频模态。此外，我们提议同时蒸馏多个基础扩散模型的概率流，从而产生一个具有更广泛风格兼容性的单一蒸馏运动模块。我们很高兴地发布我们蒸馏的AnimateDiff-Lightning模型供社区使用。

English

We present AnimateDiff-Lightning for lightning-fast video generation. Our model uses progressive adversarial diffusion distillation to achieve new state-of-the-art in few-step video generation. We discuss our modifications to adapt it for the video modality. Furthermore, we propose to simultaneously distill the probability flow of multiple base diffusion models, resulting in a single distilled motion module with broader style compatibility. We are pleased to release our distilled AnimateDiff-Lightning model for the community's use.