照片交换：图像中的个性化主体交换

摘要

在图像和视觉内容主导数字领域的时代，操纵和个性化这些图像的能力已成为必需。设想无缝地将一只躺在阳光照射的窗台上的虎斑猫在照片中替换为自己顽皮的小狗，同时保留图像的原始魅力和构图。我们提出了Photoswap，这是一种新颖方法，通过在现有图像中进行个性化主体交换，实现了这种沉浸式图像编辑体验。Photoswap首先从参考图像中学习主体的视觉概念，然后使用预训练的扩散模型以无需训练的方式将其交换到目标图像中。我们确定，一个概念完善的视觉主体可以通过适当的自注意力和交叉注意力操作，无缝地转移到任何图像中，保持交换主体的姿势和图像的整体连贯性。全面的实验突显了Photoswap在个性化主体交换中的有效性和可控性。此外，Photoswap在人类评分方面明显优于基准方法，涵盖了主体交换、背景保留和整体质量，揭示了其广泛的应用潜力，从娱乐到专业编辑。

English

In an era where images and visual content dominate our digital landscape, the ability to manipulate and personalize these images has become a necessity. Envision seamlessly substituting a tabby cat lounging on a sunlit window sill in a photograph with your own playful puppy, all while preserving the original charm and composition of the image. We present Photoswap, a novel approach that enables this immersive image editing experience through personalized subject swapping in existing images. Photoswap first learns the visual concept of the subject from reference images and then swaps it into the target image using pre-trained diffusion models in a training-free manner. We establish that a well-conceptualized visual subject can be seamlessly transferred to any image with appropriate self-attention and cross-attention manipulation, maintaining the pose of the swapped subject and the overall coherence of the image. Comprehensive experiments underscore the efficacy and controllability of Photoswap in personalized subject swapping. Furthermore, Photoswap significantly outperforms baseline methods in human ratings across subject swapping, background preservation, and overall quality, revealing its vast application potential, from entertainment to professional editing.

照片交换：图像中的个性化主体交换

Photoswap: Personalized Subject Swapping in Images

摘要

Support