ReDirector：运用旋转相机编码技术实现任意时长视频重拍

摘要

我们提出ReDirector——一种针对动态拍摄可变长度视频的新型相机控制重拍生成方法。该方法通过对齐输入视频与目标重拍的时空位置，修正了先前研究中RoPE的常见误用。此外，我们引入旋转相机编码（RoCE），这是一种基于相机条件的RoPE相位偏移技术，能够捕捉并整合输入视频与目标视频内部及之间的多视角关系。通过将相机条件融入RoPE，我们的方法可泛化至分布外的相机轨迹和视频长度，有效提升动态目标定位与静态背景保持的能力。大量实验进一步证明，该方法在不同轨迹和长度下均能显著提升相机可控性、几何一致性和视频质量。

English

We present ReDirector, a novel camera-controlled video retake generation method for dynamically captured variable-length videos. In particular, we rectify a common misuse of RoPE in previous works by aligning the spatiotemporal positions of the input video and the target retake. Moreover, we introduce Rotary Camera Encoding (RoCE), a camera-conditioned RoPE phase shift that captures and integrates multi-view relationships within and across the input and target videos. By integrating camera conditions into RoPE, our method generalizes to out-of-distribution camera trajectories and video lengths, yielding improved dynamic object localization and static background preservation. Extensive experiments further demonstrate significant improvements in camera controllability, geometric consistency, and video quality across various trajectories and lengths.

ReDirector：运用旋转相机编码技术实现任意时长视频重拍

ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encoding

摘要

Support