TIP-Editor：一款准确的3D编辑器，可以根据文本提示和图像提示进行编辑。

摘要

基于文本驱动的3D场景编辑因其便利性和用户友好性而受到了广泛关注。然而，由于文本描述的固有限制，现有方法仍然缺乏对编辑结果指定外观和位置的精确控制。为此，我们提出了一个3D场景编辑框架，TIPEditor，它接受文本和图像提示以及3D边界框来指定编辑区域。通过图像提示，用户可以方便地指定目标内容的详细外观/风格，以补充文本描述，实现外观的精确控制。具体而言，TIP-Editor采用逐步的2D个性化策略来更好地学习现有场景和参考图像的表示，其中提出了一个定位损失来鼓励按照边界框指定的正确对象放置。此外，TIPEditor利用显式和灵活的3D高斯光斑作为3D表示，以促进局部编辑同时保持背景不变。大量实验证明，TIP-Editor在指定边界框区域内根据文本和图像提示进行精确编辑，始终优于基准线在编辑质量和对提示的对齐方面，在定性和定量上表现出色。

English

Text-driven 3D scene editing has gained significant attention owing to its convenience and user-friendliness. However, existing methods still lack accurate control of the specified appearance and location of the editing result due to the inherent limitations of the text description. To this end, we propose a 3D scene editing framework, TIPEditor, that accepts both text and image prompts and a 3D bounding box to specify the editing region. With the image prompt, users can conveniently specify the detailed appearance/style of the target content in complement to the text description, enabling accurate control of the appearance. Specifically, TIP-Editor employs a stepwise 2D personalization strategy to better learn the representation of the existing scene and the reference image, in which a localization loss is proposed to encourage correct object placement as specified by the bounding box. Additionally, TIPEditor utilizes explicit and flexible 3D Gaussian splatting as the 3D representation to facilitate local editing while keeping the background unchanged. Extensive experiments have demonstrated that TIP-Editor conducts accurate editing following the text and image prompts in the specified bounding box region, consistently outperforming the baselines in editing quality, and the alignment to the prompts, qualitatively and quantitatively.

TIP-Editor：一款准确的3D编辑器，可以根据文本提示和图像提示进行编辑。

TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts

摘要

Support