RT-Splatting: 基于高斯溅射的反射与透射联合建模

摘要

3D高斯溅射（3DGS）实现了具有高视觉质量的实时新视角合成。然而，现有方法在处理兼具复杂反射和清晰透射的半透明镜面表面时仍存在困难，常导致反射模糊或透射过度遮挡。为此，我们提出RT-Splatting框架，该框架将每个高斯体的几何占据与光学不透明度解耦。这种分解方式通过单一高斯基元集合，构建了统一的表面-体积场景表示。我们的混合渲染器将该表示既解释为捕捉高频反射的表面，也视为保持清晰透射的体积。为缓解反射与透射联合优化中的歧义性，我们引入了镜面感知梯度门控机制，抑制高镜面区域向透射分支传递的误导梯度，有效减少干扰性漂浮伪影。在挑战性半透明场景上的实验表明，RT-Splatting实现了最先进性能，以实时渲染能力提供高保真反射与清晰透射。此外，我们的分解机制自然地支持灵活的场景编辑。项目主页访问地址：https://sjj118.github.io/RT-Splatting。

English

3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often producing blurry reflections or overly occluded transmission. To address this, we present RT-Splatting, a framework that disentangles each Gaussian's geometric occupancy from its optical opacity. This factorization yields a unified surface-volume scene representation with a single set of Gaussian primitives. Our hybrid renderer interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission. To mitigate the ambiguity in jointly optimizing reflection and transmission, we introduce Specular-Aware Gradient Gating, which suppresses misleading gradients from highly specular regions into the transmission branch, effectively reducing distracting floaters. Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering. Moreover, our factorization naturally enables flexible scene editing. The project page is available at https://sjj118.github.io/RT-Splatting.