RT-Splatting：基於高斯潑濺的反射與傳輸聯合建模

摘要

3D高斯噴濺（3DGS）技術能實現即時的新視角合成，並具備高視覺品質。然而，現有方法在處理兼具複雜反射與清晰透射的半透明鏡面表面時常遭遇困難，往往產生模糊的反射或過度遮擋的透射。為解決此問題，我們提出RT-Splatting框架，該框架將每個高斯元的幾何佔有率與光學不透明度進行解耦。此因式分解透過單一組高斯原語，產生統一的表面-體積場景表示法。我們的混合渲染器將此表示法同時詮釋為捕捉高頻反射的表面，以及保留清晰透射的體積。為減輕聯合最佳化反射與透射時的不明確性，我們引入鏡面感知梯度閘控機制，抑制來自高度鏡面區域的誤導梯度進入透射分支，有效減少干擾性浮游物。在具挑戰性的半透明場景實驗中，RT-Splatting展現最先進的效能，在即時渲染下同時提供高保真反射與清晰透射。此外，我們的因式分解自然實現了靈活的場景編輯。專案頁面請見https://sjj118.github.io/RT-Splatting。

English

3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often producing blurry reflections or overly occluded transmission. To address this, we present RT-Splatting, a framework that disentangles each Gaussian's geometric occupancy from its optical opacity. This factorization yields a unified surface-volume scene representation with a single set of Gaussian primitives. Our hybrid renderer interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission. To mitigate the ambiguity in jointly optimizing reflection and transmission, we introduce Specular-Aware Gradient Gating, which suppresses misleading gradients from highly specular regions into the transmission branch, effectively reducing distracting floaters. Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering. Moreover, our factorization naturally enables flexible scene editing. The project page is available at https://sjj118.github.io/RT-Splatting.