SF3D：稳定快速的三维网格重建，配备UV展开和光照解耦。

SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement

August 1, 2024

作者: Mark Boss, Zixuan Huang, Aaryaman Vasishta, Varun Jampani

cs.AI

摘要

我们提出了SF3D，一种新颖的方法，可以在仅0.5秒内从单个图像中快速高质量地重建带纹理的物体网格。与大多数现有方法不同，SF3D明确针对网格生成进行训练，结合了一种快速UV展开技术，可以快速生成纹理，而不是依赖顶点颜色。该方法还学习预测材质参数和法线贴图，以增强重建的3D网格的视觉质量。此外，SF3D集成了去光步骤，有效消除低频照明效果，确保重建的网格可以轻松用于新的照明条件。实验证明了SF3D相对于现有技术的卓越性能。项目页面：https://stable-fast-3d.github.io

English

We present SF3D, a novel method for rapid and high-quality textured object mesh reconstruction from a single image in just 0.5 seconds. Unlike most existing approaches, SF3D is explicitly trained for mesh generation, incorporating a fast UV unwrapping technique that enables swift texture generation rather than relying on vertex colors. The method also learns to predict material parameters and normal maps to enhance the visual quality of the reconstructed 3D meshes. Furthermore, SF3D integrates a delighting step to effectively remove low-frequency illumination effects, ensuring that the reconstructed meshes can be easily used in novel illumination conditions. Experiments demonstrate the superior performance of SF3D over the existing techniques. Project page: https://stable-fast-3d.github.io