同一场景,两种深度:探究单目基础模型中的几何歧义性
One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models
June 28, 2026
作者: Xiaohao Xu, Feng Xue, Xiang Li, Haowei Li, Shusheng Yang, Tianyi Zhang, Matthew Johnson-Roberson, Xiaonan Huang
cs.AI
摘要
一个忠实的三维世界表征应考虑分层几何结构,其中单条相机光线可能包含多个可见且几何有效的表面。然而,单目深度估计将此结构简化为每个像素一个标量深度值。透明场景使这种模糊性变得可测量:同一光线可穿过前景玻璃观察到背景,将监督目标转变为标注、数据和训练的习惯约定,而非场景固有的真实值。学习得到的预测器将其深度层偏好暴露为这种约定。我们提出MultiDepth-3k(MD-3k),一个稀疏双层序数基准,用于测量深度层偏好和多层空间关系准确度(ML-SRA)。在MD-3k上,领先的深度基础模型在标准RGB输入下展现出多样的层偏好,表明相同的分层几何结构在不同模型间可被不同解析。我们进一步发现,拉普拉斯视觉提示(LVP)——一种无需训练的频谱输入变换——可以显著改变某些冻结模型所报告的层。最强的RGB/LVP组合DAv2-L达到75.5%的ML-SRA。这些结果表明,深度基础模型可能表达了互补的几何假设,而标准RGB推理将这些假设保留未表达。我们邀请学界通过模糊性感知视角重新思考深度监督与评估,将多个有效的三维解释视为待测量、保留和表达的几何结构。
English
A faithful 3D world representation should account for layered geometry, where a single camera ray may contain multiple visible and geometrically valid surfaces. Monocular depth estimation, however, reduces this structure to one scalar depth per pixel. Transparent scenes make this ambiguity measurable: the same ray can pass through foreground glass and observe the background, turning the supervised target into a convention of annotation, data, and training rather than a scene-intrinsic truth. A learned predictor exposes this convention as its depth-layer preference. We introduce MultiDepth-3k (MD-3k), a sparse two-layer ordinal benchmark for measuring depth-layer preference and multi-layer spatial relationship accuracy (ML-SRA). On MD-3k, leading depth foundation models exhibit diverse layer preferences under standard RGB input, showing that the same layered geometry can be resolved differently across models. We further find that Laplacian Visual Prompting (LVP), a training-free spectral input transformation, can substantially change the reported layer for certain frozen models. The strongest RGB/LVP pair, DAv2-L, reaches 75.5% ML-SRA. These results suggest that depth foundation models may express complementary geometric hypotheses that standard RGB inference leaves unexpressed. We invite the community to rethink depth supervision and evaluation through an ambiguity-aware lens, where multiple valid 3D interpretations are treated as geometric structure to be measured, preserved, and expressed.