Roomer:用於三維室內佈局生成的反思式物體基礎模型編輯與修復
Roomer: Reflective Object-Grounded Model Editing and Repair for 3D Indoor Layout Synthesis
August 3, 2026
作者: Lingwei Dang, Ziyan Qiu, Jiajia Cheng, Shishuo Shang, Zhenhao Zhang, Yufei Zhu, Qingxin Xiao, Pan Liu, Shenghui Huang, Yun Hao, Juntong Li, Qingyao Wu
cs.AI
摘要
現有的室內佈局生成器所產生的佈局,雖然整體上看似合理,但仍可能保留局部性的違規問題,例如碰撞、超出邊界、開口受阻,以及動線不通暢等。過往研究大多專注於全場景生成或場景層級的優化,對於辨識責任物體並局部修復受影響區域的支援相當有限。我們提出 Roomer,一個具反思能力的修復框架,將這些違規問題轉化為稀疏的、以物體為基礎的修復任務。Roomer 將佈局編碼為「RoState」,並利用「RoReview」將量測到的違規問題綁定到相關物體上。一個由幾何條件驅動的視覺語言模型規劃器會提出結構化的局部編輯,而一個確定性求解器則負責驗證該編輯,並在必要時產生一組有限的候選編輯。每個候選編輯只有在全場景驗證確認其能解決目標違規問題,且不會引入新的嚴重違規或破壞受保護約束時,才會被採用。我們在 Roomer-CC 上訓練該規劃器;Roomer-CC 是一個受控破壞資料集,將有缺陷的佈局與基於物體的違規證據以及已知可行的反向 StatePatch 配對。由於現有基準很少評估物理上有效的佈局是否真正可用,我們引入了 Roomer-Eval 來評估分佈品質、物理有效性與實際可用性。實驗顯示,Roomer 能夠修復殘餘違規問題,同時保留有效區域,提升物理有效性與可用性,並且能跨外部生成器遷移。
English
Existing indoor layout generators produce globally plausible layouts yet may retain local violations such as collisions, out-of-bounds placements, obstructed openings, and blocked circulation. Most prior work focuses on full-scene synthesis or scene-level optimization, with limited support for identifying responsible objects and locally repairing affected regions. We present Roomer, a reflective repair framework that casts these violations as sparse, object-grounded repair problems. Roomer encodes layouts as ``RoState'' and uses ``RoReview'' to bind measured violations to implicated objects. A geometry-conditioned vision-language model planner proposes a structured local edit, while a deterministic solver validates it and generates a finite set of candidate edits when needed. Each candidate is committed only if full-scene verification confirms that it resolves the target violation without new hard violations or broken protected constraints. We train the planner on Roomer-CC, a controlled-corruption dataset that pairs faulty layouts with object-grounded violation evidence and known-feasible inverse StatePatches. Since existing benchmarks rarely assess whether physically valid layouts are usable, we introduce Roomer-Eval to assess distributional quality, physical validity, and practical usability. Experiments show that Roomer repairs residual violations while preserving valid regions, improves physical validity and usability, and transfers across external generators.