SPRITE：从静态效果图到引擎就绪的游戏用户界面

SPRITE: From Static Mockups to Engine-Ready Game UI

March 18, 2026

作者: Yunshu Bai, RuiHao Li, Hao Zhang, Chien Her Lim, Ming Yan, Mengtian Li

cs.AI

摘要

游戏界面实现需要将风格化设计稿转换为可交互的引擎实体。然而，当前"截图转代码"工具往往难以处理游戏界面典型的非常规几何形状和深层视觉层级结构。为填补这一空白，我们推出SPRITE技术方案——一种将静态截图转化为可编辑引擎资源的流程。通过融合视觉语言模型与结构化YAML中间表示，SPRITE能够精准捕捉复杂的容器关系和非矩形布局。我们在精选的游戏UI基准测试集上评估了SPRITE方案，并邀请专业开发者进行专家评审，以评估其重构保真度和原型制作效率。研究结果表明，SPRITE通过自动化繁琐的编码工作和解析复杂嵌套关系，有效优化了开发流程。通过促进引擎内的快速迭代，SPRITE成功模糊了游戏开发中艺术设计与技术实现之间的界限。项目页面：https://baiyunshu.github.io/sprite.github.io/

English

Game UI implementation requires translating stylized mockups into interactive engine entities. However, current "Screenshot-to-Code" tools often struggle with the irregular geometries and deep visual hierarchies typical of game interfaces. To bridge this gap, we introduce SPRITE, a pipeline that transforms static screenshots into editable engine assets. By integrating Vision-Language Models (VLMs) with a structured YAML intermediate representation, SPRITE explicitly captures complex container relationships and non-rectangular layouts. We evaluated SPRITE against a curated Game UI benchmark and conducted expert reviews with professional developers to assess reconstruction fidelity and prototyping efficiency. Our findings demonstrate that SPRITE streamlines development by automating tedious coding and resolving complex nesting. By facilitating rapid in-engine iteration, SPRITE effectively blurs the boundaries between artistic design and technical implementation in game development. Project page: https://baiyunshu.github.io/sprite.github.io/