SPRITE：从静态设计稿到引擎就绪的游戏用户界面

SPRITE: From Static Mockups to Engine-Ready Game UI

March 18, 2026

作者: Yunshu Bai, RuiHao Li, Hao Zhang, Chien Her Lim, Ming Yan, Mengtian Li

cs.AI

摘要

游戏用户界面的实现需要将风格化设计稿转化为交互式引擎实体。然而当前"截图转代码"工具往往难以处理游戏界面特有的不规则几何形状和深层视觉层级。为弥合这一鸿沟，我们提出SPRITE技术管线，能够将静态截图转换为可编辑的引擎资源。通过融合视觉语言模型与结构化YAML中间表示，SPRITE可精准捕捉复杂容器关系和非矩形布局。我们在精选的游戏UI基准测试中评估了SPRITE系统，并邀请专业开发者进行专家评审以评估重构保真度和原型制作效率。研究结果表明，SPRITE通过自动化繁琐编码和解析复杂嵌套关系，有效提升了开发效率。通过支持快速的引擎内迭代，SPRITE成功模糊了游戏开发中艺术设计与技术实现之间的界限。项目页面：https://baiyunshu.github.io/sprite.github.io/

English

Game UI implementation requires translating stylized mockups into interactive engine entities. However, current "Screenshot-to-Code" tools often struggle with the irregular geometries and deep visual hierarchies typical of game interfaces. To bridge this gap, we introduce SPRITE, a pipeline that transforms static screenshots into editable engine assets. By integrating Vision-Language Models (VLMs) with a structured YAML intermediate representation, SPRITE explicitly captures complex container relationships and non-rectangular layouts. We evaluated SPRITE against a curated Game UI benchmark and conducted expert reviews with professional developers to assess reconstruction fidelity and prototyping efficiency. Our findings demonstrate that SPRITE streamlines development by automating tedious coding and resolving complex nesting. By facilitating rapid in-engine iteration, SPRITE effectively blurs the boundaries between artistic design and technical implementation in game development. Project page: https://baiyunshu.github.io/sprite.github.io/