UI重混:通过交互式案例检索与重构支持界面设计
UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing
January 26, 2026
作者: Junling Wang, Hongyi Lan, Xiaotian Su, Mustafa Doga Dogan, April Yi Wang
cs.AI
摘要
设计用户界面(UI)是产品发布、作品集构建或项目个性化过程中的关键环节,但缺乏设计专业知识的终端用户往往难以准确表达设计意图并信赖设计决策。现有的示例型工具要么支持广泛探索(易导致选择过载和设计偏离),要么仅允许基于单一案例调整(存在设计固化的风险)。我们推出UI Remix交互系统,该系统通过示例驱动的工作流支持移动端UI设计。基于多模态检索增强生成(MMRAG)技术,UI Remix支持在全局(完整界面)和局部(组件)层级进行迭代式搜索、选择与适配。为增强可信度,系统提供评分、下载量、开发者信息等来源透明度提示。在24名终端用户的实证研究中,UI Remix显著提升了参与者实现设计目标的能力,促进了有效迭代,并鼓励了对替代设计的探索。参与者反馈来源透明度提示增强了他们适配示例的信心。本研究为AI辅助的示例驱动系统指明了新方向,使终端用户能以更强控制力、更高信任度和更开放心态进行设计探索。
English
Designing user interfaces (UIs) is a critical step when launching products, building portfolios, or personalizing projects, yet end users without design expertise often struggle to articulate their intent and to trust design choices. Existing example-based tools either promote broad exploration, which can cause overwhelm and design drift, or require adapting a single example, risking design fixation. We present UI Remix, an interactive system that supports mobile UI design through an example-driven design workflow. Powered by a multimodal retrieval-augmented generation (MMRAG) model, UI Remix enables iterative search, selection, and adaptation of examples at both the global (whole interface) and local (component) level. To foster trust, it presents source transparency cues such as ratings, download counts, and developer information. In an empirical study with 24 end users, UI Remix significantly improved participants' ability to achieve their design goals, facilitated effective iteration, and encouraged exploration of alternative designs. Participants also reported that source transparency cues enhanced their confidence in adapting examples. Our findings suggest new directions for AI-assisted, example-driven systems that empower end users to design with greater control, trust, and openness to exploration.