界面重构:通过交互式范例检索与再设计支持用户界面创作
UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing
January 26, 2026
作者: Junling Wang, Hongyi Lan, Xiaotian Su, Mustafa Doga Dogan, April Yi Wang
cs.AI
摘要
在產品發佈、作品集建構或專案個性化過程中,使用者介面(UI)設計是關鍵環節,但缺乏設計專業背景的終端使用者往往難以精準表達設計意圖,且對設計決策缺乏信心。現有的範例式工具要麼鼓勵廣泛探索(易導致選擇過載與設計方向偏離),要麼要求基於單一範例調整(存在設計定勢風險)。我們提出UI Remix互動系統,通過範例驅動的設計工作流程支援行動UI設計。該系統基於多模態檢索增強生成(MMRAG)模型,允許使用者在整體介面層面與局部組件層面進行迭代式搜尋、選擇和調整。為建立信任機制,系統提供來源透明度提示(如評分、下載量、開發者資訊)。透過對24位終端使用者的實證研究發現,UI Remix顯著提升了參與者達成設計目標的能力,促進了有效迭代,並激發了對替代設計方案的探索。參與者同時反饋來源透明度提示增強了他們調整範例的信心。本研究為AI輔助的範例驅動系統開拓了新方向,使終端使用者能以更強的控制力、信任感及探索開放性進行設計。
English
Designing user interfaces (UIs) is a critical step when launching products, building portfolios, or personalizing projects, yet end users without design expertise often struggle to articulate their intent and to trust design choices. Existing example-based tools either promote broad exploration, which can cause overwhelm and design drift, or require adapting a single example, risking design fixation. We present UI Remix, an interactive system that supports mobile UI design through an example-driven design workflow. Powered by a multimodal retrieval-augmented generation (MMRAG) model, UI Remix enables iterative search, selection, and adaptation of examples at both the global (whole interface) and local (component) level. To foster trust, it presents source transparency cues such as ratings, download counts, and developer information. In an empirical study with 24 end users, UI Remix significantly improved participants' ability to achieve their design goals, facilitated effective iteration, and encouraged exploration of alternative designs. Participants also reported that source transparency cues enhanced their confidence in adapting examples. Our findings suggest new directions for AI-assisted, example-driven systems that empower end users to design with greater control, trust, and openness to exploration.