SketchDynamics：探索自由手绘草图在动画生成中的动态意图表达

摘要

素描为动画创作提供了一种直观传达动态意图的方式（即元素如何随时间与空间变化），使其成为自动内容生成的天然媒介。然而现有方法常将素描局限于固定指令标记或预定义视觉形态，忽视了其自由形式的本质以及人类在意图塑造中的核心作用。为此，我们提出一种交互范式：用户通过自由手绘向视觉语言模型传达动态意图，并以草图故事板到动态图形的流程实现该范式。我们开发了交互界面，并通过24名参与者的三阶段研究进行优化。研究表明：素描能以极简输入传递运动信息，其固有模糊性需用户参与澄清，且能通过视觉引导实现视频精细化调整。我们的发现揭示了素描与AI交互在弥合意图与结果之间鸿沟的潜力，并验证了其在3D动画和视频生成领域的适用性。

English

Sketching provides an intuitive way to convey dynamic intent in animation authoring (i.e., how elements change over time and space), making it a natural medium for automatic content creation. Yet existing approaches often constrain sketches to fixed command tokens or predefined visual forms, overlooking their freeform nature and the central role of humans in shaping intention. To address this, we introduce an interaction paradigm where users convey dynamic intent to a vision-language model via free-form sketching, instantiated here in a sketch storyboard to motion graphics workflow. We implement an interface and improve it through a three-stage study with 24 participants. The study shows how sketches convey motion with minimal input, how their inherent ambiguity requires users to be involved for clarification, and how sketches can visually guide video refinement. Our findings reveal the potential of sketch and AI interaction to bridge the gap between intention and outcome, and demonstrate its applicability to 3D animation and video generation.

SketchDynamics：探索自由手绘草图在动画生成中的动态意图表达

SketchDynamics: Exploring Free-Form Sketches for Dynamic Intent Expression in Animation Generation

摘要

Support