結合串流力控制的串流影片生成

摘要

我們提出StreamForce，這是一個流式影片生成框架，能夠透過連續力輸入實現基於物理的控制。不同於過去針對不同力類型訓練獨立模型、假設固定力或依賴非因果處理的影片模型，StreamForce是一個因果統一的模型，能即時且連貫地回應局部與全域的時變力。為達成此目標，我們設計了一個統一的力表示作為控制訊號，並開發了一套用於力可控影片生成的蒸餾流程。我們的模型結合了自回歸效率與力響應能力，維持穩定的光度與動態真實性。StreamForce在單一GPU上最高可達16.6 FPS，在力的遵循度與動作真實性方面均達到最先進的效能。專案網站：https://neu-vi.github.io/StreamForce/

English

We introduce StreamForce, a streaming video generation framework that enables physically grounded control through continuous force inputs. Unlike prior video models that train separate models for different force types, assume fixed forces, or rely on non-causal processing, StreamForce is a causal and unified model that responds instantly and coherently to both local and global, time-varying forces. To achieve this, we design a unified force representation as a control signal and develop a distillation pipeline for force-controllable video generation. Our model combines autoregressive efficiency with force responsiveness, sustaining stable photometric and dynamic realism. StreamForce runs at up to 16.6 FPS on a single GPU, achieving state-of-the-art performance in both force adherence and motion realism. Project website: https://neu-vi.github.io/StreamForce/