ChatPaper.aiChatPaper

ComfyUI-Copilot:自动化工作流开发的智能助手

ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development

June 5, 2025
作者: Zhenran Xu, Xue Yang, Yiyu Wang, Qingli Hu, Zijiao Wu, Longyue Wang, Weihua Luo, Kaifu Zhang, Baotian Hu, Min Zhang
cs.AI

摘要

我们推出ComfyUI-Copilot,这是一款基于大型语言模型的插件,旨在提升ComfyUI这一开源AI艺术创作平台的易用性和效率。尽管ComfyUI具备灵活性和用户友好界面,但对新手而言,仍面临文档有限、模型配置错误及工作流设计复杂等挑战。ComfyUI-Copilot通过提供智能节点与模型推荐,以及自动化的一键工作流构建,有效应对了这些问题。其核心采用了一个层次化的多代理框架,包括一个负责任务分配的中心助理代理和针对不同用途的专业工作代理,辅以我们精心整理的ComfyUI知识库,以简化调试与部署流程。我们通过离线定量评估和在线用户反馈验证了ComfyUI-Copilot的有效性,证明其能准确推荐节点并加速工作流开发。此外,应用案例表明,ComfyUI-Copilot降低了初学者的入门门槛,同时提升了资深用户的工作流效率。ComfyUI-Copilot的安装包及演示视频可在https://github.com/AIDC-AI/ComfyUI-Copilot获取。
English
We introduce ComfyUI-Copilot, a large language model-powered plugin designed to enhance the usability and efficiency of ComfyUI, an open-source platform for AI-driven art creation. Despite its flexibility and user-friendly interface, ComfyUI can present challenges to newcomers, including limited documentation, model misconfigurations, and the complexity of workflow design. ComfyUI-Copilot addresses these challenges by offering intelligent node and model recommendations, along with automated one-click workflow construction. At its core, the system employs a hierarchical multi-agent framework comprising a central assistant agent for task delegation and specialized worker agents for different usages, supported by our curated ComfyUI knowledge bases to streamline debugging and deployment. We validate the effectiveness of ComfyUI-Copilot through both offline quantitative evaluations and online user feedback, showing that it accurately recommends nodes and accelerates workflow development. Additionally, use cases illustrate that ComfyUI-Copilot lowers entry barriers for beginners and enhances workflow efficiency for experienced users. The ComfyUI-Copilot installation package and a demo video are available at https://github.com/AIDC-AI/ComfyUI-Copilot.
PDF411June 6, 2025