ModelScope-Agent：使用開源大型語言模型構建可定制的代理系統

ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models

September 2, 2023

作者: Chenliang Li, Hehong Chen, Ming Yan, Weizhou Shen, Haiyang Xu, Zhikai Wu, Zhicheng Zhang, Wenmeng Zhou, Yingda Chen, Chen Cheng, Hongzhu Shi, Ji Zhang, Fei Huang, Jingren Zhou

cs.AI

摘要

近來，大型語言模型（LLMs）展現出了非凡的能力，能夠理解人類意圖、進行推理，並設計類似規劃的行為。為了進一步發揮LLMs的能力來完成複雜任務，目前越來越多的趨勢是建立代理程式框架，為LLMs（如ChatGPT）配備工具使用能力，以連接大量外部API。在這項工作中，我們介紹了ModelScope-Agent，這是一個基於開源LLMs作為控制器的通用且可定製的代理程式框架，用於真實應用。它提供了一個用戶友好的系統庫，具有可定製的引擎設計，支持在多個開源LLMs上進行模型訓練，同時也以統一方式實現與模型API和常見API的無縫集成。為了賦予LLMs工具使用能力，提出了一個全面的框架，涵蓋工具使用數據收集、工具檢索、工具註冊、記憶控制、定製模型訓練以及實際應用的評估。最後，我們展示了ModelScopeGPT，這是基於ModelScope-Agent框架的ModelScope社群的真實世界智能助理，能夠將開源LLMs與超過1000個公共AI模型以及ModelScope中的本地化社群知識相連接。ModelScope-Agent庫https://github.com/modelscope/modelscope-agent 和在線演示https://modelscope.cn/studios/damo/ModelScopeGPT/summary 現已公開提供。

English

Large language models (LLMs) have recently demonstrated remarkable capabilities to comprehend human intentions, engage in reasoning, and design planning-like behavior. To further unleash the power of LLMs to accomplish complex tasks, there is a growing trend to build agent framework that equips LLMs, such as ChatGPT, with tool-use abilities to connect with massive external APIs. In this work, we introduce ModelScope-Agent, a general and customizable agent framework for real-world applications, based on open-source LLMs as controllers. It provides a user-friendly system library, with customizable engine design to support model training on multiple open-source LLMs, while also enabling seamless integration with both model APIs and common APIs in a unified way. To equip the LLMs with tool-use abilities, a comprehensive framework has been proposed spanning over tool-use data collection, tool retrieval, tool registration, memory control, customized model training, and evaluation for practical real-world applications. Finally, we showcase ModelScopeGPT, a real-world intelligent assistant of ModelScope Community based on the ModelScope-Agent framework, which is able to connect open-source LLMs with more than 1000 public AI models and localized community knowledge in ModelScope. The ModelScope-Agent libraryhttps://github.com/modelscope/modelscope-agent and online demohttps://modelscope.cn/studios/damo/ModelScopeGPT/summary are now publicly available.