GPT4All：开源压缩语言模型生态系统

摘要

最近，大型语言模型（LLMs）在各种专业和学术基准测试中取得了人类水平的表现。然而，这些模型的可访问性远远落后于它们的性能。最先进的LLMs需要昂贵的基础设施；只能通过限速、地理锁定和审查的网络界面访问；并且缺乏公开的代码和技术报告。本文讲述了GPT4All的故事，这是一个旨在使LLMs的访问民主化的流行开源存储库。我们概述了最初的GPT4All模型系列的技术细节，以及GPT4All项目从单一模型发展为完整的开源生态系统的演变。我们希望本文既是对原始GPT4All模型的技术概述，也是对GPT4All开源生态系统随后发展的案例研究。

English

Large language models (LLMs) have recently achieved human-level performance on a range of professional and academic benchmarks. The accessibility of these models has lagged behind their performance. State-of-the-art LLMs require costly infrastructure; are only accessible via rate-limited, geo-locked, and censored web interfaces; and lack publicly available code and technical reports. In this paper, we tell the story of GPT4All, a popular open source repository that aims to democratize access to LLMs. We outline the technical details of the original GPT4All model family, as well as the evolution of the GPT4All project from a single model into a fully fledged open source ecosystem. It is our hope that this paper acts as both a technical overview of the original GPT4All models as well as a case study on the subsequent growth of the GPT4All open source ecosystem.

GPT4All：开源压缩语言模型生态系统

GPT4All: An Ecosystem of Open Source Compressed Language Models

摘要

Support