论开放基础模型对社会的影响

摘要

基础模型是强大的技术：它们如何公开发布直接影响其社会影响。在这篇立场论文中，我们关注开放基础模型，这里定义为具有广泛可用模型权重的模型（例如Llama 2，Stable Diffusion XL）。我们确定了开放基础模型的五个独特特性（例如更大的可定制性，监控不足），这些特性导致了它们的益处和风险。开放基础模型提供了重要的益处，但也有一些注意事项，涵盖了创新、竞争、决策权分配和透明度。为了理解它们被滥用的风险，我们设计了一个风险评估框架，用于分析它们的边际风险。在几个滥用向量（例如网络攻击、生物武器）中，我们发现目前的研究不足以有效地表征开放基础模型相对于现有技术的边际风险。该框架有助于解释为什么在某些情况下边际风险较低，通过揭示过去的研究集中于框架的不同子集并具有不同的假设，澄清了关于滥用风险的分歧，并阐明了更具建设性辩论的前进之路。总的来说，我们的工作通过概述需要进行的研究来从经验上验证开放基础模型的理论益处和风险，有助于支持对开放基础模型社会影响的更加扎实的评估。

English

Foundation models are powerful technologies: how they are released publicly directly shapes their societal impact. In this position paper, we focus on open foundation models, defined here as those with broadly available model weights (e.g. Llama 2, Stable Diffusion XL). We identify five distinctive properties (e.g. greater customizability, poor monitoring) of open foundation models that lead to both their benefits and risks. Open foundation models present significant benefits, with some caveats, that span innovation, competition, the distribution of decision-making power, and transparency. To understand their risks of misuse, we design a risk assessment framework for analyzing their marginal risk. Across several misuse vectors (e.g. cyberattacks, bioweapons), we find that current research is insufficient to effectively characterize the marginal risk of open foundation models relative to pre-existing technologies. The framework helps explain why the marginal risk is low in some cases, clarifies disagreements about misuse risks by revealing that past work has focused on different subsets of the framework with different assumptions, and articulates a way forward for more constructive debate. Overall, our work helps support a more grounded assessment of the societal impact of open foundation models by outlining what research is needed to empirically validate their theoretical benefits and risks.

论开放基础模型对社会的影响

On the Societal Impact of Open Foundation Models

摘要

Summary

Support

Support