数学家的大型语言模型

摘要

大型语言模型（LLMs）如ChatGPT因其通用语言理解能力而备受关注，尤其是它们生成高质量文本或计算机代码的能力。对许多专业人士而言，LLMs是一种无价的工具，可以加快工作速度并提高工作质量。在本文中，我们讨论它们在帮助专业数学家方面的潜力。我们首先对所有现代语言模型中使用的Transformer模型进行数学描述。基于最近的研究，我们概述最佳实践和潜在问题，并报告语言模型的数学能力。最后，我们阐明了LLMs改变数学家工作方式的潜力。

English

Large language models (LLMs) such as ChatGPT have received immense interest for their general-purpose language understanding and, in particular, their ability to generate high-quality text or computer code. For many professions, LLMs represent an invaluable tool that can speed up and improve the quality of work. In this note, we discuss to what extent they can aid professional mathematicians. We first provide a mathematical description of the transformer model used in all modern language models. Based on recent studies, we then outline best practices and potential issues and report on the mathematical abilities of language models. Finally, we shed light on the potential of LMMs to change how mathematicians work.

数学家的大型语言模型

Large Language Models for Mathematicians

摘要

Support