GPT 可以在沒有計算機的情況下解決數學問題。
GPT Can Solve Mathematical Problems Without a Calculator
September 6, 2023
作者: Zhen Yang, Ming Ding, Qingsong Lv, Zhihuan Jiang, Zehai He, Yuyi Guo, Jinfeng Bai, Jie Tang
cs.AI
摘要
先前的研究通常假設大型語言模型無法準確執行算術運算，特別是超過8位數的乘法，以及涉及小數和分數的運算，而無需使用計算器工具。本文旨在挑戰這種誤解。通過充足的訓練數據，一個擁有20億參數的語言模型可以在幾乎100%的準確率下進行多位數算術運算，並且沒有數據洩露問題，顯著超越了GPT-4（其多位數乘法的準確率僅為4.3%）。我們還展示了我們的MathGLM，從在文本中描述的具有額外多步算術運算和數學問題的數據集上對GLM-10B進行微調，實現了與GPT-4在一個包含5,000個樣本的中文數學問題測試集上類似的性能。
English
Previous studies have typically assumed that large language models are unable
to accurately perform arithmetic operations, particularly multiplication of >8
digits, and operations involving decimals and fractions, without the use of
calculator tools. This paper aims to challenge this misconception. With
sufficient training data, a 2 billion-parameter language model can accurately
perform multi-digit arithmetic operations with almost 100% accuracy without
data leakage, significantly surpassing GPT-4 (whose multi-digit multiplication
accuracy is only 4.3%). We also demonstrate that our MathGLM, fine-tuned from
GLM-10B on a dataset with additional multi-step arithmetic operations and math
problems described in text, achieves similar performance to GPT-4 on a
5,000-samples Chinese math problem test set.