小模型，大作为：探索紧凑型语言模型

摘要

尽管大语言模型近期主导了研究格局，但小语言模型在多个领域仍保持高度相关性，然而其受到的关注却少得多。本研究探究了较小语言模型在检索增强生成（RAG）系统中生成阶段的表现。为有效评估这些模型，我们采用了涵盖多种学科领域和问题类型的开源与专有数据集。研究结果表明，搭载小语言模型的RAG系统可直接在设备端运行，在合理时间内无需任何GPU硬件支持。实验代码及补充材料链接可通过GitHub仓库获取：https://github.com/SibNN/SLM-RAG-EVAL。

English

While large language models have been dominating the research landscape recently, small language models remain highly relevant across various domains; yet, they receive far less attention. In this study, we investigate how smaller language models perform during the generation stage within a Retrieval-Augmented Generation (RAG) system. To benchmark these models effectively, we utilised both open-source and proprietary datasets covering diverse subject areas and question types. Our findings demonstrate that a RAG system with small language models can be executed directly on-device without requiring any GPU hardware within a reasonable time. The experimental code and links to the supplementary materials can be accessed through the GitHub repository: https://github.com/SibNN/SLM-RAG-EVAL.