Shai：用于资产管理的大型语言模型

摘要

本文介绍了“Shai”，这是一个专为资产管理行业设计的100亿级大型语言模型，构建在一个开源基础模型之上。通过持续的预训练和微调，利用定向语料库，Shai在与其领域相关的任务中展现出卓越的性能，超越了基准模型。我们的研究包括开发了一种创新的评估框架，该框架整合了专业资格考试、定制任务、开放式问题回答以及安全评估，全面评估了Shai的能力。此外，我们讨论了在资产管理中利用像GPT-4这样的大型语言模型进行性能评估所面临的挑战和影响，并建议结合自动化评估和人类判断。Shai的开发展示了100亿级大型语言模型在金融领域中的潜力和多样性，具有显著的性能和适度的计算需求，希望为行业同行提供实用的见解和方法，以协助他们进行类似的努力。

English

This paper introduces "Shai" a 10B level large language model specifically designed for the asset management industry, built upon an open-source foundational model. With continuous pre-training and fine-tuning using a targeted corpus, Shai demonstrates enhanced performance in tasks relevant to its domain, outperforming baseline models. Our research includes the development of an innovative evaluation framework, which integrates professional qualification exams, tailored tasks, open-ended question answering, and safety assessments, to comprehensively assess Shai's capabilities. Furthermore, we discuss the challenges and implications of utilizing large language models like GPT-4 for performance assessment in asset management, suggesting a combination of automated evaluation and human judgment. Shai's development, showcasing the potential and versatility of 10B-level large language models in the financial sector with significant performance and modest computational requirements, hopes to provide practical insights and methodologies to assist industry peers in their similar endeavors.

Shai：用于资产管理的大型语言模型

Shai: A large language model for asset management

摘要

Support