只需遵循原则指导即可质疑 LLaMA-1/2、GPT-3.5/4。

Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4

December 26, 2023

作者: Sondos Mahmoud Bsharat, Aidar Myrzakhan, Zhiqiang Shen

cs.AI

摘要

本文介绍了26条指导原则，旨在简化查询和提示大型语言模型的过程。我们的目标是简化为各种规模的大型语言模型制定问题的基本概念，检验它们的能力，并增强用户对不同规模的大型语言模型在输入不同提示时行为的理解。我们在LLaMA-1/2（7B、13B和70B）、GPT-3.5/4上进行了大量实验，以验证所提原则对指令和提示设计的有效性。我们希望这项工作为从事大型语言模型提示研究的研究人员提供更好的指导。项目页面位于https://github.com/VILA-Lab/ATLAS。

English

This paper introduces 26 guiding principles designed to streamline the process of querying and prompting large language models. Our goal is to simplify the underlying concepts of formulating questions for various scales of large language models, examining their abilities, and enhancing user comprehension on the behaviors of different scales of large language models when feeding into different prompts. Extensive experiments are conducted on LLaMA-1/2 (7B, 13B and 70B), GPT-3.5/4 to verify the effectiveness of the proposed principles on instructions and prompts design. We hope that this work provides a better guide for researchers working on the prompting of large language models. Project page is available at https://github.com/VILA-Lab/ATLAS.