對於質疑 LLaMA-1/2、GPT-3.5/4，你只需要原則性的指導。

Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4

December 26, 2023

作者: Sondos Mahmoud Bsharat, Aidar Myrzakhan, Zhiqiang Shen

cs.AI

摘要

本文介紹了26條指導原則，旨在簡化查詢和提示大型語言模型的過程。我們的目標是簡化為各種規模的大型語言模型制定問題的基本概念，檢驗它們的能力，並增強用戶對不同規模的大型語言模型在不同提示下輸入時行為的理解。在LLaMA-1/2（7B、13B和70B）、GPT-3.5/4上進行了大量實驗，以驗證所提原則對指導和提示設計的有效性。我們希望這項工作為從事大型語言模型提示工作的研究人員提供更好的指導。項目頁面位於https://github.com/VILA-Lab/ATLAS。

English

This paper introduces 26 guiding principles designed to streamline the process of querying and prompting large language models. Our goal is to simplify the underlying concepts of formulating questions for various scales of large language models, examining their abilities, and enhancing user comprehension on the behaviors of different scales of large language models when feeding into different prompts. Extensive experiments are conducted on LLaMA-1/2 (7B, 13B and 70B), GPT-3.5/4 to verify the effectiveness of the proposed principles on instructions and prompts design. We hope that this work provides a better guide for researchers working on the prompting of large language models. Project page is available at https://github.com/VILA-Lab/ATLAS.