H2O 開放生態系統用於最先進的大型語言模型

H2O Open Ecosystem for State-of-the-art Large Language Models

October 17, 2023

作者: Arno Candel, Jon McKinney, Philipp Singer, Pascal Pfeiffer, Maximilian Jeblick, Chun Ming Lee, Marcos V. Conde

cs.AI

摘要

大型語言模型（LLMs）代表了人工智慧領域的一場革命。然而，它們也帶來許多重大風險，例如存在偏見、私密、受版權保護或有害的文本。因此，我們需要開放、透明和安全的解決方案。我們推出了一個完整的開源生態系統，用於開發和測試LLMs。這個項目的目標是推動開放式替代方案，取代封閉式方法。我們釋出了h2oGPT，這是一個包含70億參數的精調LLMs家族。我們還推出了H2O LLM Studio，這是一個框架和無代碼GUI，旨在使用最新的尖端技術進行高效的精調、評估和部署LLMs。我們的代碼和模型採用完全寬鬆的Apache 2.0許可證。我們相信開源語言模型有助於推動人工智慧的發展，使其更具可訪問性和可信賴性。演示可在以下網址查看：https://gpt.h2o.ai/

English

Large Language Models (LLMs) represent a revolution in AI. However, they also pose many significant risks, such as the presence of biased, private, copyrighted or harmful text. For this reason we need open, transparent and safe solutions. We introduce a complete open-source ecosystem for developing and testing LLMs. The goal of this project is to boost open alternatives to closed-source approaches. We release h2oGPT, a family of fine-tuned LLMs from 7 to 70 Billion parameters. We also introduce H2O LLM Studio, a framework and no-code GUI designed for efficient fine-tuning, evaluation, and deployment of LLMs using the most recent state-of-the-art techniques. Our code and models are licensed under fully permissive Apache 2.0 licenses. We believe open-source language models help to boost AI development and make it more accessible and trustworthy. The demo is available at: https://gpt.h2o.ai/