Amphion：一個開源的音頻、音樂和語音生成工具包

摘要

Amphion 是一個用於音訊、音樂和語音生成的工具包。它的目的在於支持可重現的研究，並幫助初級研究人員和工程師進入音訊、音樂和語音生成研究和開發領域。Amphion 提供了一個獨特的功能：經典模型或架構的視覺化。我們認為這些視覺化對於希望更好理解模型的初級研究人員和工程師是有益的。Amphion 的北極星目標是提供一個研究將任何輸入轉換為一般音訊的平台。Amphion 設計用於支持個別生成任務。除了特定的生成任務外，Amphion 還包括幾個聲碼器和評估指標。聲碼器是產生高質量音訊信號的重要模組，而評估指標對於確保生成任務中的一致指標至關重要。在本文中，我們對 Amphion 進行了高層級概述。

English

Amphion is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development. Amphion offers a unique feature: visualizations of classic models or architectures. We believe that these visualizations are beneficial for junior researchers and engineers who wish to gain a better understanding of the model. The North-Star objective of Amphion is to offer a platform for studying the conversion of any inputs into general audio. Amphion is designed to support individual generation tasks. In addition to the specific generation tasks, Amphion also includes several vocoders and evaluation metrics. A vocoder is an important module for producing high-quality audio signals, while evaluation metrics are critical for ensuring consistent metrics in generation tasks. In this paper, we provide a high-level overview of Amphion.

Amphion：一個開源的音頻、音樂和語音生成工具包

Amphion: An Open-Source Audio, Music and Speech Generation Toolkit

摘要

Support