VoxCeleb 語者識別挑戰：一個回顧性研究

The VoxCeleb Speaker Recognition Challenge: A Retrospective

August 27, 2024

作者: Jaesung Huh, Joon Son Chung, Arsha Nagrani, Andrew Brown, Jee-weon Jung, Daniel Garcia-Romero, Andrew Zisserman

cs.AI

摘要

VoxCeleb 語者識別挑戰（VoxSRC）是一系列從2019年至2023年每年舉辦的挑戰和研討會。這些挑戰主要評估語者識別和日誌記錄任務，涵蓋不同設定，包括：封閉和開放式訓練數據；以及監督式、自監督式和半監督式訓練用於領域適應。這些挑戰還為每個任務和設定提供了公開可用的訓練和評估數據集，每年釋出新的測試集。本文對這些挑戰進行了回顧，內容包括：它們所探索的內容；挑戰參與者開發的方法及其演變過程；以及語者驗證和日誌記錄領域的當前狀態。我們記錄了在共同評估數據集上挑戰的五個版本中性能的進展，並詳細分析了每年的特別焦點如何影響參與者的表現。本文旨在為希望瞭解語者識別和日誌記錄領域的研究人員提供概述，同時也針對希望從 VoxSRC 挑戰的成功中受益並避免錯誤的挑戰組織者。最後，我們討論了該領域目前的優勢和開放性挑戰。項目頁面：https://mm.kaist.ac.kr/datasets/voxceleb/voxsrc/workshop.html

English

The VoxCeleb Speaker Recognition Challenges (VoxSRC) were a series of challenges and workshops that ran annually from 2019 to 2023. The challenges primarily evaluated the tasks of speaker recognition and diarisation under various settings including: closed and open training data; as well as supervised, self-supervised, and semi-supervised training for domain adaptation. The challenges also provided publicly available training and evaluation datasets for each task and setting, with new test sets released each year. In this paper, we provide a review of these challenges that covers: what they explored; the methods developed by the challenge participants and how these evolved; and also the current state of the field for speaker verification and diarisation. We chart the progress in performance over the five installments of the challenge on a common evaluation dataset and provide a detailed analysis of how each year's special focus affected participants' performance. This paper is aimed both at researchers who want an overview of the speaker recognition and diarisation field, and also at challenge organisers who want to benefit from the successes and avoid the mistakes of the VoxSRC challenges. We end with a discussion of the current strengths of the field and open challenges. Project page : https://mm.kaist.ac.kr/datasets/voxceleb/voxsrc/workshop.html