VoxCeleb 说话人识别挑战:一次回顾性的研究
The VoxCeleb Speaker Recognition Challenge: A Retrospective
August 27, 2024
作者: Jaesung Huh, Joon Son Chung, Arsha Nagrani, Andrew Brown, Jee-weon Jung, Daniel Garcia-Romero, Andrew Zisserman
cs.AI
摘要
VoxCeleb说话人识别挑战(VoxSRC)是一系列从2019年持续到2023年的挑战和研讨会。这些挑战主要评估了说话人识别和日程安排任务,涵盖了各种设置,包括:封闭和开放训练数据;以及监督、自监督和半监督训练用于领域适应。这些挑战还为每个任务和设置提供了公开可用的训练和评估数据集,每年发布新的测试集。在本文中,我们对这些挑战进行了回顾,内容包括:它们探索了什么;挑战参与者开发的方法以及这些方法的演变;以及说话人验证和日程安排领域的当前状况。我们记录了在一个共同的评估数据集上挑战的五个版本中性能的进展,并详细分析了每年的特别关注点如何影响参与者的表现。本文旨在为希望了解说话人识别和日程安排领域概况的研究人员以及希望从VoxSRC挑战的成功中受益并避免错误的挑战组织者提供帮助。最后,我们讨论了该领域当前的优势和面临的挑战。项目页面:https://mm.kaist.ac.kr/datasets/voxceleb/voxsrc/workshop.html
English
The VoxCeleb Speaker Recognition Challenges (VoxSRC) were a series of
challenges and workshops that ran annually from 2019 to 2023. The challenges
primarily evaluated the tasks of speaker recognition and diarisation under
various settings including: closed and open training data; as well as
supervised, self-supervised, and semi-supervised training for domain
adaptation. The challenges also provided publicly available training and
evaluation datasets for each task and setting, with new test sets released each
year. In this paper, we provide a review of these challenges that covers: what
they explored; the methods developed by the challenge participants and how
these evolved; and also the current state of the field for speaker verification
and diarisation. We chart the progress in performance over the five
installments of the challenge on a common evaluation dataset and provide a
detailed analysis of how each year's special focus affected participants'
performance. This paper is aimed both at researchers who want an overview of
the speaker recognition and diarisation field, and also at challenge organisers
who want to benefit from the successes and avoid the mistakes of the VoxSRC
challenges. We end with a discussion of the current strengths of the field and
open challenges. Project page :
https://mm.kaist.ac.kr/datasets/voxceleb/voxsrc/workshop.htmlSummary
AI-Generated Summary