Vibravox：一组使用体感音频传感器捕获的法语语音数据集

Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensors

July 16, 2024

作者: Julien Hauret, Malo Olivier, Thomas Joubaud, Christophe Langrenne, Sarah Poirée, Véronique Zimpfer, Éric Bavu

cs.AI

摘要

Vibravox是一个符合《通用数据保护条例》（GDPR）的数据集，其中包含使用五种不同的体导音频传感器录制的音频记录：两个耳塞麦克风、两个骨传导振动拾音器和一个喉话筒。数据集还包括来自空中麦克风的音频数据，用作参考。Vibravox语料库包含由188名参与者在高阶Ambisonics 3D空间化器施加的不同声学条件下录制的38小时语音样本和生理声音。语料库中还包括有关录制条件和语言转录的注释。我们针对各种与语音相关的任务进行了一系列实验，包括语音识别、语音增强和说话人验证。这些实验使用最先进的模型进行，以评估和比较它们在Vibravox数据集提供的不同音频传感器捕获的信号上的性能，旨在更好地了解它们各自的特征。

English

Vibravox is a dataset compliant with the General Data Protection Regulation (GDPR) containing audio recordings using five different body-conduction audio sensors : two in-ear microphones, two bone conduction vibration pickups and a laryngophone. The data set also includes audio data from an airborne microphone used as a reference. The Vibravox corpus contains 38 hours of speech samples and physiological sounds recorded by 188 participants under different acoustic conditions imposed by an high order ambisonics 3D spatializer. Annotations about the recording conditions and linguistic transcriptions are also included in the corpus. We conducted a series of experiments on various speech-related tasks, including speech recognition, speech enhancement and speaker verification. These experiments were carried out using state-of-the-art models to evaluate and compare their performances on signals captured by the different audio sensors offered by the Vibravox dataset, with the aim of gaining a better grasp of their individual characteristics.