Aria日常活动数据集

Aria Everyday Activities Dataset

February 20, 2024

作者: Zhaoyang Lv, Nickolas Charron, Pierre Moulon, Alexander Gamino, Cheng Peng, Chris Sweeney, Edward Miller, Huixuan Tang, Jeff Meissner, Jing Dong, Kiran Somasundaram, Luis Pesqueira, Mark Schwesinger, Omkar Parkhi, Qiao Gu, Renzo De Nardi, Shangyi Cheng, Steve Saarinen, Vijay Baiyya, Yuyang Zou, Richard Newcombe, Jakob Julian Engel, Xiaqing Pan, Carl Ren

cs.AI

摘要

我们介绍Aria日常活动（AEA）数据集，这是一个使用Project Aria眼镜记录的主观多模态开放数据集。AEA包含了由多个佩戴者在五个地理多样的室内位置记录的143个日常活动序列。每个记录都包含通过Project Aria眼镜记录的多模态传感器数据。此外，AEA提供机器感知数据，包括高频全局对齐的3D轨迹、场景点云、每帧的3D眼睛注视向量和时间对齐的语音转录。在本文中，我们展示了通过该数据集实现的一些示例研究应用，包括神经场景重建和提示分割。AEA是一个开放源代码数据集，可从projectaria.com下载。我们还提供了在Project Aria工具中使用数据集的开源实现和示例。

English

We present Aria Everyday Activities (AEA) Dataset, an egocentric multimodal open dataset recorded using Project Aria glasses. AEA contains 143 daily activity sequences recorded by multiple wearers in five geographically diverse indoor locations. Each of the recording contains multimodal sensor data recorded through the Project Aria glasses. In addition, AEA provides machine perception data including high frequency globally aligned 3D trajectories, scene point cloud, per-frame 3D eye gaze vector and time aligned speech transcription. In this paper, we demonstrate a few exemplar research applications enabled by this dataset, including neural scene reconstruction and prompted segmentation. AEA is an open source dataset that can be downloaded from projectaria.com. We are also providing open-source implementations and examples of how to use the dataset in Project Aria Tools.