Aria日常活動數據集

Aria Everyday Activities Dataset

February 20, 2024

作者: Zhaoyang Lv, Nickolas Charron, Pierre Moulon, Alexander Gamino, Cheng Peng, Chris Sweeney, Edward Miller, Huixuan Tang, Jeff Meissner, Jing Dong, Kiran Somasundaram, Luis Pesqueira, Mark Schwesinger, Omkar Parkhi, Qiao Gu, Renzo De Nardi, Shangyi Cheng, Steve Saarinen, Vijay Baiyya, Yuyang Zou, Richard Newcombe, Jakob Julian Engel, Xiaqing Pan, Carl Ren

cs.AI

摘要

我們介紹Aria Everyday Activities (AEA) 資料集，這是一個以Project Aria眼鏡記錄的主觀多模式開放資料集。AEA 包含了在五個地理多樣的室內地點中由多位佩戴者記錄的143個日常活動序列。每個記錄都包含透過Project Aria眼鏡記錄的多模式感應器數據。此外，AEA 提供機器感知數據，包括高頻全球對齊的3D軌跡、場景點雲、每幀的3D眼神矢量和時間對齊的語音轉錄。在本文中，我們展示了這個資料集所啟用的一些範例研究應用，包括神經場景重建和提示分割。AEA 是一個開源資料集，可從projectaria.com 下載。我們還提供了在Project Aria Tools中使用該資料集的開源實現和示例。

English

We present Aria Everyday Activities (AEA) Dataset, an egocentric multimodal open dataset recorded using Project Aria glasses. AEA contains 143 daily activity sequences recorded by multiple wearers in five geographically diverse indoor locations. Each of the recording contains multimodal sensor data recorded through the Project Aria glasses. In addition, AEA provides machine perception data including high frequency globally aligned 3D trajectories, scene point cloud, per-frame 3D eye gaze vector and time aligned speech transcription. In this paper, we demonstrate a few exemplar research applications enabled by this dataset, including neural scene reconstruction and prompted segmentation. AEA is an open source dataset that can be downloaded from projectaria.com. We are also providing open-source implementations and examples of how to use the dataset in Project Aria Tools.