Alexa，与机器人一起玩：介绍首届Alexa奖SimBot挑战赛，探索具身体感知的人工智能。

摘要

Alexa Prize计划赋予了许多大学生探索、实验和展示他们在构建会话代理方面的才能的机会，其中包括SocialBot大挑战和TaskBot挑战。随着会话代理在多模态和具象化环境中的应用日益增多，探索结合计算机视觉和实体化的会话交互的功能变得至关重要。本文描述了SimBot挑战，这是一个新的挑战，大学团队将在其中竞争构建能够在模拟物理环境中完成任务的机器人助手。本文概述了SimBot挑战，其中包括在线和离线挑战阶段。我们描述了为团队提供的基础设施和支持，包括Alexa Arena、模拟环境以及提供给团队加速构建视觉和语言模型的ML工具包。我们总结了参与团队应对研究挑战并提取关键经验教训的方法。最后，我们对比赛中竞争SimBot的表现进行了分析。

English

The Alexa Prize program has empowered numerous university students to explore, experiment, and showcase their talents in building conversational agents through challenges like the SocialBot Grand Challenge and the TaskBot Challenge. As conversational agents increasingly appear in multimodal and embodied contexts, it is important to explore the affordances of conversational interaction augmented with computer vision and physical embodiment. This paper describes the SimBot Challenge, a new challenge in which university teams compete to build robot assistants that complete tasks in a simulated physical environment. This paper provides an overview of the SimBot Challenge, which included both online and offline challenge phases. We describe the infrastructure and support provided to the teams including Alexa Arena, the simulated environment, and the ML toolkit provided to teams to accelerate their building of vision and language models. We summarize the approaches the participating teams took to overcome research challenges and extract key lessons learned. Finally, we provide analysis of the performance of the competing SimBots during the competition.

Alexa，与机器人一起玩：介绍首届Alexa奖SimBot挑战赛，探索具身体感知的人工智能。

Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AI

摘要

Support