V-IRL:将虚拟智能扎根于现实生活
V-IRL: Grounding Virtual Intelligence in Real Life
February 5, 2024
作者: Jihan Yang, Runyu Ding, Ellis Brown, Xiaojuan Qi, Saining Xie
cs.AI
摘要
人类居住的地球与现代人工智能代理所创建的数字领域之间存在感知鸿沟。要开发能够在现实世界环境中像人类一样灵活感知、思考和行动的人工智能代理,必须弥合数字和物理世界之间的现实差距。我们如何能够在一个丰富多样且没有真实硬件和控制约束的环境中赋予代理人类一样的实体?为此,我们引入了V-IRL:一个能够使代理在虚拟但真实环境中与真实世界可扩展互动的平台。我们的平台既是开发能够完成各种实际任务的代理的游乐场,也是一个广阔的测试基地,用于衡量在全球范围内跨越感知、决策和与真实世界数据互动等能力方面的进展。
English
There is a sensory gulf between the Earth that humans inhabit and the digital
realms in which modern AI agents are created. To develop AI agents that can
sense, think, and act as flexibly as humans in real-world settings, it is
imperative to bridge the realism gap between the digital and physical worlds.
How can we embody agents in an environment as rich and diverse as the one we
inhabit, without the constraints imposed by real hardware and control? Towards
this end, we introduce V-IRL: a platform that enables agents to scalably
interact with the real world in a virtual yet realistic environment. Our
platform serves as a playground for developing agents that can accomplish
various practical tasks and as a vast testbed for measuring progress in
capabilities spanning perception, decision-making, and interaction with
real-world data across the entire globe.