虛擬智能在現實生活中的基礎

摘要

人類所居住的地球與現代 AI 代理人所創造的數字領域之間存在著感知上的鴻溝。為了開發能夠在現實世界中像人類一樣靈活感知、思考和行動的 AI 代理人，必須彌合數字和物理世界之間的現實差距。我們如何能夠在一個像我們所居住的環境中賦予代理人身體，而又不受真實硬體和控制所加諸的限制？為了達到這個目的，我們引入了 V-IRL：一個讓代理人能夠在虛擬但寫實環境中與現實世界進行可擴展互動的平台。我們的平台既是一個用於開發能夠完成各種實際任務的代理人的遊樂場，也是一個用於測量跨越全球範圍的感知、決策和與現實世界數據互動能力進展的廣闊實驗平臺。

English

There is a sensory gulf between the Earth that humans inhabit and the digital realms in which modern AI agents are created. To develop AI agents that can sense, think, and act as flexibly as humans in real-world settings, it is imperative to bridge the realism gap between the digital and physical worlds. How can we embody agents in an environment as rich and diverse as the one we inhabit, without the constraints imposed by real hardware and control? Towards this end, we introduce V-IRL: a platform that enables agents to scalably interact with the real world in a virtual yet realistic environment. Our platform serves as a playground for developing agents that can accomplish various practical tasks and as a vast testbed for measuring progress in capabilities spanning perception, decision-making, and interaction with real-world data across the entire globe.

虛擬智能在現實生活中的基礎

V-IRL: Grounding Virtual Intelligence in Real Life

摘要

Support