RoboDojo：用于全面评估通用机器人操作策略的统一仿真与真实基准

RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies

July 7, 2026

作者: Tianxing Chen, Yue Chen, Zixuan Li, Junyuan Tang, Kailun Su, Haoran Lu, Weijie Wan, Baijun Chen, Songling Liu, Haowen Yan, Honghao Su, Zhiyang Dou, Kaixuan Wang, Dandan Zhang, Yunze Liu, Yan Qin, Qiwei Liang, Qiwei Wu, Zijian Lin, Wenwei Lin, Yuran Wang, Minghua He, Tianshu Wu, Ruihai Wu, Jingquan Zhou, Kai-Chong Lei, Haibao Yu, Yuanfeng Ji, Weiyang Jin, Guanyu Lin, Xiaofan Li, Qi Xiong, Renjing Xu, Zhongyu Li, Wenhao Chai, Enze Xie, Ziwei Wang, Yao Mu, Hao Dong, Wojciech Matusik, Mingyu Ding, Wenbo Ding, Ping Luo, Masayoshi Tomizuka

cs.AI

摘要

通用机器人操作策略发展迅速，但现有基准在系统评估其能力方面仍存在局限。许多基准依赖简单、短时域或技能范围狭窄的任务，能力覆盖有限，且通常仅在仿真或仅在实际环境中进行。仿真可实现可扩展的反馈，但忽略了物理部署挑战，而实际环境评估成本高、耗时长且难以复现。我们提出RoboDojo，一个统一的仿真与实物基准，用于全面评估通用机器人操作策略。RoboDojo包含42个仿真任务和18个实物任务，涵盖多样且互补的操作能力。仿真基准从五个维度进行评估：泛化能力、记忆能力、精度、长时域执行能力和开放词汇指令遵循能力，而实物基准则将策略置于具有挑战性的物理世界部署条件下。RoboDojo通过Isaac Sim中的异构并行仿真支持可扩展评估，并提供了RoboDojo-RealEval，一个可复现的实物评估系统，具备远程云访问、标准化硬件、场景重置、评估协议和部署接口。结合XPolicyLab，策略可一次性集成，并在仿真与实物环境中进行最小化适配的评估。我们将30个策略集成到XPolicyLab中，并在RoboDojo上对其进行评估，建立了公开排行榜和当前策略性能的系统分析。网站地址：http://robodojo-benchmark.com/。

English

Generalist robot manipulation policies have advanced rapidly, yet existing benchmarks remain limited in systematically evaluating their capabilities. Many rely on simple, short-horizon, or skill-narrow tasks with limited capability coverage, and are often conducted only in simulation or only in the real world. Simulation enables scalable feedback but misses physical deployment challenges, while real-world evaluation is costly, time-consuming, and difficult to reproduce. We introduce RoboDojo, a unified sim-and-real benchmark for comprehensive evaluation of generalist robot manipulation policies. RoboDojo includes 42 simulation tasks and 18 real-world tasks covering diverse and complementary manipulation capabilities. The simulation benchmark evaluates five dimensions: generalization, memory, precision, long-horizon execution, and open-vocabulary instruction following, while the real-world benchmark exposes policies to challenging physical-world deployment conditions. RoboDojo supports scalable evaluation through heterogeneous parallel simulation in Isaac Sim and provides RoboDojo-RealEval, a reproducible real-world evaluation system with remote cloud access, standardized hardware, scene reset, evaluation protocol, and deployment interface. Together with XPolicyLab, policies can be integrated once and evaluated across simulation and real-world settings with minimal adaptation. We integrate 30 policies into XPolicyLab and evaluate them on RoboDojo, establishing a public leaderboard and systematic analysis of current policy performance. The website is available at http://robodojo-benchmark.com/.