1. Genie Sim 3.0

May 8, 2026 · View on GitHub

image.png

arXiv Paper: 2601.02078 GitHub Webpage HuggingFace ModelScope Dataset

1. Genie Sim 3.0

Genie Sim is the simulation platform from AgiBot. It provides developers with a complete toolchain for environment reconstruction, scene generalization, data collection, and automated evaluation. Its core module, Genie Sim Benchmark is a standardized tool dedicated to establishing the most accurate and authoritative evaluation for embodied intelligence.

The platform integrates 3D reconstruction with visual generation to create a high-fidelity simulation environment. It pioneers LLM-driven technology to generate vast simulation scenes and evaluation configurations in minutes. The evaluation system covers 200+ tasks across 100,000+ scenarios to establish a comprehensive capability profile for models. Genie Sim also opens over 10,000 hours synthetic dataset including real-world robot operation scenarios.

The platform will significantly accelerate model development, reduce reliance on physical hardware, and empower innovation in embodied intelligence. Simulation assets, dataset, and code are fully open source.

2. Features

  • High-Fidelity Sim-Ready Assets: 5,140 validated 3D assets covering five real-world operation fields: retail, industry, catering, home and office. ModelScope.
  • 3DGS-based Reconstruction Pipeline: Integrate 3DGS-based reconstruction process with visual generative model to synthesize realistic simulation environment with high-precision meshes. ModelScope.
  • Genie Sim World: A multimodal spatial world model which generates photorealistic 3D world from diverse input types in minutes. GitHub.
  • LLM-Driven Scene Generation: Natural language-driven generation and generalization which instantly generates diverse simulation scenes through conversational interaction.
  • Large-Scale Synthetic Dataset: Over 10,000 hours open-source synthetic data across 200+ loco-manipulation tasks with multi-sensor streams, alongside multi-dimensional variations.
  • Synthetic Data Generation: Efficient toolkit for data collectoin with error-recovery mechanism, supporting both low-latency teleoperation and automated data programming. ModelScope.
  • Robust and Diverse Benchmark: Provide 100,000+ simulation scenarios and use LLM to autonomously generate task instructions and evaluation configurations. Discrepancy between simulation and real-world test results is less than 10%.
  • VLM-based Auto-Evaluation System: Full-spectrum evaluation criteria to provide model's capability profile covering manipulation skills, cognitive comprehension and task complexity.
  • Zero-Shot Sim-to-Real Transfer: Model trained with our synthetic data exhibits zero-shot sim-to-real transfer capability with superior task success rate compared to model trained with real data.

3. Updates

  • [4/8/2026] v3.1
    • Release Genie Sim World: a multimodal spatial world model for 3D world generation
    • Update new benchmarks for instruction following, spatial understanding, manipulation skills, robustness, and sim2real
    • Support human-in-the-loop and distributed reinforcement learning pipeline of RLinf
  • [1/7/2026] v3.0
    • Update Isaac Sim to v5.1.0 and support RTX 50series graphic card
    • Provide USD and URDF files of Agibot Genie G2 robot and support whole body control
    • Support 3DGS-based scene reconstruction and convert output to USD format for application in Isaac Sim
    • Release synthetic dataset and corresponding data collection pipeline
    • Add LLM-based features to generate scenarios, task instructions and evaluation configurations
  • [7/14/2025] v2.2
    • Provide detailed evaluation metrics for all Agibot World Challenge tasks
    • Add automatic evaluation script to run each task multiple times and record score of all steps
  • [6/25/2025] v2.1
    • Add 10 more manipulation tasks for Agibot World Challenge 2025 including all simulation assets
    • Open-source synthetic datasets for 10 manipulation tasks on Huggingface
    • Integrate UniVLA policy and support model inference simulation evaluation
    • Update IK solver sdk which supports cross-embodiment IK solving for other robots
    • Optimize communication framework and improve simulation running speed by 2x
    • Update automatic evaluation framework for more complicated long-range tasks

4. Documentation

4.1 Documentations

Please refer to these links to install Genie Sim and download assets and dataset:

4.2 Genie Sim Benchmark Leaderboard

GenieSim-Instruction

Tasksπ0.5GR00T-N1.6π0
pick_block_number0.730.280.17
pick_block_shape0.410.150.17
pick_common_sense0.350.120.05
pick_follow_logic_or0.580.560.26
pick_object_type0.810.560.27
pick_specific_object0.580.350.16
straighten_object0.660.330.46
pick_billiards_color0.810.370.47
pick_block_color0.880.710.40
pick_block_size0.890.520.36
Avg.0.670.400.28

GenieSim-Robust

Generalizationπ0.5GR00T-N1.6π0
Reference0.920.580.46
Instruction0.890.470.32
Robot Init Base0.830.590.32
Robot Init Joint0.700.390.34
Robot End Effector0.420.300.26
Control Delay0.760.570.40
Camera Frame Drop0.830.280.19
Camera Noise0.890.590.34
Camera Occlusion0.930.590.41
Camera Extrinsic0.390.270.22
Ambient Lighting0.850.540.44
Background0.900.570.40
Avg.0.770.480.34

GenieSim-Manipulation

Tasksπ0.5GR00T-N1.6π0
Open Door0.600.350.46
Hold Pot0.350.000.14
Pour Workpiece0.950.950.72
Stock and Straighten Shelf0.370.150.21
Take Wrong Item Shelf0.950.650.80
Scoop Popcorn0.780.800.68
Clean the Desktop0.160.010.08
Place Block into Box0.500.300.38
Sorting Packages0.450.140.13
Sorting Packages Continuous0.160.030.00
Avg.0.530.340.36

GenieSim-Sim2Real

TasksSim Env
Sim Data
(sim-to-sim)
Sim Env
Real Data
(real-to-sim)
Real Env
Sim Data
(sim-to-real)
Real Env
Real Data
(real-to-real)
Select Color0.860.750.850.73
Recognize Size0.930.750.940.75
Grasp Targets0.720.540.710.58
Organize Items0.480.450.600.40
Pack in Supermarket0.941.000.950.95
Sort Fruit0.900.901.001.00
Place Block into Drawer0.800.900.850.90
Bimanual Chip Handover0.800.700.730.71
Avg.0.800.750.830.75

Sim Data: 500~1500 episodes of simulation data. Real Data: 500 episodes of real-world data. All models are post-trained from the π0.5 baseline.

4.3 Support

4.2 Roadmap

  • Release more long-horizon benchmark mainuplation tasks
  • More scenes and assets for each benchmark task
  • Support Agibot World Challenge baseline model
  • Scenario layout and manipulation trajectory generalization toolkit
  • Provide dockfile and tutorial for scene reconstruction pipeline
  • Update motion control toolkit to support Genie G2 teleoperation in simulation
  • Support human-in-the-loop and distributed reinforcement learning pipeline of RLinf
  • Upload all assets and dataset on Huggingface
  • Support more tasks and larger models for RLinf

4.3 License and Citation

All the data and code within source/geniesim and source/data_collection are under Mozilla Public License 2.0. The source/scene_reconstruction project contains code under multiple licenses, for complete and updated licensing details, please see the LICENSE files

Please consider citing our work either way below if it helps your research.

@misc{yin2026geniesim30,
  title={Genie Sim 3.0 : A High-Fidelity Comprehensive Simulation Platform for Humanoid Robot},
  author={Chenghao Yin and Da Huang and Di Yang and Jichao Wang and Nanshu Zhao and Chen Xu and Wenjun Sun and Linjie Hou and Zhijun Li and Junhui Wu and Zhaobo Liu and Zhen Xiao and Sheng Zhang and Lei Bao and Rui Feng and Zhenquan Pang and Jiayu Li and Qian Wang and Maoqing Yao},
  year={2026},
  eprint={2601.02078},
  archivePrefix={arXiv},
  primaryClass={cs.RO},
  url={https://arxiv.org/abs/2601.02078},
}

4.4 References

  1. PDDL Parser (2020). Version 1.1. [Source code]. https://github.com/pucrs-automated-planning/pddl-parser.
  2. BDDL. Version 1.x.x [Source code]. https://github.com/StanfordVL/bddl
  3. CUROBO [Source code]. https://github.com/NVlabs/curobo
  4. Isaac Lab [Source code]. https://github.com/isaac-sim/IsaacLab
  5. Omni Gibson [Source code]. https://github.com/StanfordVL/OmniGibson
  6. The Scene Language [Source code]. https://github.com/zzyunzhi/scene-language
  7. COAL [Source code]. https://github.com/coal-library/coal
  8. OCTOMAP [Source code]. https://github.com/OctoMap/octomap
  9. PINOCCHIO [Source code]. https://github.com/stack-of-tasks/pinocchio
  10. URDFDOM [Source code]. https://github.com/ros/urdfdom
  11. LIBCCD [Source code]. https://github.com/danfis/libccd
  12. LIBMINIZIP [Source code]. https://github.com/switch-st/libminizip
  13. LIBODE [Source code]. https://github.com/markmbaum/libode
  14. LIBURING [Source code]. https://github.com/axboe/liburing
  15. MuJoCo [Source code]. https://github.com/google-deepmind/mujoco