---

Contents

• Contents
• Installtion
• Datasets
• Training and Evaluation
• Released Checkpoint Results
• LeaderBoard

Installtion

Based on the EmbodiChain, we offer both docker and local installation methods. For detailed installation instructions, please refer to Installation Document.

Datasets

We provide 1,000 pre-collected trajectories per task as part of the open-source release RoboSynChallenge Dataset. The datasets hosted on HuggingFace are available at here.

However, we still strongly recommend users to perform data collection themselves. For detailed data collection instructions, please refer to Data Collection Document.

Training and Evaluation

Currently, RoboSynChallenge integrates training and evaluation for PI0, PI0.5, and Motus. Detailed procedures can be found in the documentation for the corresponding strategies: 👉Webpage. In addition, you can easily extend your own policys for training and evaluation by following the documentation 👉Webpage.

Released Checkpoint Results

100-episode simulation evaluations for the released ACT and Diffusion Policy checkpoints are published in evaluation_results. The machine-readable result file pins success rate, action steps, millisecond inference time, Hugging Face checkpoint revisions, and the random protocol configuration.

LeaderBoard

The full leaderboard and setting can be found in: https://edem-ai.github.io/robosynchallenge.github.io/#/leaderboard.