UMI-3D Dataset and Models

April 16, 2026 ยท View on GitHub

๐ŸŒ UMI-3D Project Homepage

๐Ÿ”ง UMI-3D Hardware ๐Ÿ›ฐ๏ธ UMI-3D SLAM Pipeline ๐Ÿค– UMI-3D Policy
UMI-3D Hardware UMI-3D SLAM Pipeline UMI-3D Policy
Hardware design, BOM, CAD, and 3D-printed components SLAM, synchronization, calibration, and data processing Policy training, deployment, and inference

Overview

This repository provides datasets, pretrained models, and raw recordings for UMI-3D.

Each task includes:

  • A Zarr dataset for policy training
  • Pretrained policy weights
  • Raw rosbag recordings for reproducibility

Task 1 โ€” Cup Arrangement


Task 2 โ€” Curtain Pulling


Task 3 โ€” Door Opening and Cup Arrangement


Notes

  • The datasets are generated using the full UMI-3D pipeline (Hardware โ†’ SLAM โ†’ Data Processing).
  • Raw rosbag files are provided for full reproducibility and reprocessing.
  • All datasets are compatible with the UMI-3D Policy framework.

Citation

If you find this work useful for your research, please consider citing:

@misc{wang2026umi3dextendinguniversalmanipulation,
  title={UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception},
  author={Ziming Wang},
  year={2026},
  eprint={2604.14089},
  archivePrefix={arXiv},
  primaryClass={cs.RO},
  url={https://arxiv.org/abs/2604.14089}
}