README.md

May 4, 2026 · View on GitHub

[ICML 2026] | Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory

arXiv Project Page

Ruiqi Wu1,2,3*, Xuanhua He4,2*, Meng Cheng2*, Tianyu Yang2, Yong Zhang2‡, Zhuoliang Kang2, Xunliang Cai2, Xiaoming Wei2, Chunle Guo1,3†, Chongyi Li1,3, Ming-Ming Cheng1,3

1Nankai University   2Meituan   3NKIARI   4HKUST

*Equal Contribution   Corresponding Author   Project Leader

 

Demo

 


Highlights

Infinite-World is a robust interactive world model with:

  • Real-World Training — Trained on real-world videos without requiring perfect pose annotations or synthetic data
  • 1000+ Frame Memory — Maintains coherent visual memory over 1000+ frames via Hierarchical Pose-free Memory Compressor (HPMC)
  • Robust Action Control — Uncertainty-aware action labeling ensures accurate action-response learning from noisy trajectories

Infinite-World Framework

Installation

Environment: Python 3.10, CUDA 12.4 recommended.

1. Create conda environment

conda create -n infworld python=3.10
conda activate infworld

2. Install PyTorch with CUDA 12.4

pip install torch==2.6.0 torchvision==0.21.0 --index-url https://download.pytorch.org/whl/cu124

3. Install Python dependencies

pip install -r requirements.txt

Checkpoint Configuration

All model paths are configured in configs/infworld_config.yaml. Paths are relative to the project root unless absolute.

Download checkpoints

Download checkpoints from https://huggingface.co/MeiGen-AI/Infinite-World and place files under checkpoints/:

File / directoryConfig keyDescription
models/Wan2.1_VAE.pthvae_cfg.vae_pthVAE weights
models/models_t5_umt5-xxl-enc-bf16.pthtext_encoder_cfg.checkpoint_pathT5 text encoder
models/google/umt5-xxl (folder)text_encoder_cfg.tokenizer_pathT5 tokenizer
infinite_world_model.ckptcheckpoint_pathDiT model weights

Results

Quantitative Comparison

ModelMot. Smo.↑Dyn. Deg.↑Aes. Qual.↑Img. Qual.↑Avg. Score↑Memory↓Fidelity↓Action↓ELO Rating↑
Hunyuan-GameCraft0.98550.98960.53800.60100.77852.672.492.561311
Matrix-Game 2.00.97881.00000.52670.72150.80682.982.911.781432
Yume 1.50.98610.98960.58400.69690.81412.431.912.471495
HY-World-1.50.99051.00000.52800.66110.79492.592.781.501542
Infinite-World0.98761.00000.54400.71590.81191.921.671.541719

Citation

If you find this work useful, please consider citing:

@article{wu2026infiniteworld,
  title={Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory},
  author={Wu, Ruiqi and He, Xuanhua and Cheng, Meng and Yang, Tianyu and Zhang, Yong and Kang, Zhuoliang and Cai, Xunliang and Wei, Xiaoming and Guo, Chunle and Li, Chongyi and Cheng, Ming-Ming},
  journal={arXiv preprint arXiv:2602.02393},
  year={2026}
}

License

This project is released under the MIT License.