README.md

July 23, 2026 ยท View on GitHub

DreamX-World: A General-Purpose Interactive World Model

DreamX Team

Official Website Reactor HuggingFace ModelScope Tech Report

Page License


DreamX-World is a general-purpose world model for interactive world simulation. It generates diverse, high-fidelity worlds that users can explore, control, and transform with event prompts.

The model is trained with a scalable data engine on Unreal Engine data, gameplay footage, and real-world videos, combined with camera estimation and strict data filtering to learn realistic dynamics and interactions. It follows a progressive training pipeline: learning fine-grained action control first, then open-ended event response, and using Reinforcement Learning to improve action following, interaction consistency, and visual fidelity. Finally, through forcing and distillation, DreamX-World achieves efficient inference, making interactive generation practical at scale.

:fire: News

  • Jul 23, 2026: DreamX-World 1.0 is now live! Head over to the Official Website to experience our interactive world model.
  • June 15, 2026: We released DreamX-World 1.0 technical report.
  • June 15, 2026: We open-sourced DreamX-World-5B that supports 1-min video generation.
  • May 11, 2026: We open-sourced DreamX-World-5B-Cam and inference codes.

:calendar: Plan

  • :heavy_check_mark: DreamX-World-5B-Cam Model.
  • :heavy_check_mark: Long-horizon DreamX-World-5B Model.
  • :heavy_check_mark: Release Technical Report.
  • DreamX-World-14B-Cam Model.
  • Audio-Video Joint Generation Model.

๐Ÿš€ Quick Start

Setup

  1. Install dependencies
pip install -r requirements.txt
  1. Download Wan2.2-5B-TI2V checkpoints from https://huggingface.co/Wan-AI

Inference

Please check out inference_README.md for detailed instructions.

๐Ÿ“ Checkpoints

ModelDownload LinkDetailsInstrutions
DreamX-World-5B-CamHuggingface, ModelScopeBidrectional, Supports 5s Video Generationinference_README.md
DreamX-World-5BHuggingface, ModelScopeAutoregressive, Supports Long-horizon Video Generationinference_README.md

Computational Efficiency

The inference time (shown in the Cost column below) comprises both denoising and VAE decoding time.

ModelGPUsVideoCost (Time in second/Peak Memory)
DreamX-World-5B-Cam1xH205s 720P509s/38G
DreamX-World-5B1xH205s 720P26s/40G
DreamX-World-5B1xH2060s 720P342s/72G

๐ŸŽฌ Video Demo

Watch on YouTube

Note: The demo videos are intentionally compressed to ensure smooth playback, which may result in a slight loss of visual quality.

โณ Generate Long-Horizon Worlds

DreamX-World supports long-horizon autoregressive generation with precise camera control. Progressive training on long rollouts mitigates identity, background, style, and color drift, enabling coherent world exploration over hundreds of frames.

๐Ÿง  Remember and Revisit

DreamX-World uses geometry-guided memory retrieval to recover non-local visual evidence from earlier observations. This improves scene persistence when the camera revisits a previously explored region, preserving its layout, object identities, and local appearance.

DreamX-World enables high-fidelity, controllable exploration across diverse realistic environments, including indoor, urban, natural, and architectural scenes.

๐ŸŒˆ Dive into Dream Worlds

Beyond realistic scenes, DreamX-World also generates fantasy, game-like, sci-fi, and stylized worlds.

๐ŸŽฎ Generate in Third-Person View

DreamX-World supports both first-person interaction and coherent third-person generation. It keeps camera-follow behavior stable while preserving controllable agent motion and scene consistency.

โšก Promptable World Events

DreamX-World supports prompt-driven world events that dynamically change the environment, including flexible and compositional event generation with consistent temporal evolution.

  • Single Event: A single event prompt triggers a specific world-changing interaction.
  • Compositional Events: Multiple events compose together to create complex, multi-step world transformations.

Single Event

Compositional Events

๐Ÿ’ฌ WeChat Group

Join our WeChat group for discussion:

WeChat Group QR Code

๐Ÿ“š Citation

If you find DreamX-World useful in your research, please consider citing our technical report:

@article{team2026dreamx,
  title={DreamX-World 1.0: A General-Purpose Interactive World Model},
  author={Team, DreamX and Bai, Yancheng and Chen, Rui and Chu, Xiangxiang and Dang, Rujing and Dou, Hao and Gao, Bingjie and Gu, Qiwen and Hong, Siyu and Lei, Jiachen and others},
  journal={arXiv preprint arXiv:2606.16993},
  year={2026}
}

๐Ÿ“œ License

This project is licensed under Apache 2.0. See LICENSE for details.

โœจ Acknowledgement

We thank the Wan Team for open-sourcing their code and models.