README.md

June 28, 2026 · View on GitHub

WorldCache: Content-Aware Caching for Accelerated Video World Models

Accepted at ECCV 2026 arXiv Project Website License PyTorch

Accepted at ECCV 2026 · European Conference on Computer Vision

Oryx Video-ChatGPT

Umair Nawaz, Ahmed Heakl, Ufaq Khan, Abdelrahman Shaker, Salman Khan, Fahad Shahbaz Khan

WorldCache is a training-free, plug-and-play inference acceleration framework for diffusion-based video world models. It achieves up to 3.0× speedup while strictly maintaining temporal coherence and visual fidelity.


🎬 Qualitative Preview

High-fidelity video generation on Cosmos-Predict 2.5 (14B) with upto 3.0x speedup.

Robot 154 AV Scene
Misc Scene Robot 034

WorldCache Teaser


📖 Abstract

Video World Models increasingly rely on large-scale diffusion transformers to simulate complex spatial dynamics. However, the high computational cost of autoregressive generation remains a significant bottleneck. WorldCache overcomes this by identifying temporal and spatial redundancies in the denoising process.

Tip

WorldCache is backbone-agnostic and training-free. It can be integrated into existing diffusion pipelines with just a few lines of code.

Unlike naive caching which causes "motion drift," WorldCache uses a suite of content-aware modules like Causal Feature Caching (CFC), Saliency-Weighted Drift (SWD), Optimal Feature Approximation (OFA), and Adaptive Threshold Scheduling (ATS) to predict skipped computation rather than blindly copying it. Our method generalizes across leading architectures like NVIDIA Cosmos, WAN2.1, and DreamDojo.


✨ Key Components

WorldCache is driven by four key technical ideologies:

ModuleIconDescription
Causal Feature Caching (CFC)Dynamically scales caching tolerance based on early layer motion velocity.
Saliency-Weighted Drift (SWD)🎯Penalizes caching errors in perceptually critical high-frequency regions.
Optimal Feature Approx. (OFA)🌊Interpolates skipped cache states using trajectory matching and optical flow.
Adaptive Threshold Scheduling (ATS)📈Exponentially relaxes caching constraints in later denoising stages.

🔬 Method Overview

WorldCache treats caching like a localized prediction. It controls the pace with causal tracking while interpolating the next state.

WorldCache Pipeline

🛠️ Technical Highlights

  • Drift Probing: Uses the first KK blocks of the transformer as a lightweight proxy for global drift.
  • Motion-Adaptive Thresholds: Uses α\alpha-scaled motion signals to prevent "ghosting" artifacts in high-dynamics scenes.
  • Saliency Mapping: Weights L1 drift by spatial saliency (channel-wise variance) to preserve fine details.

⚙️ Installation & Setup

For detailed system requirements, environment setup (Virtual Env/Docker), and checkpoint downloading instructions, please refer to our:

👉 Detailed Setup Guide

⚡ Quick Summary (Conda + UV)

# 1. Create and activate conda environment
conda create -n worldcache python=3.10 -y
conda activate worldcache

# 2. Sync dependencies with UV
curl -LsSf https://astral.sh/uv/install.sh | sh
cd Models/Cosmos-Predict2.5/
uv sync --extra=cu128 --active --inexact

# 3. Basic inference (from root)
python Models/Cosmos-Predict2.5/examples/inference.py --model 2B/post-trained --worldcache_enabled [options]

🚀 Quick Start

To generate high-quality video with WorldCache acceleration:

# From the root of the repository - Text2World
CUDA_VISIBLE_DEVICES=0 python Models/Cosmos-Predict2.5/examples/inference.py \
  -i Models/Cosmos-Predict2.5/path/to/prompt.json \
  -o outputs/worldcache_output \
  --inference-type=text2world \
  --model 2B/post-trained \
  --disable-guardrails \
  --worldcache_enabled \
  --worldcache_motion_sensitivity 2.0 \
  --worldcache_flow_enabled \
  --worldcache_flow_scale 2.0 \
  --worldcache_osi_enabled \
  --worldcache_saliency_enabled \
  --worldcache_saliency_weight 1.0 \
  --worldcache_dynamic_decay

# From the root of the repository - Image2World
CUDA_VISIBLE_DEVICES=0 python Models/Cosmos-Predict2.5/examples/inference.py \
  -i Models/Cosmos-Predict2.5/path/to/prompt.json \
  -o outputs/worldcache_output \
  --inference-type=image2world \
  --model 2B/post-trained \
  --disable-guardrails \
  --worldcache_enabled \
  --worldcache_motion_sensitivity 2.0 \
  --worldcache_flow_enabled \
  --worldcache_flow_scale 2.0 \
  --worldcache_osi_enabled \
  --worldcache_saliency_enabled \
  --worldcache_saliency_weight 1.0 \
  --worldcache_dynamic_decay

📊 Quantitative Results

WorldCache establishes a new state-of-the-art for training-free diffusion acceleration, maintaining near-baseline quality while significantly reducing latency.


🌐 Model & Benchmark Coverage

Model FamilyScalesArchitecturePAI-BenchEgoDex-Eval
Cosmos-Predict 2.52B, 14BDiT
WAN2.11.3B, 14BDiT
DreamDojo2BDiT

1. PAI-Bench: Physical Reasoning Benchmarks

Across two major architectures (Cosmos and WAN), WorldCache consistently delivers >2× speedup with <1% drop in overall physical reasoning scores.

Table 1: PAI-Bench Text-to-World (T2W) Results

ModelMethodDomain AvgQuality AvgOverallLatency (s)Speedup
Cosmos 2BBaseline0.7670.7280.74854.341.00×
DiCache0.7590.7270.74340.821.3×
WorldCache0.7630.7270.74526.282.1×
Cosmos 14BBaseline0.7920.7460.769216.251.00×
DiCache0.7920.7450.768148.361.4×
WorldCache0.7950.7460.77198.612.14×

Table 2: PAI-Bench Image-to-World (I2W) Results

ModelMethodDomain AvgQuality AvgOverallLatency (s)Speedup
Cosmos 2BBaseline0.8450.7610.80355.041.00×
DiCache0.8350.7520.79439.681.40×
WorldCache0.8400.7560.79824.482.30×
Cosmos 14BBaseline0.8600.7690.814210.071.00×
DiCache0.8550.7670.811146.041.40×
WorldCache0.8590.7680.81399.252.18×

2. Architecture Transfer: WAN2.1

WorldCache is backbone-agnostic. On the latest WAN2.1 architecture, it achieves superior speed-quality tradeoffs compared to DiCache.

Table 3: WAN2.1 Transfer Results

BackboneMethodOverallLatency (s)Speedup
T2W 1.3BBaseline0.7727120.041.00×
DiCache0.770361.571.96×
WorldCache0.772150.842.36×
I2W 14BBaseline0.7384475.601.00×
DiCache0.7311291.911.53×
WorldCache0.7388206.732.31×

3. EgoDex-Eval: Robotics Performance

In egocentric robotics tasks requiring high spatial precision, WorldCache maintains frame-level fidelity (PSNR/SSIM) while enabling real-time-friendly inference.

Table 4: EgoDex-Eval (Robotics Evaluation)

ModelMethodPSNRSSIMLPIPSLatency (s)Speedup
WAN2.1-14BBaseline13.300.5030.459391.901.00×
DiCache12.950.4910.461208.601.88×
WorldCache13.190.4980.460171.602.30×
Cosmos-2.5-2BBaseline12.870.4550.51870.011.00×
DiCache12.630.4450.53151.971.34×
WorldCache12.820.4660.51843.241.62×
DreamDojo-2BBaseline23.630.7750.22619.731.00×
DiCache20.410.7340.25212.461.58×
WorldCache23.690.7370.25110.361.90×

📈 Denoising Step Budget Scaling

WorldCache scales effectively with the denoising step budget. For longer generation trajectories (more steps), the efficiency gains increase as the underlying motion manifold stabilizes.

Denoising Step Budget Scaling
Efficiency scaling: WorldCache achieves up to 3.1× speedup as denoising steps increase, while maintaining superior quality over DiCache.


WorldCache maintains flawless temporal coherence across diverse domains, from urban traffic to precision robotics.

Main Qualitative Comparison Main comparison: WorldCache stays closer to baseline rollout in dynamic and interaction-heavy regions.

Cosmos-2B Crossing
Cosmos-2B crossing scene: Preserves pedestrian identity and background consistency.
Cosmos-14B Kitchen
Cosmos-14B kitchen interaction: Stable hand and carried object tracking.
Dynamic Scene
Dynamic scene: Balanced performance in high-velocity regions.
Temporal Consistency
Consistency: Zero "ghosting" artifacts at 2.5×+ speedup.

🙏 Acknowledgements

We acknowledge the following works that inspired this project:

  • Cosmos-Predict 2.5 — NVIDIA's world foundation model platform.
  • WAN2.1 — Open suite of video foundation models.
  • DreamDojo — Generalist robot world model from the NVIDIA GEAR Team.
  • DiCacheDiCache: Let Diffusion Model Determine Its Own Cache, ICLR 2026.

📝 Citation

@inproceedings{nawaz2026worldcache,
  title         = {WorldCache: Content-Aware Caching for Accelerated Video World Models},
  author        = {Umair Nawaz and Ahmed Heakl and Ufaq Khan and Abdelrahman Shaker and Salman Khan and Fahad Shahbaz Khan},
  booktitle     = {European Conference on Computer Vision (ECCV)},
  eprint        = {2603.22286},
  archivePrefix = {arXiv},
  primaryClass  = {cs.CV},
  note          = {Accepted},
  year          = {2026}
}

📄 License

This project inherits the Apache 2.0 License from the NVIDIA Cosmos-Predict2 codebase.