Awesome-World-Model-Simulators [](https://github.com/sindresorhus/awesome)

August 25, 2026 · View on GitHub

A curated list of resources on generative world models as simulators, based on the comprehensive survey "From Generation to Simulation: How Far Are World Models from Being True Simulators?" The corpus contains 200 papers published between 2018 and 2026 and is organized using eight capabilities of traditional simulators.

Overview of world models as simulators

News🔥

  • [2026/08/24] Initial release of the Awesome-World-Model-Simulators repository.
  • [2026/06/30] Literature search closed with a corpus of 200 papers.

Contact

If you have suggestions, corrections, or new papers to recommend, please open a GitHub issue or submit a pull request.

If this list helps your research, please ⭐ and cite:

@misc{wang2026generationsimulationfarworld,
  title={From Generation to Simulation: How Far Are World Models from Being True Simulators?},
  author={Tong Wang and Huan Deng and Mucheng Yang and Yang He and Xiaohui Kuang and Gang Zhao},
  year={2026},
  eprint={2608.23070},
  archivePrefix={arXiv},
  primaryClass={cs.AI},
  url={https://arxiv.org/abs/2608.23070}
}

Table of Contents 🍃

Roadmap of world models as simulators

Research landscape across simulator capabilities

The master list records each paper exactly once, while the eight capability sections form a reverse index. A paper appears in every capability section to which it makes a principal contribution; consequently, entries may occur in more than one reverse-index section. Within each capability, papers are grouped by the concrete analytical categories used in the survey rather than by technical route. The dedicated survey section provides a topical index of all review papers.

How to read the counts. This repository contains exactly 200 unique papers and 499 C1–C8 capability assignments. Each paper has one to three principal capability tags, so the capability-section counts represent assignment incidences and should not be summed as a paper total. The Surveys section additionally re-indexes 16 review papers already included in the same corpus. The master list is therefore the authoritative view for the 200-paper total; the capability and survey sections are navigation indexes.

Master List: 200 Unique Papers

Each paper appears exactly once in this table, ordered by publication year (newest first) and then by title. Capability tags link to the corresponding reverse-index sections below.

TitlePub. & DateCapability TagsCode/Project URL
τ0-WM: A Unified Video-Action World Model for Robotic ManipulationarXiv 2026C4 · C6 · C8Star
3D4D: An Interactive, Editable, 4D World Model via 3D Video GenerationAAAI 2026C1 · C3Website
ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics AlignmentarXiv 2026C2 · C4Star
ActionParty: Multi-Subject Action Binding in Generative Video GamesarXiv 2026C3 · C4Star
ActWorld: From Explorable to Interactive World Model via Action-Aware MemoryarXiv 2026C2 · C4 · C5Website
Advancing Open-source World ModelsarXiv 2026C3 · C5 · C7Star
Being-H0.7: A Latent World-Action Model from Egocentric VideosarXiv 2026C4 · C6 · C7Star
BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment MasksarXiv 2026C1 · C3 · C4Website
Comp4D: Compositional 4D Scene GenerationWACV 2026C1 · C7Star
Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and PlanningarXiv 2026C3 · C4 · C6Website
CP4D: Compositional Physics-aware 4D Scene GenerationarXiv 2026C1 · C2 · C5Website
DecMem: Towards Minute-Long Consistent World Generation with Decoupled MemoryarXiv 2026C1 · C5Star
DiLA: Disentangled Latent Action World ModelsarXiv 2026C4 · C5 · C7Star
DisCo: World Models with Discrete Camera Motion ControlarXiv 2026C4 · C5
DreamDojo: A Generalist Robot World Model from Large-Scale Human VideosarXiv 2026C3 · C4 · C7Star
DreamX-World 1.0: A General-Purpose Interactive World ModelarXiv 2026C3 · C4 · C5Star
DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous DrivingarXiv 2026C4 · C7 · C8Website
Factored Latent Action World ModelsarXiv 2026C3 · C4Star
Fast Autoregressive Video Diffusion and World Models with Temporal Cache Compression and Sparse AttentionarXiv 2026C3 · C5
Fine-flow Distilling Coarse-flow Video Generation for Long-Term Driving World ModelAAAI 2026C4 · C5Star
FlowDreamer: A RGB-D World Model With Flow-Based Motion Representations for Robot ManipulationICRA 2026C4 · C6Website
Future Dynamic 3D Reconstruction: A 3D World Model with Disentangled Ego-MotionarXiv 2026C1 · C5 · C7Website
GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game AgentsarXiv 2026C3 · C8Website
GEM-4D: Geometry-Enhanced Video World Models for Robot ManipulationarXiv 2026C1 · C2 · C5Website
Grounding World Simulation Models in a Real-World MetropolisarXiv 2026C4 · C5
Hierarchical Latent Action ModelarXiv 2026C4
iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation FrameworkarXiv 2026C4 · C5 · C8Website
Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied SimulationarXiv 2026C2 · C4 · C6Star
Learning Invariant Visual Representations for Planning with Joint-Embedding Predictive World ModelsarXiv 2026C4 · C5Star
Learning Latent Action World Models In The WildarXiv 2026C3 · C4 · C7
LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World ModelsarXiv 2026C5 · C8Website
Lyra 2.0: Explorable Generative 3D WorldsarXiv 2026C1 · C3 · C5Star
MAGICITY4D: Controllable and Editable 4D City Scene Generation Using MLLM-Enhanced Procedural Content GenerationICASSP 2026C1 · C4Website
MANIPDREAMER: Boosting Robotic Manipulation World Model with Action Tree and Visual GuidanceICASSP 2026C3 · C4Website
Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon MemoryarXiv 2026C3 · C4 · C5Star
minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World ModelsarXiv 2026C3 · C4Star
MoVerse: Real-Time Video World Modeling with Panoramic Gaussian ScaffoldarXiv 2026C1 · C3 · C5Star
MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic ManipulationarXiv 2026C4 · C6Website
Nano World Models: A Minimalist Implementation of Future Video PredictionarXiv 2026C4 · C7 · C8Star
NeoVerse: Enhancing 4D World Model with in-the-wild Monocular VideosarXiv 2026C1 · C4 · C7Website
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle SimulationarXiv 2026C3 · C4 · C7Star
OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous DrivingTIP 2026C4 · C5 · C6Star
Olaf-World: Orienting Latent Actions for Video World ModelingarXiv 2026C3 · C4 · C7Website
OmniRoam: World Wandering via Long-Horizon Panoramic Video GenerationarXiv 2026C4 · C5Star
Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World ModelsarXiv 2026C3 · C8Star
OpenGame: Open Agentic Coding for GamesarXiv 2026C8Star
OrbiSim: World Models as Differentiable Physics Engines for Embodied IntelligencearXiv 2026C2 · C4 · C6Website
Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent SpaceAAAI 2026C3 · C4
Physics Consistent World Models via Schrödinger-Bridge Optimal Transport for Computational Imaging and 3D-Consistent Video GenerationsAAAI 2026C2 · C5
PointWorld: Scaling 3D World Models for In-The-Wild Robotic ManipulationarXiv 2026C2 · C3 · C6Website
Pre-Trained Video Generative Models as World SimulatorsAAAI 2026C3 · C4 · C5
Prisma-World: Camera-Controllable Multi-Agent Video World ModelarXiv 2026C1 · C4 · C5Star
ReactSim-Bench: Benchmarking Reactive Behavior World Model Simulation in Autonomous DrivingarXiv 2026C4 · C5 · C8Star
RealWonder: Real-Time Physical Action-Conditioned Video GenerationarXiv 2026C2 · C3Website
RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic ManipulationarXiv 2026C2 · C4 · C8Website
Self-evolving World ModelAutonomous Embodied AI 2026C3 · C4
Simulating the Real World: A Unified Survey of Multimodal Generative ModelsTPAMI 2026C7 · C8
Solaris: Building a Multiplayer Video World Model in MinecraftarXiv 2026C3 · C5Star
SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World TasksarXiv 2026C4 · C7 · C8Website
STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic ManipulationarXiv 2026C4 · C6
Towards Dynamic World Model Generation with Monocular VideoICASSP 2026C1 · C4
Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future TrendsarXiv 2026C3 · C4 · C8Star
UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous DrivingarXiv 2026C3 · C4Website
UWM-JEPA: Predictive World Models That Imagine in Belief SpacearXiv 2026C4 · C5Star
VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector GraphsarXiv 2026C3 · C5 · C6Star
Vega: Learning to Drive with Natural Language InstructionsarXiv 2026C4Star
VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric ControlarXiv 2026C1 · C2 · C4Star
Video Generation Models as World Models: Efficient Paradigms, Architectures and AlgorithmsarXiv 2026C2 · C5
VJEPA: Variational Joint Embedding Predictive Architectures as Probabilistic World ModelsarXiv 2026C4 · C5Star
WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model EvaluationarXiv 2026C3 · C8Star
What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?TMLR 2026C3 · C4Star
What-If World: A Causal Benchmark for General World Models in Embodied ScenariosarXiv 2026C2 · C5 · C8
What Makes Video World Model Latents Action-Relevant: Prediction over ReconstructionarXiv 2026C4 · C7
WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and PlatformarXiv 2026C6 · C7 · C8Website
WorldBench: Disambiguating Physics for Diagnostic Evaluation of World ModelsarXiv 2026C2 · C8
WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World ModelsarXiv 2026C3 · C4 · C5Website
World model-based long-tail and scenario-specific generation for autonomous drivingJICV 2026C3 · C7
World Model for Robot Learning: A Comprehensive SurveyarXiv 2026C8Star
World Models for Robotic Manipulation: A SurveyarXiv 2026C4 · C8
Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous DrivingarXiv 2026C1 · C4 · C6Website
A Comprehensive Survey on World Models for Embodied AIarXiv 2025C2 · C5 · C8Star
AdaWorld: Learning Adaptable World Models with Latent ActionsICML 2025C3 · C4Star
AETHER: Geometric-Aware Unified World ModelingICCV 2025C1 · C4 · C7Star
A Survey: Learning Embodied Intelligence from Physical Simulators and World ModelsarXiv 2025C2 · C3 · C8Star
A Survey of World Models for Autonomous DrivingarXiv 2025C8
ChronoDreamer: Action-Conditioned World Model as an Online Simulator for Robotic PlanningarXiv 2025C2 · C3 · C6Star
Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation ModelsarXiv 2025C4 · C7Website
Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal ControlarXiv 2025C4 · C7Star
Cosmos World Foundation Model Platform for Physical AIarXiv 2025C1 · C7Star
Ctrl-World: A Controllable Generative World Model for Robot ManipulationarXiv 2025C4 · C5 · C8Website
Diffusion Models Are Real-Time Game EnginesICLR 2025C3 · C4 · C5Website
DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene GenerationICCV 2025C4 · C6Website
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video GenerationAAAI 2025C4 · C7 · C8Website
DrivingGPT: Unifying Driving World Modeling and Planning with Multi-Modal Autoregressive TransformersICCV 2025C4 · C5 · C8Website
Embodied World Models Emerge from Navigational Task in Open-Ended EnvironmentsarXiv 2025C3 · C6
ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric InteractionarXiv 2025C3 · C6 · C8Website
Free4D: Tuning-Free 4D Scene Generation with Spatial-Temporal ConsistencyICCV 2025C1 · C4Star
From 2D to 3D Cognition: A Brief Survey of General World ModelsarXiv 2025C1 · C2 · C3
GAF: Gaussian Action Field as a 4D Representation for Dynamic World Modeling in Robotic ManipulationarXiv 2025C1 · C4 · C6Star
GAIA-2: A Controllable Multi-View Generative World Model for Autonomous DrivingarXiv 2025C4 · C5 · C7Website
GameFactory: Creating New Games with Generative Interactive VideosICCV 2025C3 · C4 · C7Website
GameGen-X: Interactive Open-world Game Video GenerationICLR 2025C1 · C4 · C7Star
GaussianDWM: 3D Gaussian Driving World Model for Unified Scene Understanding and Multi-Modal GenerationarXiv 2025C4 · C6Star
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition ControlCVPR 2025C4 · C6 · C8Star
Generative World Modelling for Humanoids: 1X World Model Challenge Technical ReportarXiv 2025C4 · C6 · C8Star
Genie Envisioner: A Unified World Foundation Platform for Robotic ManipulationarXiv 2025C2 · C4 · C8Website
GigaWorld-0: World Models as Data Engine to Empower Embodied AIarXiv 2025C1 · C2 · C7Star
GWM: Towards Scalable Gaussian World Models for Robotic ManipulationICCV 2025C1 · C2 · C4Star
HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene GenerationACM MM 2025C1 · C7Star
Hunyuan-GameCraft-2: Instruction-following Interactive Game World ModelarXiv 2025C3 · C4 · C8Website
Inferix: A Block-Diffusion based Next-Generation Inference Engine for World SimulationarXiv 2025C3 · C5 · C8Star
IRASim: A Fine-Grained World Model for Robot ManipulationICCV 2025C2 · C3 · C4Website
Latent Action World Models for Control with Unlabeled TrajectoriesarXiv 2025C4 · C7
Learning 3D Persistent Embodied World ModelsNeurIPS 2025C5 · C6Star
Learning Real-World Action-Video Dynamics with Heterogeneous Masked AutoregressionarXiv 2025C3 · C4 · C8Website
Mastering diverse control tasks through world modelsNature 2025C5 · C7Star
Matrix-game 2.0: An open-source real-time and streaming interactive world modelarXiv 2025C3 · C4 · C5Star
Matrix-Game: Interactive World Foundation ModelarXiv 2025C3 · C4 · C8Star
Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video GenerationarXiv 2025C5 · C8
MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous DrivingarXiv 2025C4 · C5Star
MineWorld: a Real-Time and Open-Source Interactive World Model on MinecraftarXiv 2025C3 · C8Website
Motus: A Unified Latent Action World ModelarXiv 2025C4 · C7Website
MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric RepresentationsIEEE IV 2025C4 · C6Star
Navigation World ModelsCVPR 2025C4 · C5 · C7
PAN: A World Model for General, Interactable, and Long-Horizon World SimulationarXiv 2025C3 · C4 · C5
PIN-WM: Learning Physics-INformed World Models for Non-Prehensile ManipulationRSS 2025C1 · C2 · C7Star
PlayerOne: Egocentric World SimulatorNeurIPS 2025C1 · C4 · C5Star
Prompting with the Future: Open-World Model Predictive Control with Interactive Digital TwinsRSS 2025C2 · C6Website
ProphetDWM: A Driving World Model for Rolling Out Future Actions and VideosarXiv 2025C4 · C5 · C6Star
ReconDreamer-RL: Enhancing Reinforcement Learning via Diffusion-based Scene ReconstructionarXiv 2025C2 · C3 · C8Website
RELIC: Interactive Video World Model with Long-Horizon MemoryarXiv 2025C3 · C4 · C5Website
RoboChallenge: Large-scale Real-robot Evaluation of Embodied PoliciesarXiv 2025C3 · C8Star
RoboScape: Physics-informed Embodied World ModelarXiv 2025C1 · C2 · C6Star
RoDyn: Taming Interactive Robot-Dynamic 2.5D World Model for Robotic ManipulationarXiv 2025C2 · C4 · C6Website
Simulating the Visual World with Artificial Intelligence: A RoadmaparXiv 2025C2 · C3 · C8Website
SimWorld: A Unified Benchmark for Simulator-Conditioned Scene Generation via World ModelIROS 2025C6 · C8Star
STORM: Search-Guided Generative World Models for Robotic ManipulationarXiv 2025C4 · C6 · C8
TesserAct: Learning 4D Embodied World ModelsICCV 2025C1 · C6Website
The Matrix: Infinite-Horizon World Generation with Real-Time Moving ControlNeurIPS 2025C3 · C4 · C5Website
The Role of World Models in Shaping Autonomous Driving: A Comprehensive SurveyarXiv 2025C8Star
Understanding World or Predicting Future? A Comprehensive Survey of World ModelsACM Computing Surveys 2025C8Star
Unified Video Action ModelRSS 2025C3 · C6Website
UniScene: Unified Occupancy-centric Driving Scene GenerationCVPR 2025C1 · C7 · C8Star
Video World Models with Long-term Spatial MemoryarXiv 2025C1 · C5Website
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and PlanningarXiv 2025C4 · C5 · C7Star
VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View MemoryICCV 2025C4 · C5Star
Whole-Body Conditioned Egocentric Video PredictionNeurIPS 2025C2 · C4 · C8
WonderWorld: Interactive 3D Scene Generation from a Single ImageCVPR 2025C1 · C3 · C5Star
WorldGen: From Text to Traversable and Interactive 3D WorldsarXiv 2025C1 · C3 · C4Website
World-in-World: World Models in a Closed-Loop WorldarXiv 2025C3 · C4 · C8Star
World model-based end-to-end scene generation for accident anticipation in autonomous drivingCommunications Engineering 2025C4 · C7
World Model Enhanced Embodied Intelligence for Deformable Object Manipulation of Dynamic TargetsCINTI 2025C2 · C5
WorldPack: Compressed Memory Improves Spatial Consistency in Video World ModelingarXiv 2025C4 · C5 · C8
WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World ModelingarXiv 2025C3 · C4 · C5Website
WorldScore: A Unified Evaluation Benchmark for World GenerationICCV 2025C4 · C8Website
WorldVLA: Towards Autoregressive Action World ModelarXiv 2025C2 · C4 · C5Star
WoW: Towards a World omniscient World model Through Embodied InteractionarXiv 2025C2 · C5 · C8Star
Yan: Foundational Interactive Video GenerationarXiv 2025C3 · C4 · C5Website
Yume-1.5: A Text-Controlled Interactive World Generation ModelarXiv 2025C3 · C4 · C5Star
Yume: An Interactive World Generation ModelarXiv 2025C3 · C4 · C5Star
A Unified Approach for Text-and Image-Guided 4D Scene GenerationCVPR 2024C1 · C7
AVID: Adapting Video Diffusion Models to World ModelsarXiv 2024C3 · C4
Diffusion for World Modeling: Visual Details Matter in AtariNeurIPS 2024C3 · C5 · C6Website
Doe-1: Closed-Loop Autonomous Driving with Large World ModelarXiv 2024C3 · C4 · C6Star
DriveDreamer: Towards Real-world-driven World Models for Autonomous DrivingECCV 2024C1 · C4Star
DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World ModelarXiv 2024C3 · C7 · C8Website
Driving Into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous DrivingCVPR 2024C4 · C5 · C7Star
DrivingWorld: Constructing World Model for Autonomous Driving via Video GPTarXiv 2024C4 · C5Star
Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A SurveyarXiv 2024C8
GenAD: Generalized Predictive Model for Autonomous DrivingarXiv 2024C3 · C4 · C7Star
Generative World ExplorerarXiv 2024C3 · C5 · C6Star
Genie: Generative Interactive EnvironmentsICML 2024C1 · C3 · C4Website
Is Sora a World Simulator? A Comprehensive Survey on General World Models and BeyondarXiv 2024C2 · C5Star
iVideoGPT: Interactive VideoGPTs are Scalable World ModelsNeurIPS 2024C3 · C4 · C6Website
Learning Interactive Real-World SimulatorsICLR 2024C3 · C4 · C7Website
Learning to Act from Actionless Videos through Dense CorrespondencesICLR 2024C4 · C6 · C7Star
MagicDrive: Street View Generation with Diverse 3D Geometry ControlICLR 2024C1 · C4 · C5Star
MoDem-V2: Visuo-Motor World Models for Real-World Robot ManipulationICRA 2024C3 · C6Star
OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous DrivingarXiv 2024C3 · C4 · C6
Pandora: Towards General World Model with Natural Language Actions and Video StatesarXiv 2024C3 · C4 · C7Website
Peekaboo: Interactive Video Generation via Masked-DiffusionCVPR 2024C3 · C4Star
Playable Game GenerationarXiv 2024C3 · C5 · C8Star
RoboDreamer: Learning Compositional World Models for Robot ImaginationICML 2024C4 · C5 · C7Website
ADriver-I: A General World Model for Autonomous DrivingarXiv 2023C3 · C4 · C5
GAIA-1: A Generative World Model for Autonomous DrivingarXiv 2023C4 · C5 · C7Website
Learning Universal Policies via Text-Guided Video GenerationNeurIPS 2023C4 · C6 · C7Website
Phenaki: Variable Length Video Generation from Open Domain Textual DescriptionsICLR 2023C4 · C5
TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion PredictionICRA 2023C3 · C4Star
Transformers are Sample-Efficient World ModelsICLR 2023C5 · C6Star
DayDreamer: World Models for Physical Robot LearningCoRL 2022C2 · C3Star
Planning with Diffusion for Flexible Behavior SynthesisICML 2022C4 · C5Star
Playable Environments: Video Manipulation in Space and TimeCVPR 2022C1 · C4 · C5Star
Mastering Atari with Discrete World ModelsICLR 2021C5 · C6
Playable Video GenerationCVPR 2021C3 · C4Star
VideoGPT: Video Generation using VQ-VAE and TransformersarXiv 2021C1 · C7Website
Dream to Control: Learning Behaviors by Latent ImaginationICLR 2020C5 · C6
Mastering Atari, Go, chess and shogi by planning with a learned modelNature 2020C5 · C6
Model Based Reinforcement Learning for AtariICLR 2020C5 · C6
Learning Latent Dynamics for Planning from PixelsICML 2019C5 · C6
World ModelsarXiv 2018C3 · C5Website

1 Asset Construction

Controllable creation, composition, and editing of maps, objects, characters, materials, and persistent 3D/4D assets. 38 papers in the corpus make this a principal contribution.

C1 Assets as Conditional Input (6)

TitlePub. & DateCode/Project URL
VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric ControlarXiv 2026Star
Prisma-World: Camera-Controllable Multi-Agent Video World ModelarXiv 2026Star
MAGICITY4D: Controllable and Editable 4D City Scene Generation Using MLLM-Enhanced Procedural Content GenerationICASSP 2026Website
BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment MasksarXiv 2026Website
MagicDrive: Street View Generation with Diverse 3D Geometry ControlICLR 2024Star
DriveDreamer: Towards Real-world-driven World Models for Autonomous DrivingECCV 2024Star

C1 Asset Generation by World Models (32)

TitlePub. & DateCode/Project URL
Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous DrivingarXiv 2026Website
Towards Dynamic World Model Generation with Monocular VideoICASSP 2026
NeoVerse: Enhancing 4D World Model with in-the-wild Monocular VideosarXiv 2026Website
MoVerse: Real-Time Video World Modeling with Panoramic Gaussian ScaffoldarXiv 2026Star
Lyra 2.0: Explorable Generative 3D WorldsarXiv 2026Star
GEM-4D: Geometry-Enhanced Video World Models for Robot ManipulationarXiv 2026Website
Future Dynamic 3D Reconstruction: A 3D World Model with Disentangled Ego-MotionarXiv 2026Website
DecMem: Towards Minute-Long Consistent World Generation with Decoupled MemoryarXiv 2026Star
CP4D: Compositional Physics-aware 4D Scene GenerationarXiv 2026Website
Comp4D: Compositional 4D Scene GenerationWACV 2026Star
3D4D: An Interactive, Editable, 4D World Model via 3D Video GenerationAAAI 2026Website
WorldGen: From Text to Traversable and Interactive 3D WorldsarXiv 2025Website
WonderWorld: Interactive 3D Scene Generation from a Single ImageCVPR 2025Star
Video World Models with Long-term Spatial MemoryarXiv 2025Website
UniScene: Unified Occupancy-centric Driving Scene GenerationCVPR 2025Star
TesserAct: Learning 4D Embodied World ModelsICCV 2025Website
RoboScape: Physics-informed Embodied World ModelarXiv 2025Star
PlayerOne: Egocentric World SimulatorNeurIPS 2025Star
PIN-WM: Learning Physics-INformed World Models for Non-Prehensile ManipulationRSS 2025Star
HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene GenerationACM MM 2025Star
GWM: Towards Scalable Gaussian World Models for Robotic ManipulationICCV 2025Star
GigaWorld-0: World Models as Data Engine to Empower Embodied AIarXiv 2025Star
GameGen-X: Interactive Open-world Game Video GenerationICLR 2025Star
GAF: Gaussian Action Field as a 4D Representation for Dynamic World Modeling in Robotic ManipulationarXiv 2025Star
From 2D to 3D Cognition: A Brief Survey of General World ModelsarXiv 2025
Free4D: Tuning-Free 4D Scene Generation with Spatial-Temporal ConsistencyICCV 2025Star
Cosmos World Foundation Model Platform for Physical AIarXiv 2025Star
AETHER: Geometric-Aware Unified World ModelingICCV 2025Star
Genie: Generative Interactive EnvironmentsICML 2024Website
A Unified Approach for Text-and Image-Guided 4D Scene GenerationCVPR 2024
Playable Environments: Video Manipulation in Space and TimeCVPR 2022Star
VideoGPT: Video Generation using VQ-VAE and TransformersarXiv 2021Website

2 Physics Engine

Faithful modeling of motion, collision, contact, deformation, and other physical laws. 34 papers in the corpus make this a principal contribution.

C2 Hard Physics (4)

TitlePub. & DateCode/Project URL
OrbiSim: World Models as Differentiable Physics Engines for Embodied IntelligencearXiv 2026Website
Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied SimulationarXiv 2026Star
Prompting with the Future: Open-World Model Predictive Control with Interactive Digital TwinsRSS 2025Website
PIN-WM: Learning Physics-INformed World Models for Non-Prehensile ManipulationRSS 2025Star

C2 Soft Constraints (26)

TitlePub. & DateCode/Project URL
Video Generation Models as World Models: Efficient Paradigms, Architectures and AlgorithmsarXiv 2026
VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric ControlarXiv 2026Star
RealWonder: Real-Time Physical Action-Conditioned Video GenerationarXiv 2026Website
PointWorld: Scaling 3D World Models for In-The-Wild Robotic ManipulationarXiv 2026Website
GEM-4D: Geometry-Enhanced Video World Models for Robot ManipulationarXiv 2026Website
CP4D: Compositional Physics-aware 4D Scene GenerationarXiv 2026Website
ActWorld: From Explorable to Interactive World Model via Action-Aware MemoryarXiv 2026Website
ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics AlignmentarXiv 2026Star
WoW: Towards a World omniscient World model Through Embodied InteractionarXiv 2025Star
WorldVLA: Towards Autoregressive Action World ModelarXiv 2025Star
World Model Enhanced Embodied Intelligence for Deformable Object Manipulation of Dynamic TargetsCINTI 2025
Whole-Body Conditioned Egocentric Video PredictionNeurIPS 2025
Simulating the Visual World with Artificial Intelligence: A RoadmaparXiv 2025Website
RoDyn: Taming Interactive Robot-Dynamic 2.5D World Model for Robotic ManipulationarXiv 2025Website
RoboScape: Physics-informed Embodied World ModelarXiv 2025Star
ReconDreamer-RL: Enhancing Reinforcement Learning via Diffusion-based Scene ReconstructionarXiv 2025Website
IRASim: A Fine-Grained World Model for Robot ManipulationICCV 2025Website
GWM: Towards Scalable Gaussian World Models for Robotic ManipulationICCV 2025Star
GigaWorld-0: World Models as Data Engine to Empower Embodied AIarXiv 2025Star
Genie Envisioner: A Unified World Foundation Platform for Robotic ManipulationarXiv 2025Website
From 2D to 3D Cognition: A Brief Survey of General World ModelsarXiv 2025
ChronoDreamer: Action-Conditioned World Model as an Online Simulator for Robotic PlanningarXiv 2025Star
A Survey: Learning Embodied Intelligence from Physical Simulators and World ModelsarXiv 2025Star
A Comprehensive Survey on World Models for Embodied AIarXiv 2025Star
Is Sora a World Simulator? A Comprehensive Survey on General World Models and BeyondarXiv 2024Star
DayDreamer: World Models for Physical Robot LearningCoRL 2022Star

C2 Physical Evaluation (4)

TitlePub. & DateCode/Project URL
WorldBench: Disambiguating Physics for Diagnostic Evaluation of World ModelsarXiv 2026
What-If World: A Causal Benchmark for General World Models in Embodied ScenariosarXiv 2026
RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic ManipulationarXiv 2026Website
Physics Consistent World Models via Schrödinger-Bridge Optimal Transport for Computational Imaging and 3D-Consistent Video GenerationsAAAI 2026

3 Interaction

The breadth of entities that can interact and the depth, latency, and closed-loop nature of interaction. 80 papers in the corpus make this a principal contribution.

C3 The Object of Interaction (51)

TitlePub. & DateCode/Project URL
WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World ModelsarXiv 2026Website
World model-based long-tail and scenario-specific generation for autonomous drivingJICV 2026
What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?TMLR 2026Star
UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous DrivingarXiv 2026Website
Solaris: Building a Multiplayer Video World Model in MinecraftarXiv 2026Star
Self-evolving World ModelAutonomous Embodied AI 2026
Pre-Trained Video Generative Models as World SimulatorsAAAI 2026
PointWorld: Scaling 3D World Models for In-The-Wild Robotic ManipulationarXiv 2026Website
Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent SpaceAAAI 2026
Olaf-World: Orienting Latent Actions for Video World ModelingarXiv 2026Website
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle SimulationarXiv 2026Star
minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World ModelsarXiv 2026Star
Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon MemoryarXiv 2026Star
MANIPDREAMER: Boosting Robotic Manipulation World Model with Action Tree and Visual GuidanceICASSP 2026Website
Lyra 2.0: Explorable Generative 3D WorldsarXiv 2026Star
Learning Latent Action World Models In The WildarXiv 2026
Fast Autoregressive Video Diffusion and World Models with Temporal Cache Compression and Sparse AttentionarXiv 2026
Factored Latent Action World ModelsarXiv 2026Star
BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment MasksarXiv 2026Website
Advancing Open-source World ModelsarXiv 2026Star
ActionParty: Multi-Subject Action Binding in Generative Video GamesarXiv 2026Star
Yume: An Interactive World Generation ModelarXiv 2025Star
Yan: Foundational Interactive Video GenerationarXiv 2025Website
WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World ModelingarXiv 2025Website
The Matrix: Infinite-Horizon World Generation with Real-Time Moving ControlNeurIPS 2025Website
Simulating the Visual World with Artificial Intelligence: A RoadmaparXiv 2025Website
ReconDreamer-RL: Enhancing Reinforcement Learning via Diffusion-based Scene ReconstructionarXiv 2025Website
PAN: A World Model for General, Interactable, and Long-Horizon World SimulationarXiv 2025
MineWorld: a Real-Time and Open-Source Interactive World Model on MinecraftarXiv 2025Website
Matrix-Game: Interactive World Foundation ModelarXiv 2025Star
Matrix-game 2.0: An open-source real-time and streaming interactive world modelarXiv 2025Star
IRASim: A Fine-Grained World Model for Robot ManipulationICCV 2025Website
Inferix: A Block-Diffusion based Next-Generation Inference Engine for World SimulationarXiv 2025Star
GameFactory: Creating New Games with Generative Interactive VideosICCV 2025Website
From 2D to 3D Cognition: A Brief Survey of General World ModelsarXiv 2025
ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric InteractionarXiv 2025Website
Diffusion Models Are Real-Time Game EnginesICLR 2025Website
ChronoDreamer: Action-Conditioned World Model as an Online Simulator for Robotic PlanningarXiv 2025Star
AdaWorld: Learning Adaptable World Models with Latent ActionsICML 2025Star
A Survey: Learning Embodied Intelligence from Physical Simulators and World ModelsarXiv 2025Star
Playable Game GenerationarXiv 2024Star
OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous DrivingarXiv 2024
MoDem-V2: Visuo-Motor World Models for Real-World Robot ManipulationICRA 2024Star
Genie: Generative Interactive EnvironmentsICML 2024Website
GenAD: Generalized Predictive Model for Autonomous DrivingarXiv 2024Star
Doe-1: Closed-Loop Autonomous Driving with Large World ModelarXiv 2024Star
Diffusion for World Modeling: Visual Details Matter in AtariNeurIPS 2024Website
TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion PredictionICRA 2023Star
ADriver-I: A General World Model for Autonomous DrivingarXiv 2023
DayDreamer: World Models for Physical Robot LearningCoRL 2022Star
World ModelsarXiv 2018Website

C3 The Depth of Interaction (29)

TitlePub. & DateCode/Project URL
WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model EvaluationarXiv 2026Star
VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector GraphsarXiv 2026Star
Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future TrendsarXiv 2026Star
RealWonder: Real-Time Physical Action-Conditioned Video GenerationarXiv 2026Website
Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World ModelsarXiv 2026Star
MoVerse: Real-Time Video World Modeling with Panoramic Gaussian ScaffoldarXiv 2026Star
GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game AgentsarXiv 2026Website
DreamX-World 1.0: A General-Purpose Interactive World ModelarXiv 2026Star
DreamDojo: A Generalist Robot World Model from Large-Scale Human VideosarXiv 2026Star
Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and PlanningarXiv 2026Website
3D4D: An Interactive, Editable, 4D World Model via 3D Video GenerationAAAI 2026Website
Yume-1.5: A Text-Controlled Interactive World Generation ModelarXiv 2025Star
WorldGen: From Text to Traversable and Interactive 3D WorldsarXiv 2025Website
World-in-World: World Models in a Closed-Loop WorldarXiv 2025Star
WonderWorld: Interactive 3D Scene Generation from a Single ImageCVPR 2025Star
Unified Video Action ModelRSS 2025Website
RoboChallenge: Large-scale Real-robot Evaluation of Embodied PoliciesarXiv 2025Star
RELIC: Interactive Video World Model with Long-Horizon MemoryarXiv 2025Website
Learning Real-World Action-Video Dynamics with Heterogeneous Masked AutoregressionarXiv 2025Website
Hunyuan-GameCraft-2: Instruction-following Interactive Game World ModelarXiv 2025Website
Embodied World Models Emerge from Navigational Task in Open-Ended EnvironmentsarXiv 2025
Peekaboo: Interactive Video Generation via Masked-DiffusionCVPR 2024Star
Pandora: Towards General World Model with Natural Language Actions and Video StatesarXiv 2024Website
Learning Interactive Real-World SimulatorsICLR 2024Website
iVideoGPT: Interactive VideoGPTs are Scalable World ModelsNeurIPS 2024Website
Generative World ExplorerarXiv 2024Star
DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World ModelarXiv 2024Website
AVID: Adapting Video Diffusion Models to World ModelsarXiv 2024
Playable Video GenerationCVPR 2021Star

4 Controllability

How precisely users or agents can steer world evolution through explicit, multimodal, or learned actions. 125 papers in the corpus make this a principal contribution.

C4 Explicit Control (89)

TitlePub. & DateCode/Project URL
τ0-WM: A Unified Video-Action World Model for Robotic ManipulationarXiv 2026Star
Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous DrivingarXiv 2026Website
WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World ModelsarXiv 2026Website
World Models for Robotic Manipulation: A SurveyarXiv 2026
What Makes Video World Model Latents Action-Relevant: Prediction over ReconstructionarXiv 2026
What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?TMLR 2026Star
VJEPA: Variational Joint Embedding Predictive Architectures as Probabilistic World ModelsarXiv 2026Star
VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric ControlarXiv 2026Star
UWM-JEPA: Predictive World Models That Imagine in Belief SpacearXiv 2026Star
Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future TrendsarXiv 2026Star
Towards Dynamic World Model Generation with Monocular VideoICASSP 2026
Self-evolving World ModelAutonomous Embodied AI 2026
RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic ManipulationarXiv 2026Website
ReactSim-Bench: Benchmarking Reactive Behavior World Model Simulation in Autonomous DrivingarXiv 2026Star
Prisma-World: Camera-Controllable Multi-Agent Video World ModelarXiv 2026Star
Pre-Trained Video Generative Models as World SimulatorsAAAI 2026
Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent SpaceAAAI 2026
OrbiSim: World Models as Differentiable Physics Engines for Embodied IntelligencearXiv 2026Website
OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous DrivingTIP 2026Star
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle SimulationarXiv 2026Star
NeoVerse: Enhancing 4D World Model with in-the-wild Monocular VideosarXiv 2026Website
Nano World Models: A Minimalist Implementation of Future Video PredictionarXiv 2026Star
MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic ManipulationarXiv 2026Website
minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World ModelsarXiv 2026Star
Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon MemoryarXiv 2026Star
MANIPDREAMER: Boosting Robotic Manipulation World Model with Action Tree and Visual GuidanceICASSP 2026Website
Learning Invariant Visual Representations for Planning with Joint-Embedding Predictive World ModelsarXiv 2026Star
Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied SimulationarXiv 2026Star
iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation FrameworkarXiv 2026Website
Grounding World Simulation Models in a Real-World MetropolisarXiv 2026
FlowDreamer: A RGB-D World Model With Flow-Based Motion Representations for Robot ManipulationICRA 2026Website
Fine-flow Distilling Coarse-flow Video Generation for Long-Term Driving World ModelAAAI 2026Star
DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous DrivingarXiv 2026Website
DreamDojo: A Generalist Robot World Model from Large-Scale Human VideosarXiv 2026Star
DisCo: World Models with Discrete Camera Motion ControlarXiv 2026
Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and PlanningarXiv 2026Website
BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment MasksarXiv 2026Website
ActWorld: From Explorable to Interactive World Model via Action-Aware MemoryarXiv 2026Website
ActionParty: Multi-Subject Action Binding in Generative Video GamesarXiv 2026Star
ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics AlignmentarXiv 2026Star
Yume: An Interactive World Generation ModelarXiv 2025Star
Yan: Foundational Interactive Video GenerationarXiv 2025Website
WorldScore: A Unified Evaluation Benchmark for World GenerationICCV 2025Website
WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World ModelingarXiv 2025Website
WorldPack: Compressed Memory Improves Spatial Consistency in Video World ModelingarXiv 2025
World-in-World: World Models in a Closed-Loop WorldarXiv 2025Star
World model-based end-to-end scene generation for accident anticipation in autonomous drivingCommunications Engineering 2025
Whole-Body Conditioned Egocentric Video PredictionNeurIPS 2025
VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View MemoryICCV 2025Star
The Matrix: Infinite-Horizon World Generation with Real-Time Moving ControlNeurIPS 2025Website
RoDyn: Taming Interactive Robot-Dynamic 2.5D World Model for Robotic ManipulationarXiv 2025Website
RELIC: Interactive Video World Model with Long-Horizon MemoryarXiv 2025Website
ProphetDWM: A Driving World Model for Rolling Out Future Actions and VideosarXiv 2025Star
PlayerOne: Egocentric World SimulatorNeurIPS 2025Star
Navigation World ModelsCVPR 2025
MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous DrivingarXiv 2025Star
Matrix-Game: Interactive World Foundation ModelarXiv 2025Star
Matrix-game 2.0: An open-source real-time and streaming interactive world modelarXiv 2025Star
Learning Real-World Action-Video Dynamics with Heterogeneous Masked AutoregressionarXiv 2025Website
IRASim: A Fine-Grained World Model for Robot ManipulationICCV 2025Website
GWM: Towards Scalable Gaussian World Models for Robotic ManipulationICCV 2025Star
Genie Envisioner: A Unified World Foundation Platform for Robotic ManipulationarXiv 2025Website
Generative World Modelling for Humanoids: 1X World Model Challenge Technical ReportarXiv 2025Star
GaussianDWM: 3D Gaussian Driving World Model for Unified Scene Understanding and Multi-Modal GenerationarXiv 2025Star
GameGen-X: Interactive Open-world Game Video GenerationICLR 2025Star
GameFactory: Creating New Games with Generative Interactive VideosICCV 2025Website
GAIA-2: A Controllable Multi-View Generative World Model for Autonomous DrivingarXiv 2025Website
GAF: Gaussian Action Field as a 4D Representation for Dynamic World Modeling in Robotic ManipulationarXiv 2025Star
Free4D: Tuning-Free 4D Scene Generation with Spatial-Temporal ConsistencyICCV 2025Star
DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene GenerationICCV 2025Website
Diffusion Models Are Real-Time Game EnginesICLR 2025Website
Ctrl-World: A Controllable Generative World Model for Robot ManipulationarXiv 2025Website
Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation ModelsarXiv 2025Website
AETHER: Geometric-Aware Unified World ModelingICCV 2025Star
RoboDreamer: Learning Compositional World Models for Robot ImaginationICML 2024Website
Peekaboo: Interactive Video Generation via Masked-DiffusionCVPR 2024Star
MagicDrive: Street View Generation with Diverse 3D Geometry ControlICLR 2024Star
Learning Interactive Real-World SimulatorsICLR 2024Website
iVideoGPT: Interactive VideoGPTs are Scalable World ModelsNeurIPS 2024Website
GenAD: Generalized Predictive Model for Autonomous DrivingarXiv 2024Star
DrivingWorld: Constructing World Model for Autonomous Driving via Video GPTarXiv 2024Star
Driving Into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous DrivingCVPR 2024Star
DriveDreamer: Towards Real-world-driven World Models for Autonomous DrivingECCV 2024Star
Doe-1: Closed-Loop Autonomous Driving with Large World ModelarXiv 2024Star
AVID: Adapting Video Diffusion Models to World ModelsarXiv 2024
TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion PredictionICRA 2023Star
GAIA-1: A Generative World Model for Autonomous DrivingarXiv 2023Website
Playable Environments: Video Manipulation in Space and TimeCVPR 2022Star
Playable Video GenerationCVPR 2021Star

C4 Language and Multimodal Control (24)

TitlePub. & DateCode/Project URL
Vega: Learning to Drive with Natural Language InstructionsarXiv 2026Star
UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous DrivingarXiv 2026Website
STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic ManipulationarXiv 2026
SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World TasksarXiv 2026Website
OmniRoam: World Wandering via Long-Horizon Panoramic Video GenerationarXiv 2026Star
MAGICITY4D: Controllable and Editable 4D City Scene Generation Using MLLM-Enhanced Procedural Content GenerationICASSP 2026Website
DreamX-World 1.0: A General-Purpose Interactive World ModelarXiv 2026Star
Yume-1.5: A Text-Controlled Interactive World Generation ModelarXiv 2025Star
WorldGen: From Text to Traversable and Interactive 3D WorldsarXiv 2025Website
STORM: Search-Guided Generative World Models for Robotic ManipulationarXiv 2025
PAN: A World Model for General, Interactable, and Long-Horizon World SimulationarXiv 2025
MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric RepresentationsIEEE IV 2025Star
Hunyuan-GameCraft-2: Instruction-following Interactive Game World ModelarXiv 2025Website
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition ControlCVPR 2025Star
DrivingGPT: Unifying Driving World Modeling and Planning with Multi-Modal Autoregressive TransformersICCV 2025Website
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video GenerationAAAI 2025Website
Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal ControlarXiv 2025Star
Pandora: Towards General World Model with Natural Language Actions and Video StatesarXiv 2024Website
OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous DrivingarXiv 2024
Learning to Act from Actionless Videos through Dense CorrespondencesICLR 2024Star
Phenaki: Variable Length Video Generation from Open Domain Textual DescriptionsICLR 2023
Learning Universal Policies via Text-Guided Video GenerationNeurIPS 2023Website
ADriver-I: A General World Model for Autonomous DrivingarXiv 2023
Planning with Diffusion for Flexible Behavior SynthesisICML 2022Star

C4 Latent Actions (12)

TitlePub. & DateCode/Project URL
Olaf-World: Orienting Latent Actions for Video World ModelingarXiv 2026Website
Learning Latent Action World Models In The WildarXiv 2026
Hierarchical Latent Action ModelarXiv 2026
Factored Latent Action World ModelsarXiv 2026Star
DiLA: Disentangled Latent Action World ModelsarXiv 2026Star
Being-H0.7: A Latent World-Action Model from Egocentric VideosarXiv 2026Star
WorldVLA: Towards Autoregressive Action World ModelarXiv 2025Star
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and PlanningarXiv 2025Star
Motus: A Unified Latent Action World ModelarXiv 2025Website
Latent Action World Models for Control with Unlabeled TrajectoriesarXiv 2025
AdaWorld: Learning Adaptable World Models with Latent ActionsICML 2025Star
Genie: Generative Interactive EnvironmentsICML 2024Website

5 Stability

Long-horizon temporal, spatial, identity, and causal consistency under autoregressive rollout. 80 papers in the corpus make this a principal contribution.

C5 Self-Adversarial Training (4)

TitlePub. & DateCode/Project URL
Solaris: Building a Multiplayer Video World Model in MinecraftarXiv 2026Star
Lyra 2.0: Explorable Generative 3D WorldsarXiv 2026Star
DreamX-World 1.0: A General-Purpose Interactive World ModelarXiv 2026Star
WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World ModelingarXiv 2025Website

C5 Implicit and Explicit Memory (12)

TitlePub. & DateCode/Project URL
LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World ModelsarXiv 2026Website
Fast Autoregressive Video Diffusion and World Models with Temporal Cache Compression and Sparse AttentionarXiv 2026
DecMem: Towards Minute-Long Consistent World Generation with Decoupled MemoryarXiv 2026Star
ActWorld: From Explorable to Interactive World Model via Action-Aware MemoryarXiv 2026Website
WorldPack: Compressed Memory Improves Spatial Consistency in Video World ModelingarXiv 2025
VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View MemoryICCV 2025Star
Video World Models with Long-term Spatial MemoryarXiv 2025Website
RELIC: Interactive Video World Model with Long-Horizon MemoryarXiv 2025Website
PAN: A World Model for General, Interactable, and Long-Horizon World SimulationarXiv 2025
Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video GenerationarXiv 2025
Learning 3D Persistent Embodied World ModelsNeurIPS 2025Star
Inferix: A Block-Diffusion based Next-Generation Inference Engine for World SimulationarXiv 2025Star

C5 Causal Consistency (52)

TitlePub. & DateCode/Project URL
WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World ModelsarXiv 2026Website
VJEPA: Variational Joint Embedding Predictive Architectures as Probabilistic World ModelsarXiv 2026Star
Video Generation Models as World Models: Efficient Paradigms, Architectures and AlgorithmsarXiv 2026
VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector GraphsarXiv 2026Star
UWM-JEPA: Predictive World Models That Imagine in Belief SpacearXiv 2026Star
Prisma-World: Camera-Controllable Multi-Agent Video World ModelarXiv 2026Star
Pre-Trained Video Generative Models as World SimulatorsAAAI 2026
Physics Consistent World Models via Schrödinger-Bridge Optimal Transport for Computational Imaging and 3D-Consistent Video GenerationsAAAI 2026
OmniRoam: World Wandering via Long-Horizon Panoramic Video GenerationarXiv 2026Star
OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous DrivingTIP 2026Star
MoVerse: Real-Time Video World Modeling with Panoramic Gaussian ScaffoldarXiv 2026Star
Learning Invariant Visual Representations for Planning with Joint-Embedding Predictive World ModelsarXiv 2026Star
GEM-4D: Geometry-Enhanced Video World Models for Robot ManipulationarXiv 2026Website
Future Dynamic 3D Reconstruction: A 3D World Model with Disentangled Ego-MotionarXiv 2026Website
DisCo: World Models with Discrete Camera Motion ControlarXiv 2026
DiLA: Disentangled Latent Action World ModelsarXiv 2026Star
CP4D: Compositional Physics-aware 4D Scene GenerationarXiv 2026Website
Advancing Open-source World ModelsarXiv 2026Star
Yume: An Interactive World Generation ModelarXiv 2025Star
Yume-1.5: A Text-Controlled Interactive World Generation ModelarXiv 2025Star
Yan: Foundational Interactive Video GenerationarXiv 2025Website
WoW: Towards a World omniscient World model Through Embodied InteractionarXiv 2025Star
WorldVLA: Towards Autoregressive Action World ModelarXiv 2025Star
World Model Enhanced Embodied Intelligence for Deformable Object Manipulation of Dynamic TargetsCINTI 2025
WonderWorld: Interactive 3D Scene Generation from a Single ImageCVPR 2025Star
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and PlanningarXiv 2025Star
The Matrix: Infinite-Horizon World Generation with Real-Time Moving ControlNeurIPS 2025Website
ProphetDWM: A Driving World Model for Rolling Out Future Actions and VideosarXiv 2025Star
PlayerOne: Egocentric World SimulatorNeurIPS 2025Star
Matrix-game 2.0: An open-source real-time and streaming interactive world modelarXiv 2025Star
Mastering diverse control tasks through world modelsNature 2025Star
GAIA-2: A Controllable Multi-View Generative World Model for Autonomous DrivingarXiv 2025Website
DrivingGPT: Unifying Driving World Modeling and Planning with Multi-Modal Autoregressive TransformersICCV 2025Website
Diffusion Models Are Real-Time Game EnginesICLR 2025Website
Ctrl-World: A Controllable Generative World Model for Robot ManipulationarXiv 2025Website
A Comprehensive Survey on World Models for Embodied AIarXiv 2025Star
RoboDreamer: Learning Compositional World Models for Robot ImaginationICML 2024Website
Playable Game GenerationarXiv 2024Star
MagicDrive: Street View Generation with Diverse 3D Geometry ControlICLR 2024Star
Is Sora a World Simulator? A Comprehensive Survey on General World Models and BeyondarXiv 2024Star
Generative World ExplorerarXiv 2024Star
Driving Into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous DrivingCVPR 2024Star
Diffusion for World Modeling: Visual Details Matter in AtariNeurIPS 2024Website
Transformers are Sample-Efficient World ModelsICLR 2023Star
Phenaki: Variable Length Video Generation from Open Domain Textual DescriptionsICLR 2023
GAIA-1: A Generative World Model for Autonomous DrivingarXiv 2023Website
ADriver-I: A General World Model for Autonomous DrivingarXiv 2023
Playable Environments: Video Manipulation in Space and TimeCVPR 2022Star
Planning with Diffusion for Flexible Behavior SynthesisICML 2022Star
Mastering Atari with Discrete World ModelsICLR 2021
Model Based Reinforcement Learning for AtariICLR 2020
World ModelsarXiv 2018Website

C5 Quantification of Drift and Theoretical Guarantees (12)

TitlePub. & DateCode/Project URL
What-If World: A Causal Benchmark for General World Models in Embodied ScenariosarXiv 2026
ReactSim-Bench: Benchmarking Reactive Behavior World Model Simulation in Autonomous DrivingarXiv 2026Star
Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon MemoryarXiv 2026Star
iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation FrameworkarXiv 2026Website
Grounding World Simulation Models in a Real-World MetropolisarXiv 2026
Fine-flow Distilling Coarse-flow Video Generation for Long-Term Driving World ModelAAAI 2026Star
Navigation World ModelsCVPR 2025
MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous DrivingarXiv 2025Star
DrivingWorld: Constructing World Model for Autonomous Driving via Video GPTarXiv 2024Star
Mastering Atari, Go, chess and shogi by planning with a learned modelNature 2020
Dream to Control: Learning Behaviors by Latent ImaginationICLR 2020
Learning Latent Dynamics for Planning from PixelsICML 2019

6 State Feedback

Readable simulator feedback beyond RGB, including sensors, task signals, structured state, and labels. 45 papers in the corpus make this a principal contribution.

C6 Multi-Task Auxiliary Output (32)

TitlePub. & DateCode/Project URL
τ0-WM: A Unified Video-Action World Model for Robotic ManipulationarXiv 2026Star
Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous DrivingarXiv 2026Website
VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector GraphsarXiv 2026Star
STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic ManipulationarXiv 2026
OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous DrivingTIP 2026Star
FlowDreamer: A RGB-D World Model With Flow-Based Motion Representations for Robot ManipulationICRA 2026Website
Unified Video Action ModelRSS 2025Website
TesserAct: Learning 4D Embodied World ModelsICCV 2025Website
STORM: Search-Guided Generative World Models for Robotic ManipulationarXiv 2025
RoDyn: Taming Interactive Robot-Dynamic 2.5D World Model for Robotic ManipulationarXiv 2025Website
ProphetDWM: A Driving World Model for Rolling Out Future Actions and VideosarXiv 2025Star
MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric RepresentationsIEEE IV 2025Star
Learning 3D Persistent Embodied World ModelsNeurIPS 2025Star
Generative World Modelling for Humanoids: 1X World Model Challenge Technical ReportarXiv 2025Star
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition ControlCVPR 2025Star
GaussianDWM: 3D Gaussian Driving World Model for Unified Scene Understanding and Multi-Modal GenerationarXiv 2025Star
GAF: Gaussian Action Field as a 4D Representation for Dynamic World Modeling in Robotic ManipulationarXiv 2025Star
ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric InteractionarXiv 2025Website
Embodied World Models Emerge from Navigational Task in Open-Ended EnvironmentsarXiv 2025
DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene GenerationICCV 2025Website
OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous DrivingarXiv 2024
MoDem-V2: Visuo-Motor World Models for Real-World Robot ManipulationICRA 2024Star
Learning to Act from Actionless Videos through Dense CorrespondencesICLR 2024Star
iVideoGPT: Interactive VideoGPTs are Scalable World ModelsNeurIPS 2024Website
Generative World ExplorerarXiv 2024Star
Doe-1: Closed-Loop Autonomous Driving with Large World ModelarXiv 2024Star
Diffusion for World Modeling: Visual Details Matter in AtariNeurIPS 2024Website
Transformers are Sample-Efficient World ModelsICLR 2023Star
Learning Universal Policies via Text-Guided Video GenerationNeurIPS 2023Website
Mastering Atari with Discrete World ModelsICLR 2021
Model Based Reinforcement Learning for AtariICLR 2020
Mastering Atari, Go, chess and shogi by planning with a learned modelNature 2020

C6 Deriving Structured State from Physical Simulation (6)

TitlePub. & DateCode/Project URL
PointWorld: Scaling 3D World Models for In-The-Wild Robotic ManipulationarXiv 2026Website
OrbiSim: World Models as Differentiable Physics Engines for Embodied IntelligencearXiv 2026Website
MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic ManipulationarXiv 2026Website
Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied SimulationarXiv 2026Star
RoboScape: Physics-informed Embodied World ModelarXiv 2025Star
ChronoDreamer: Action-Conditioned World Model as an Online Simulator for Robotic PlanningarXiv 2025Star

C6 Latent Representation as Alternative Feedback (4)

TitlePub. & DateCode/Project URL
Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and PlanningarXiv 2026Website
Being-H0.7: A Latent World-Action Model from Egocentric VideosarXiv 2026Star
Dream to Control: Learning Behaviors by Latent ImaginationICLR 2020
Learning Latent Dynamics for Planning from PixelsICML 2019

C6 State-Interface Evaluation and Gaps (3)

TitlePub. & DateCode/Project URL
WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and PlatformarXiv 2026Website
SimWorld: A Unified Benchmark for Simulator-Conditioned Scene Generation via World ModelIROS 2025Star
Prompting with the Future: Open-World Model Predictive Control with Interactive Digital TwinsRSS 2025Website

7 Diversity

Coverage of environments, objects, agents, futures, and controllable variations beyond the training distribution. 46 papers in the corpus make this a principal contribution.

C7 Scale-Driven Diversity (28)

TitlePub. & DateCode/Project URL
What Makes Video World Model Latents Action-Relevant: Prediction over ReconstructionarXiv 2026
Olaf-World: Orienting Latent Actions for Video World ModelingarXiv 2026Website
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle SimulationarXiv 2026Star
Nano World Models: A Minimalist Implementation of Future Video PredictionarXiv 2026Star
Learning Latent Action World Models In The WildarXiv 2026
Future Dynamic 3D Reconstruction: A 3D World Model with Disentangled Ego-MotionarXiv 2026Website
DreamDojo: A Generalist Robot World Model from Large-Scale Human VideosarXiv 2026Star
DiLA: Disentangled Latent Action World ModelsarXiv 2026Star
Being-H0.7: A Latent World-Action Model from Egocentric VideosarXiv 2026Star
Advancing Open-source World ModelsarXiv 2026Star
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and PlanningarXiv 2025Star
UniScene: Unified Occupancy-centric Driving Scene GenerationCVPR 2025Star
PIN-WM: Learning Physics-INformed World Models for Non-Prehensile ManipulationRSS 2025Star
Navigation World ModelsCVPR 2025
Motus: A Unified Latent Action World ModelarXiv 2025Website
HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene GenerationACM MM 2025Star
GameGen-X: Interactive Open-world Game Video GenerationICLR 2025Star
GameFactory: Creating New Games with Generative Interactive VideosICCV 2025Website
Cosmos World Foundation Model Platform for Physical AIarXiv 2025Star
Pandora: Towards General World Model with Natural Language Actions and Video StatesarXiv 2024Website
Learning to Act from Actionless Videos through Dense CorrespondencesICLR 2024Star
Learning Interactive Real-World SimulatorsICLR 2024Website
GenAD: Generalized Predictive Model for Autonomous DrivingarXiv 2024Star
DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World ModelarXiv 2024Website
A Unified Approach for Text-and Image-Guided 4D Scene GenerationCVPR 2024
Learning Universal Policies via Text-Guided Video GenerationNeurIPS 2023Website
GAIA-1: A Generative World Model for Autonomous DrivingarXiv 2023Website
VideoGPT: Video Generation using VQ-VAE and TransformersarXiv 2021Website

C7 Composition-Driven Diversity (7)

TitlePub. & DateCode/Project URL
Comp4D: Compositional 4D Scene GenerationWACV 2026Star
World model-based end-to-end scene generation for accident anticipation in autonomous drivingCommunications Engineering 2025
GAIA-2: A Controllable Multi-View Generative World Model for Autonomous DrivingarXiv 2025Website
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video GenerationAAAI 2025Website
Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation ModelsarXiv 2025Website
RoboDreamer: Learning Compositional World Models for Robot ImaginationICML 2024Website
Driving Into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous DrivingCVPR 2024Star

C7 Controllable Parametric Diversity (6)

TitlePub. & DateCode/Project URL
World model-based long-tail and scenario-specific generation for autonomous drivingJICV 2026
NeoVerse: Enhancing 4D World Model with in-the-wild Monocular VideosarXiv 2026Website
Mastering diverse control tasks through world modelsNature 2025Star
Latent Action World Models for Control with Unlabeled TrajectoriesarXiv 2025
GigaWorld-0: World Models as Data Engine to Empower Embodied AIarXiv 2025Star
Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal ControlarXiv 2025Star

C7 Theoretical Insight and Missing Evaluation of Diversity (5)

TitlePub. & DateCode/Project URL
WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and PlatformarXiv 2026Website
SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World TasksarXiv 2026Website
Simulating the Real World: A Unified Survey of Multimodal Generative ModelsTPAMI 2026
DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous DrivingarXiv 2026Website
AETHER: Geometric-Aware Unified World ModelingICCV 2025Star

8 Evaluation Metrics

Metrics and benchmarks for generation quality, downstream embodied utility, and physical plausibility. 51 papers in the corpus make this a principal contribution.

C8 Unified Generation-Quality Evaluation (22)

TitlePub. & DateCode/Project URL
Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future TrendsarXiv 2026Star
Simulating the Real World: A Unified Survey of Multimodal Generative ModelsTPAMI 2026
Nano World Models: A Minimalist Implementation of Future Video PredictionarXiv 2026Star
LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World ModelsarXiv 2026Website
DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous DrivingarXiv 2026Website
WorldScore: A Unified Evaluation Benchmark for World GenerationICCV 2025Website
WorldPack: Compressed Memory Improves Spatial Consistency in Video World ModelingarXiv 2025
UniScene: Unified Occupancy-centric Driving Scene GenerationCVPR 2025Star
Understanding World or Predicting Future? A Comprehensive Survey of World ModelsACM Computing Surveys 2025Star
The Role of World Models in Shaping Autonomous Driving: A Comprehensive SurveyarXiv 2025Star
SimWorld: A Unified Benchmark for Simulator-Conditioned Scene Generation via World ModelIROS 2025Star
Simulating the Visual World with Artificial Intelligence: A RoadmaparXiv 2025Website
ReconDreamer-RL: Enhancing Reinforcement Learning via Diffusion-based Scene ReconstructionarXiv 2025Website
MineWorld: a Real-Time and Open-Source Interactive World Model on MinecraftarXiv 2025Website
Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video GenerationarXiv 2025
Learning Real-World Action-Video Dynamics with Heterogeneous Masked AutoregressionarXiv 2025Website
Inferix: A Block-Diffusion based Next-Generation Inference Engine for World SimulationarXiv 2025Star
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition ControlCVPR 2025Star
DrivingGPT: Unifying Driving World Modeling and Planning with Multi-Modal Autoregressive TransformersICCV 2025Website
A Survey of World Models for Autonomous DrivingarXiv 2025
Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A SurveyarXiv 2024
DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World ModelarXiv 2024Website

C8 Closed-Loop Embodied Evaluation (24)

TitlePub. & DateCode/Project URL
τ0-WM: A Unified Video-Action World Model for Robotic ManipulationarXiv 2026Star
WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and PlatformarXiv 2026Website
World Models for Robotic Manipulation: A SurveyarXiv 2026
World Model for Robot Learning: A Comprehensive SurveyarXiv 2026Star
WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model EvaluationarXiv 2026Star
SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World TasksarXiv 2026Website
RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic ManipulationarXiv 2026Website
OpenGame: Open Agentic Coding for GamesarXiv 2026Star
Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World ModelsarXiv 2026Star
iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation FrameworkarXiv 2026Website
GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game AgentsarXiv 2026Website
WoW: Towards a World omniscient World model Through Embodied InteractionarXiv 2025Star
World-in-World: World Models in a Closed-Loop WorldarXiv 2025Star
Whole-Body Conditioned Egocentric Video PredictionNeurIPS 2025
STORM: Search-Guided Generative World Models for Robotic ManipulationarXiv 2025
RoboChallenge: Large-scale Real-robot Evaluation of Embodied PoliciesarXiv 2025Star
Matrix-Game: Interactive World Foundation ModelarXiv 2025Star
Hunyuan-GameCraft-2: Instruction-following Interactive Game World ModelarXiv 2025Website
Genie Envisioner: A Unified World Foundation Platform for Robotic ManipulationarXiv 2025Website
Generative World Modelling for Humanoids: 1X World Model Challenge Technical ReportarXiv 2025Star
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video GenerationAAAI 2025Website
Ctrl-World: A Controllable Generative World Model for Robot ManipulationarXiv 2025Website
A Comprehensive Survey on World Models for Embodied AIarXiv 2025Star
Playable Game GenerationarXiv 2024Star

C8 Physical-Plausibility Evaluation (5)

TitlePub. & DateCode/Project URL
WorldBench: Disambiguating Physics for Diagnostic Evaluation of World ModelsarXiv 2026
What-If World: A Causal Benchmark for General World Models in Embodied ScenariosarXiv 2026
ReactSim-Bench: Benchmarking Reactive Behavior World Model Simulation in Autonomous DrivingarXiv 2026Star
ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric InteractionarXiv 2025Website
A Survey: Learning Embodied Intelligence from Physical Simulators and World ModelsarXiv 2025Star

Four Structural Gaps

Current evaluation still has four system-level gaps: fragmented benchmarks, an open-loop bias, missing steppable-environment attributes, and no absolute comparison against traditional simulators. This diagnosis is retained as an analytical conclusion rather than treated as a paper category.

9 Surveys

The 16 surveys in the corpus are indexed once below by their primary scope.

General World Models (3)

TitlePub. & DateCode/Project URL
Is Sora a World Simulator? A Comprehensive Survey on General World Models and BeyondarXiv 2024Star
Simulating the Visual World with Artificial Intelligence: A RoadmaparXiv 2025Website
Understanding World or Predicting Future? A Comprehensive Survey of World ModelsACM Computing Surveys 2025Star

Autonomous Driving (4)

TitlePub. & DateCode/Project URL
Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A SurveyarXiv 2024
A Survey of World Models for Autonomous DrivingarXiv 2025
The Role of World Models in Shaping Autonomous Driving: A Comprehensive SurveyarXiv 2025Star
World model-based long-tail and scenario-specific generation for autonomous drivingJICV 2026

Robotics and Embodied Intelligence (5)

TitlePub. & DateCode/Project URL
A Comprehensive Survey on World Models for Embodied AIarXiv 2025Star
A Survey: Learning Embodied Intelligence from Physical Simulators and World ModelsarXiv 2025Star
Self-evolving World ModelAutonomous Embodied AI 2026
World Model for Robot Learning: A Comprehensive SurveyarXiv 2026Star
World Models for Robotic Manipulation: A SurveyarXiv 2026

Interactive Video World Models (1)

TitlePub. & DateCode/Project URL
Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future TrendsarXiv 2026Star

Efficiency and Multidimensional Generation (3)

TitlePub. & DateCode/Project URL
From 2D to 3D Cognition: A Brief Survey of General World ModelsarXiv 2025
Simulating the Real World: A Unified Survey of Multimodal Generative ModelsTPAMI 2026
Video Generation Models as World Models: Efficient Paradigms, Architectures and AlgorithmsarXiv 2026

Acknowledgement

This repository follows the structure and presentation style of World-Model. We thank the authors of all included papers and open-source projects for advancing the field.