4D Spatial Intelligence

February 15, 2026 · View on GitHub

< Back to Main README

4D Spatial Intelligence

500+ papers · 6 sub-domains

The temporal dimension of 3D understanding — depth, tracking, reconstruction, dynamics, human motion, and physics


Sub-domains

Sub-domainFocusPapers
Geometry & DepthDepth estimation, camera pose, geometric understanding100+
3D/4D TrackingDense 3D/4D point tracking, optical flow, correspondence80+
ReconstructionMulti-view and monocular scene reconstruction80+
Dynamic Scenes4D dynamic scenes via deformable NeRFs and 4DGS80+
Human-CentricHuman pose, shape, motion capture, avatars80+
Physics-BasedPhysics simulation, dynamics prediction, material estimation80+

Key Research Areas

Geometry & Depth Estimation

Monocular and multi-view depth estimation, camera pose prediction, and geometric understanding. From classical stereo to learning-based approaches using foundation models.

Key works: DPT, MiDaS, ZoeDepth, Depth Anything, Metric3D, UniDepth, DepthCrafter

3D/4D Point Tracking

Dense correspondence estimation across video frames in 3D space. Long-range tracking, scene flow, and 4D spatiotemporal correspondence.

Key works: TAP-Vid, TAPIR, CoTracker, SpatialTracker, SceneTracker, DOT

Scene Reconstruction

Multi-view and video-based 3D/4D scene reconstruction. Neural and Gaussian approaches to dense geometry recovery.

Key works: DUSt3R, MASt3R, MonST3R, Spann3R, Fast3R, SfM-free approaches

Dynamic Scenes (4D)

Modeling and rendering of dynamic 4D scenes using deformable neural radiance fields, 4D Gaussian Splatting, and temporal extensions.

Key works: D-NeRF, 4D Gaussian Splatting, Deformable 3DGS, 4DGS, SC-4DGS, Shape of Motion

Human-Centric Motion

Human body/hand/face reconstruction, motion capture, avatar generation, and temporal modeling of human performance.

Key works: SMPL-X, WHAM, 4D-Humans, TokenHMR, GVHMR, HumanGaussian, GaussianAvatar

Physics-Based Simulation

Physics-aware neural simulation, dynamics prediction, material estimation, and physics-informed learning for 4D understanding.

Key works: PhysDreamer, PhysGen, Physics3D, PIE-NeRF, Spring-Gaus, PAC-NeRF


< Back to Main README · View on Website