README.md

May 20, 2026 ยท View on GitHub

[๐ŸŽ‰CVPR 2026] MeanFuser

Fast One-Step Multi-Modal Trajectory Generation and Adaptive Reconstruction via MeanFlow for End-to-End Autonomous Driving

Paper License

Junli Wang, Xueyi Liu, Yinan Zheng, Zebing Xing, Pengfei Li, Guang Li,

Kun Ma, Guang Chen, Hangjun Ye, Zhongpu Xia, Long Chen, Qichao Zhang๐Ÿ“ง


๐Ÿ“ง indicates corresponding authors.
SKL-MAIS, CASIA ย  | ย  Xiaomi EV ย  | ย  AIR, Tsinghua University


๐Ÿ“ข News

  • [2026/05/20] We released BeyondDrive, a contrastive learning framework for end-to-end AD.
  • [2026/04/12] We released NAVSIMv2 code.
  • [2026/03/20] We released code and checkpoints.
  • [2026/02/25] We released our paper on arXiv.
  • [2026/02/21] ๐ŸŽ‰ Accepted to CVPR 2026.

๐Ÿ“Œ Table of Contents

๐Ÿ“‹ TODO List

  • HUGSIM code release (Apr. 2026).
  • NAVSIMv2 navtest code release (Apr. 2026).
  • Checkpoints release (Mar. 2026).
  • Code release (Mar. 2026).
  • Paper release (Feb. 2026).

๐Ÿ›๏ธ Model Zoo

MethodBackboneBenchmarkPDMSWeight Download
MeanFuserResNet-34NAVSIM89.0Google Drive
MeanFuser + BeyondDriveResNet-34NAVSIM90.3Google Drive
MeanFuserResNet-34HUGSIM-Google Drive

๐ŸŽฏ Getting Started

1. Clone MeanFuser Repo

git clone https://github.com/wjl2244/MeanFuser.git
cd MeanFuser

2. Create Environment

conda create -n meanfuser python=3.9 -y
conda activate meanfuser
pip install -e .

๐Ÿ“ฆ Data Preparation

NOTE: Please review and agree to the LICENSE file file before downloading the data.

1. Download Dataset

a. Download via NAVSIM offical installation.

Follow the instructions in the NAVSIM installation guide to download the dataset.

b. Download via Hugging Face

Alternatively, you can download the dataset using Hugging Face with the following commands:

export HF_ENDPOINT="https://huggingface.co"
# export HF_ENDPOINT="http://hf-mirror.com"  # Uncomment this line if you are in China

# Install the huggingface_hub tool
pip install -U "huggingface_hub"

# Download the OpenScene dataset
hf download --repo-type dataset OpenDriveLab/OpenScene --local-dir ./navsim_dataset/ --include "openscene-v1.1/*"

# Download the map data
cd download && ./download_maps.sh

2. Set Up Configuration

Move the download data to create the following structure.

navsim_workspace/
โ”œโ”€โ”€ MeanFuser/
โ”œโ”€โ”€ dataset/
โ”‚    โ”œโ”€โ”€ maps/
โ”‚    โ”œโ”€โ”€ navsim_logs/
โ”‚    โ”‚   โ”œโ”€โ”€ test/
โ”‚    โ”‚   โ”œโ”€โ”€ trainval/
โ”‚    โ”œโ”€โ”€ sensor_blobs/
โ”‚    โ”‚   โ”œโ”€โ”€ test/
โ”‚    โ”‚   โ”œโ”€โ”€ trainval/
โ””โ”€โ”€ cache/
     โ”œโ”€โ”€ navtest_v1_metric_cache/
     โ””โ”€โ”€ traintest_v1_cache/

3. Cache the Dataset

We provide a script to cache the dataset and metrics.

cd MeanFuser

# Cache the dataset. (navtrain and navtest)
bash scripts/evaluation/run_dataset_cache.sh

# Cache the metric.
bash scripts/evaluation/run_metric_cache.sh

โš™๏ธ Training and Evaluation

1. Evaluation

Please download the pre-trained checkpoints from here and place them in the navsim_workspace/MeanFuser/exp/ directory.

cd MeanFuser

# NAVSIMv1
bash scripts/evaluation/run_meanfuser_evaluation.sh

# NAVSIMv2, please switch to the NAVSIMv2 branch
bash scripts/evaluation/run_metric_cache.sh
bash scripts/evaluation/run_meanfuser_evaluation_one_stage.sh

2. Training

Please download the ResNet-34 pretrained weights from here. After downloading, update the corresponding path in the configuration file:navsim_workspace/MeanFuser/navsim/agents/meanfuser/meanfuser_config.py

cd MeanFuser

bash scripts/training/run_meanfuser_training.sh

3. Visualization

We provide a script to visualize the model's planned trajectory.

export NAVSIM_WORKSPACE="xxx/navsim_workspace"
python MeanFuser/tools/visualization_navtest_scenes.py

โค๏ธ Acknowledgements

We acknowledge all the open-source contributors for the following projects to make this work possible: