README.md
May 20, 2026 ยท View on GitHub
[๐CVPR 2026] MeanFuser
Fast One-Step Multi-Modal Trajectory Generation and Adaptive Reconstruction via MeanFlow for End-to-End Autonomous Driving
Junli Wang, Xueyi Liu, Yinan Zheng, Zebing Xing, Pengfei Li, Guang Li,
Kun Ma, Guang Chen, Hangjun Ye, Zhongpu Xia, Long Chen, Qichao Zhang๐ง
๐ง indicates corresponding authors.
SKL-MAIS, CASIA ย | ย Xiaomi EV ย | ย AIR, Tsinghua University
๐ข News
[2026/05/20]We released BeyondDrive, a contrastive learning framework for end-to-end AD.[2026/04/12]We released NAVSIMv2 code.[2026/03/20]We released code and checkpoints.[2026/02/25]We released our paper on arXiv.[2026/02/21]๐ Accepted to CVPR 2026.
๐ Table of Contents
- ๐ TODO List
- ๐๏ธ Model Zoo
- ๐ฏ Getting Started
- ๐ฆ Data Preparation
- โ๏ธ Training and Evaluation
- โค๏ธ Acknowledgements
๐ TODO List
- HUGSIM code release (Apr. 2026).
- NAVSIMv2 navtest code release (Apr. 2026).
- Checkpoints release (Mar. 2026).
- Code release (Mar. 2026).
- Paper release (Feb. 2026).
๐๏ธ Model Zoo
| Method | Backbone | Benchmark | PDMS | Weight Download |
|---|---|---|---|---|
| MeanFuser | ResNet-34 | NAVSIM | 89.0 | Google Drive |
| MeanFuser + BeyondDrive | ResNet-34 | NAVSIM | 90.3 | Google Drive |
| MeanFuser | ResNet-34 | HUGSIM | - | Google Drive |
๐ฏ Getting Started
1. Clone MeanFuser Repo
git clone https://github.com/wjl2244/MeanFuser.git
cd MeanFuser
2. Create Environment
conda create -n meanfuser python=3.9 -y
conda activate meanfuser
pip install -e .
๐ฆ Data Preparation
NOTE: Please review and agree to the LICENSE file file before downloading the data.
1. Download Dataset
a. Download via NAVSIM offical installation.
Follow the instructions in the NAVSIM installation guide to download the dataset.
b. Download via Hugging Face
Alternatively, you can download the dataset using Hugging Face with the following commands:
export HF_ENDPOINT="https://huggingface.co"
# export HF_ENDPOINT="http://hf-mirror.com" # Uncomment this line if you are in China
# Install the huggingface_hub tool
pip install -U "huggingface_hub"
# Download the OpenScene dataset
hf download --repo-type dataset OpenDriveLab/OpenScene --local-dir ./navsim_dataset/ --include "openscene-v1.1/*"
# Download the map data
cd download && ./download_maps.sh
2. Set Up Configuration
Move the download data to create the following structure.
navsim_workspace/
โโโ MeanFuser/
โโโ dataset/
โ โโโ maps/
โ โโโ navsim_logs/
โ โ โโโ test/
โ โ โโโ trainval/
โ โโโ sensor_blobs/
โ โ โโโ test/
โ โ โโโ trainval/
โโโ cache/
โโโ navtest_v1_metric_cache/
โโโ traintest_v1_cache/
3. Cache the Dataset
We provide a script to cache the dataset and metrics.
cd MeanFuser
# Cache the dataset. (navtrain and navtest)
bash scripts/evaluation/run_dataset_cache.sh
# Cache the metric.
bash scripts/evaluation/run_metric_cache.sh
โ๏ธ Training and Evaluation
1. Evaluation
Please download the pre-trained checkpoints from here and place them in the navsim_workspace/MeanFuser/exp/ directory.
cd MeanFuser
# NAVSIMv1
bash scripts/evaluation/run_meanfuser_evaluation.sh
# NAVSIMv2, please switch to the NAVSIMv2 branch
bash scripts/evaluation/run_metric_cache.sh
bash scripts/evaluation/run_meanfuser_evaluation_one_stage.sh
2. Training
Please download the ResNet-34 pretrained weights from here. After downloading, update the corresponding path in the configuration file:navsim_workspace/MeanFuser/navsim/agents/meanfuser/meanfuser_config.py
cd MeanFuser
bash scripts/training/run_meanfuser_training.sh
3. Visualization
We provide a script to visualize the model's planned trajectory.
export NAVSIM_WORKSPACE="xxx/navsim_workspace"
python MeanFuser/tools/visualization_navtest_scenes.py
โค๏ธ Acknowledgements
We acknowledge all the open-source contributors for the following projects to make this work possible: