README.md

September 26, 2025 · View on GitHub

ReflectDrive

Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving

Pengxiang Li*, Yinan Zheng*, Yue Wang*, Huimin Wang*†, Hang Zhao, Jingjing Liu, Xianyuan Zhan, Kun Zhan, Xianpeng Lang

¹LiAuto, ²Tsinghua University

[Arxiv]

Preprint, 2025

The official implementation of ReflectDrive, a novel framework that integrates a reflection mechanism for safe trajectory generation via discrete diffusion. Our method bridges the gap between imitation learning and safety-critical deployment by enabling gradient-free, iterative self-correction.

To Do List

The code is being cleaned and will be released gradually.

  • Release code for the NAVSIM benchmark.
  • Release tutorial on the Reflective Inference mechanism (Safety-Guided Regeneration).
  • Release training code.
  • Initial repo & paper.

Table of Contents

Methods

ReflectDrive introduces a novel, learning-based approach for safe and reliable autonomous driving planning. Key components include:

  • Trajectory Discretization: We first discretize the 2D driving space to construct an action codebook, representing continuous trajectories as sequences of discrete tokens.
  • Discrete Diffusion Planner: We leverage a pre-trained Vision-Language-Action (VLA) model, fine-tuned as a discrete diffusion model, to generate trajectories via a non-autoregressive denoising process.
  • Reflective Inference: A two-stage, gradient-free inference process ensures safety.
    1. Goal-Conditioned Generation: The model first generates a diverse set of multi-modal trajectory proposals based on high-level goals.
    2. Safety-Guided Regeneration: An external safety oracle identifies unsafe points in the trajectory. We then perform an efficient local search in the discrete token space to find a "safe anchor" and use the diffusion model's powerful inpainting capability to regenerate a coherent and safe trajectory around it.

Performance on NAVSIM

ReflectDrive demonstrates significant advantages in safety-critical trajectory generation, approaching human-level performance on the real-world NAVSIM benchmark. Our reflective inference mechanism substantially improves safety metrics like Drivable Area Compliance (DAC) and Time-to-Collision (TTC) without compromising driving progress (EP).

MethodParadigmInputNC↑DAC↑TTC↑Comf.↑EP↑PDMS↑
Base Planners
UniAD-Cam97.891.992.9100.078.883.4
PARA-Drive-Cam97.992.493.099.879.384.0
Hydra-MDP-C&L98.396.094.6100.078.786.5
DiffusionDriveDiffusionC&L98.296.294.7100.082.288.1
GoalFlowDiffusionC&L98.498.394.6100.085.090.3
AutoVLAAutoregressiveCam98.495.698.099.981.989.1
Our Method
ReflectDrive (w/o R.I.)Discrete DiffusionCam96.995.492.2100.079.084.8
ReflectDrive (Ours)Discrete DiffusionCam97.799.393.5100.086.991.1
ReflectDrive†Discrete DiffusionCam99.799.599.199.988.994.7
Human--100.0100.0100.099.987.594.8

R.I. denotes Reflective Inference. † denotes using a privileged ground-truth oracle for reflection.

Qualitative Results

demo1 demo2
Safety-Guided Regeneration (S.G.R.) Visualization. The top row shows scenarios where initial plans risk violating drivable area boundaries. The bottom row shows scenarios with potential collision risks. ReflectDrive iteratively optimizes the initial light-colored trajectory towards a safer, feasible final plan (darker color).

Getting Started

Coming Soon...

Bibtex

If you find our work useful for your research, please consider citing our paper:

@article{li2025discrete,
  title={{DISCRETE DIFFUSION FOR REFLECTIVE VISION-LANGUAGE-ACTION MODELS IN AUTONOMOUS DRIVING}},
  author={Li, Pengxiang and Zheng, Yinan and Wang, Yue and Wang, Huimin and Zhao, Hang and Liu, Jingjing and Zhan, Xianyuan and Zhan, Kun and Lang, Xianpeng},
  journal={arXiv preprint arXiv:2509.20109},
  year={2025}
}

Acknowledgement

Our work is inspired by and builds upon several incredible open-source projects. We would like to thank the teams behind: NAVSIM, LLaDA-V, and the broader research community working on diffusion models and autonomous driving.