README.md

April 5, 2025 · View on GitHub


A curated list of radar datasets, detection, tracking and fusion.
Keep updating.
Author: Yi Zhou
Contact: zhouyi1023@tju.edu.cn

🚩I have published a review paper on radar perception. Please see the link below. It is open access. If you find the contents are useful, please cite this paper in your work. I will keep updating this repository for the latest works in the radar perception field.

Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges

The 41-page slides associated with this paper: Link ; Link for China Mainland

Contents

Overview

Data Perspective:

Signal Processing:

Applications:

Challenges:

Radar Datasets

In my review paper, there is a table with more detials.

Conventional Radar Datasets for Autonomous Driving

DatasetRadar TypeData TypeAnnotationLink
nuScenesContinental ARS408 x5Sparse PC3D bbox, TrackIDWebsite
DENSE77Ghz Long-Range RadarSparse PC3D bboxWebsite
PixSetTI AWR1843Sparse PC3D bbox, TrackIDWebsite
Radar Scenes77GHz Middle-Range Radar x4Dense PC2D point-wise, TrackIDWebsite
Pointillism2 TI AWR 1443PC3D bboxGithub
Zendar SARSARADC, RD, PCPointwise Mask of Moving VehicleGithub
Cooperative Radars77GHz Radar x 3PCTrajctory from GNSS-RTKWebsite
aiMotive77GHz LRR Radar x2(Front and Back)PC3D bbox, TrackIDWebsite


Comments: nuScenes, DENSE and Pixset are for sensor fusion, but not particularly address the role of radar. Radar scenes provides point-wise annotations for radar point cloud, but has no other modalities. Pointillism uses 2 radars with overlapped view. Zendar seems no longer available for downloading. AiMotive focuses on long-range 360 degree multi-sensor fusion.

Pre-CFAR Datasets for Detection

DatasetRadar TypeData TypeAnnotationLink
CRUWTI AWR1843 Ultra Short RangeRAPointlevel ObjectWebsite
CARRADATI AWR1843 Short RangeRA,RD,RADPointwise, 2D bbox, MaskWebsite
RADDetTI AWR1843RAD3D bbox for RAD tensorGithub
RaDICaLTI IWR1443ADC2D bboxWebsite
GhentVRUTI AWR1243 Short RangeRADSegmentation Mask for VRUsPaper
RAMP-CNNTI AWR 1843ADC2D bboxWebsite


Comments: CARRADA is captured in clean scenarios, CRUW uses RA maps, RADDet provides annotations for RAD tensor, RADICaL provides raw ADC data and signal processing toolboxes, GhentVRU can be accssed by contacting with authors, ODA is for drones and provides event camera data.

4D Radar Datasets

DatasetRadar TypeData TypeAnnotationLink
Astyx Hires2019Astyx 6455 HiRes Middel RangePC3D bboxDateset
View-of-DelftZF FRGen21 Short RangePC3D bboxWebsite
RADIalValeo Middel Range DDMADC,RAD,PCPoint-level Vehicle; Open Space MaskGithub
TJ4DRadSetOculii Eagle Long RangePC3D bbox, TrackIDGithub
K-RadarMacnica RETINARAD3D bbox, Track IDGithub; OpenReview
ZF 4DRadar DatasetZF FRGen21 4D3DTBD Github
ThermRadOculii EaglePC3DTBD
MSC-RAD4ROculii EaglePCSLAMWebsite


Comments: Astyx is small, VoD focuses on VRU classification, RADIal's annotation is coarse but provides raw data, TJ4D features for its long range detection, K-Radar provides RAD tensor and 3D annotations. ZF 4DRadar Dataset is not yet public available.

Specific Tasks

DatasetRadar TypeTaskLink
HawkEyeSARStatic vehicle classificationWebsite
PREVENTIONConti ARS308 + SRR208 x2Trajectory PredictionWebsite
SCORP76GHzOpen space segmentationWebsite
Ghost77GHz long range *2Ghost object detectionGithub
Solinteraction DataSoliTangible interactionsGithub
GROUNDEDGround Penetrating RadarLocalizationWebsite
FloW DatasetTI AWR1843Floating waste detectionWebsite
OLIMPUWB + Continental ARS404Multi-sensor fusion for detectionWebsite
DeepSense 6GRadar+Lidar+Camera+GPSBeam predictionWebsite
CTARadar+CameraInterference analysisWebsite
Radar^2TI AWR1843Spy radar detectionWebsite
Darting Pedestrians datasetZF FRGen21 Short RangeDarting pedestrians detectionWebsite
ODA24GHzObstacle detection and avoidance for dronesWebsite
Scattering Dataset77GHzWebsite
Radar Clutter Dataset77GHzClutter detectionsWebsite
Interference Dataset77GHzInterferenceWebsite
OSDaR23Navtech RadarRail-specific object detectionWebsite

Odometry and Localization

DatasetRadar TypeTaskLink
The Oxford Offroad Radar DatasetNavtech Spinning RadarPlace RecognitionWebsite
Oxford Radar RobocarNavtech Spinning RadarOdometry, (Detection)Website; Detection Annotation
RADIATENavtech Spinning RadarOdometry, Detection, TrackingWebsite
MulRanNavtech Spinning RadarPlace RecognitionWebsite
BoreasNavtech Spinning RadarLong-term Odometry, Localization, DetectionWebsite
EU Long-term DatasetConti ARS 308Long-term SLAMWebsite
ColoRadarTI AWR2243 Cascade + AWR1843OdometryWebsite
USVInlandTI AWR1843SLAM in inland waterways, Water segmentationWebsite
Endeavour Radar DatasetConti ARS 430 x5OdometryWebsite
OdomBeyondVisionTI AWR1843OdometryWebsite

Gesture

DatasetRadar TypeData TypeTaskLink
DopNet24GHzSpectrogramGestureWebsite
MCD-Gesture77GHzRAD tensorGestureWebsite
DeepSoli60GHzRD mapGestureWebsite
PantomimeTI IWR1443PCGestureDataset
MIMOGRRADTGesutreWebsite

Human Activity and Reconstruction

DatasetRadar TypeData TypeTaskLink
Radar signatures of human activities5.8 GHzADCHuman activitiesDataset
Ci4R human activity dataset77GHz & 24GHz & 10GHzSpectrogramHuman activitiesWebsite
RadHAR77GHzPoint CloudHuman activitiesWebsite
mRI77GHzPC, RGBD camera, IMUHuman pose estimationWebsite
mmBodyArbe Phoenix 4D RadarPC, RGBD3D body reconstructionWebsite
HuPR2 TI 1843RADPoseGithub

Vital Sign

DatasetRadar TypeData TypeTaskLink
Child Vital Sign60GHzADCheart beat, respirationDataset
GUARDIAN Vital Sign24GHzIQheart beat, respirationDataset 1 Dataset 2
Multi-Person Localization and Vital Sign Estimation Radar DatasetDataset

Radar Toolbox

Simulation

RadarSimPy: Code;
Virtual Radar: Code;
MaxRay: Paper;
RadaRays: Paper, Code, Video

TI Signal Processing SDK:

RaDICaL's Toolbox: SDK;
PyRapid: SDK;
OpenRadar : SDK;
Pymmw: SDK;
Open radar initiative: SDK;
RADIal's Emptyband-DDM Script: Code

Official SDK:

NXP Premium Radar SDK: Link;
TI mmWAVE Studio: Link;
TI Toolbox: Link;
Matlab Radar Toolbox: Link

Data Capturing:

TI Radar and Camera in Python:Code;
Ainstein Radar ROS Node: ROS Node;
Continental ARS 408 ROS Node: ROS Node;
TI mmWave ROS Driver: Guide;
RaDICaL's TI ROS Node: ROS Node;
UoA's TI ROS Package: ROS Node

Seminars and Workshops

  • 2021 ICRA Radar Perception for All-Weather Autonomy [Website]

  • 2021 ICASSP Recent Advances in mmWave Radar Sensing for Autonomous Vehicles [Website]

  • Radar in Action Series by Fraunhofer FHR [Video]

  • IEEE AESS Virtual Distinguished Lecturer Webinar Series [Website]

  • Journal of Radar Webinar Series (in Chinese) [Video]

  • Markus Gardill: Automotive Radar – An Overview on State-of-the-Art Technology [Video]

  • Markus Gardill: Automotive Radar – A Signal Processing Perspective on Current Technology and Future Systems [Video][Slides]

  • Francesco Fioranelli: Radar Old but Gold- current research challenges and activities in radar micro-Doppler signatures [Video]

  • Andrej Karpathy from Tesla: [Video]

  • Ole Schumann: Radar Perception for Automated Driving – Data and Methods [Video]

  • Sani Ronen from Arbe: Using AI layer to transform HR radar into insights for Autonomous Driving applications [Video]

  • Stefan Haag: Co-Development of Automatic Annotation for ML and Sensor Fusion Improvement System [Video]

  • Arthur Ouaknine: Deep Learning & Scene Understanding for autonomous vehicle [Video]

  • Paul Newman: The Road to Anywhere-Autonomy [Video]

  • Jaime Lien: Soli: Millimeter-wave radar for touchless interaction [Video]

  • Accelerating end-to-end Development of Software-Defined 4D Imaging Radar [Videp]

  • Radar-Imaging - An Introduction to the Theory Behind [Video]

  • NXP - Radar Experts Discuss the Evolution of Automotive Radar [Video]

  • Need to Successfully Design a Milimeter-Wave Automotive Radar Antenna? [Video]

  • Webinar SAR Imaging using Ancortek’s Software Defined Radars [Video]

  • TI: Managing interference in FMCW radar systems [Video]

Review Papers

Radar Hardware:

Radar Signal Processing:

Automotive Radar Applications:

Other Radar Applications:

General Object Detection:

Sensor Fusion:

Radar Textbook

  • Fundamentals of Radar Signal Processing by Mark A. Richard
  • Radar Systems Analysis and Design using Matlab by Bassem R. Mahafza

Online Course

Signal Processing

Waveform Comparison

Quadrature Signal

MIMO

Radar Signature

PointCloud

  • 2022-A Data-driven Approach for Stochastic Modeling of Automotive Radar Detections for Extended Objects GeMic; Paper
  • 2020-Performance Evaluation Of Wide Aperture Radar For Automotive Applications RadarConf; 0.1Deg; Paper
  • 2018-Radar and Lidar Target Signatures of Various Object Types and Evaluation of Extended Object Tracking Methods for Autonomous Driving Applications Paper
  • 2017-Radar Reflection Characteristics of Vehicles for Contour and Feature Estimation FUSION; Paper

RCS

  • 2021-Machine Learning-Based Target Classification for MMW Radar in Autonomous Driving Paper
  • 2021-Performance evaluation of a state-of-the-art automotive radar and corresponding modeling approaches based on a large labeled dataset Paper
  • 2021-Open Radar Initiative: Large Scale Dataset for Benchmarking of micro-Doppler Recognition Algorithms RadarConf; Paper
  • 2018-Review of Radar Classification & RCS Characterisation Techniques for Small UAVs or Drones Paper

Phase

  • 2019-Phase-Based Target Classification Using Neural Network in Automotive Radar Systems RadarConf; Paper

Motion

  • 2021-Open Radar Initiative: Large Scale Dataset for Benchmarking of micro-Doppler Recognition Algorithms RadarConf; Paper
  • 2020-New Radar Micro-Doppler Tag for Road Safety Based on the Signature of Rotating Backscatters Paper
  • 2019-Motion sensing using radar: Gesture interaction and beyond Paper

Polarimetric

  • 2019-Polarimetric Signatures of a Passenger Car Paper
  • 2018-Performance Analysis of 79 GHz Polarimetric Radar Sensors for Autonomous Driving Paper
  • 2018-Autonomous Driving Features based on 79 GHz Polarimetric Radar Data Paper

Calibration

Radar

  • 2022-Radar Calibration by Corner Reflectors with Mass-production Errors Paper
  • 2022-A novel method for calibration and verification of road side millimetre-wave radar Paper
  • 2021-Auto-Calibration of Automotive Radars in Operational Mode Using Simultaneous Localisation and Mapping TVT; Paper
  • 2020-Motion Based Online Calibration for 4D Imaging Radar in Autonomous Driving Applications GeMic; Paper
  • 2018-Multi-Radar Self-Calibration Method using High-Definition Digital Maps for Autonomous Driving ITSC; Paper

Radar-Camera

  • 2021-A Continuous-Time Approach for 3D Radar-to-Camera Extrinsic Calibration ICRA; Motion ; Paper
  • 2021-Spatio-Temporal Multisensor Calibration Based on Gaussian Processes Moving Object Tracking ToR; Trajectory ; Paper
  • 2019-Targetless Rotational Auto-Calibration of Radar and Camera for Intelligent Transportation Systems ITSC; NN; Paper
  • 2015-Radar and vision sensors calibration for outdoor 3D reconstruction ICRA; Paper
  • 2004-Obstacle Detection Using Millimeter-wave Radar and Its Visualization on Image Sequence ICPR; Paper

Radar-Lidar

  • 2020-Extrinsic and Temporal Calibration of Automotive Radar and 3D LiDAR IROS; Paper
  • 2020-Automatic Targetless Extrinsic Calibration of Multiple 3D LiDARs and Radars IROS; Paper
  • 2017-Extrinsic 6DoF calibration of 3D LiDAR and radar RCS; Paper

Radar-Lidar-Camera

  • Continuous Target-free Extrinsic Calibration of a Multi-Sensor System from a Sequence of Static Viewpoints Paper
  • 2022-OpenCalib: A multi-sensor calibration toolbox for autonomous driving Paper; Code
  • 2021-An Joint Extrinsic Calibration Tool for Radar, Camera and Lidar TIV; Paper; Code
  • 2021-Online multi-sensor calibration based on moving object tracking Paper
  • 2019-Extrinsic 6DoF Calibration of a Radar – LiDAR– Camera System Enhanced by Radar Cross Section Estimates Evaluation Paper

Labelling

  • 2021-Spatio-Temporal Consistency for Semi-supervised Learning Using 3D Radar Cubes IV; Paper
  • 2021-Automatic labeling of vulnerable road users in multi-sensor data ITSC; Paper
  • 2021-Rethinking of Radar’s Role: A Camera-Radar Dataset and Systematic Annotator via Coordinate Alignment CVPRW; CRUW; Paper
  • 2021-RADDet: Range-Azimuth-Doppler based Radar Object Detection for Dynamic Road Users CRV; RADDet; Paper
  • 2020-CARRADA Dataset: Camera and Automotive Radar with Range-Angle-Doppler Annotations ICPR; CARRADA; Paper
  • 2020-Radar Artifact Labeling Framework (RALF): Method for Plausible Radar Detections in Datasets Paper
  • 2020-Annotating Automotive Radar efficiently: Semantic Radar Labeling Framework (SeRaLF) Paper
  • 2020- RSS-Net: Weakly-Supervised Multi-Class Semantic Segmentation with FMCW Radar IV; Oxford; PoseChain; Paper
  • 2019-Automated Ground Truth Estimation of Vulnerable Road Users in Automotive Radar Data Using GNSS ICMIM; Paper

Data Augmentation

  • 2022-Multi-class Road User Detection with 3+1D Radar in the View-of-Delft Dataset RAL; PC; Paper
  • 2021-Investigation of Uncertainty of Deep Learning-based Object Classification on Radar Spectra RadarConf; RA; Corruption ; Paper
  • 2021-Data Augmentation in Time and Doppler Frequency Domain for Radar-based Gesture Recognition EuRad; Spectrogram; Paper
  • 2020-RAMP-CNN: A Novel Neural Network for Enhanced Automotive Radar Object Recognition RA; Paper
  • 2020-RADIO Parameterized Generative Radar Data Augmentation for Small Datasets RA; Paper
  • 2016-Convolutional Neural Network With Data Augmentation for SAR Target Recognition GRSL; SAR; Paper

Simulator

  • 2024-RadSimReal: Bridging the Gap Between Synthetic and Real Data in Radar Object Detection With Simulation CVPR;
  • 2021-MaxRay: A Raytracing-based Integrated Sensing and Communication Framework OpenSoucre; Paper
  • 2021-Virtual Radar: Real-Time Millimeter-Wave Radar Sensor Simulation for Perception-Driven Robotics RAL; OpenSoucre; Paper; Code
  • 2020-Scalable and Physical Radar Sensor Simulation for Interacting Digital TwinsPaper

Artifacts

  • 2020-Simulator Design for Interference Analysis in Complex Automotive Multi-User Traffic Scenarios Paper
  • 2019-Modeling and Simulation of Radar Sensor Artifacts for Virtual Testing of Autonomous Driving Paper

Evaluation

  • 2021-Deep Evaluation Metric: Learning to Evaluate Simulated Radar Point Clouds for Virtual Testing of Autonomous Driving RadarConf; Paper
  • 2021-A Multi-Layered Approach for Measuring the Simulation-to-Reality Gap of Radar Perception for Autonomous Driving IV; Paper
  • 2018-Measurements revealing Challenges in Radar Sensor Modeling for Virtual Validation of Autonomous Driving ITSC; Paper

Generative Model

  • 2021-There and Back Again: Learning to Simulate Radar Data for Real-World Applications ICRA; Simulation_to_RA; Categorical_VAE; Paper
  • 2020-L2R GAN: LiDAR-to-Radar Translation ACCV; Lidar_OGM_to_RD; Oxford ;cGAN; Paper
  • 2020-GenRadar: Self-supervised Probabilistic Camera Synthesis based on Radar Frequencies Journal; RD_to_Image; Categorical_VAE; Paper
  • 2019-Automotive radar and camera fusion using Generative Adversarial Networks Journal; Radar_OGM_to_Image; cGAN; Paper
  • 2017-Deep Stochastic Radar Models IV; Scene_to_RA; VAE; Paper

Doppler

  • 2021-IMU2Doppler: Cross-Modal Domain Adaptation for Doppler-based Activity Recognition Using IMU Data IMWUT; IMU; Paper
  • 2021-Vid2Doppler: Synthesizing Doppler Radar Data from Videos for Training Privacy-Preserving Activity Recognition CHI; Video; Paper

Testing

  • 2021-Millimeter-Wave Radar in-the-Loop Testing for Intelligent Vehicles TITS; Paper
  • 2020-On the Testing of Advanced Automotive Radar Sensors by Means of Target Simulators Paper
  • 2017-Surrogate Bicycle Design for Millimeter-Wave Automotive Radar Pre-Collision Testing TITS; Paper

MIMO Calibration

  • 2021-Auto-Calibration of Automotive Radars in Operational Mode Using Simultaneous Localisation and Mapping TVT; Paper
  • 2021-A Practical Concept for Precise Calibration of MIMO Radar Systems EuRAD; Paper

Detector

  • 2022-A Novel Radar Point Cloud Generation Method for Robot Environment Perception Paper
  • 2021-DNN-Based Peak Sequence Classification CFAR Detection Algorithm for High-Resolution FMCW Radar Paper
  • 2020-Object surface estimation from radar images Paper
  • 2020-Deep temporal detection - A machine learning approach to multiple-dwell target detection Paper
  • 2019-DL-CFAR: a Novel CFAR Target Detection Method Based on Deep Learning Paper
  • 2019-Feature Detection With a Constant FAR in Sparse 3-D Point Cloud Data Paper

Super Resolution

  • 2024-DART: Implicit Doppler Tomography for Radar Novel View Synthesis CVPR;Paper; Codes
  • 2023-Data-driven Spatial Super-Resolution for FMCW mmWave Sensing Systems Paper
  • 2023-Super-Resolution Radar Imaging with Sparse Arrays Using a Deep Neural Network Trained with Enhanced Virtual Data Paper
  • 2023-Azimuth Super-Resolution for FMCW Radar in Autonomous Driving CVPR; Paper
  • 2023-Self-Supervised Learning for Enhancing Angular Resolution in Automotive MIMO Radars Paper
  • 2022-A Machine Learning Perspective on Automotive Radar Direction of Arrival Estimation Paper
  • 2020-Radar Image Reconstruction from Raw ADC Data using Parametric Variational Autoencoder with Domain Adaptation Paper

Clustering

  • 2021-Supervised Noise Reduction for Clustering on Automotive 4D Radar Paper
  • 2019-A Multi-Stage Clustering Framework for Automotive Radar Data Paper
  • 2019-Robust and Adaptive Radar Elliptical Density-Based Spatial Clustering and labeling for mmWave Radar Point Cloud Data Paper
  • 2018-Supervised Clustering for Radar Applications On the Way to Radar Instance Segmentation Paper
  • 2016-Adaptive Clustering for Contour Estimation of Vehicles for High-Resolution Radar Paper
  • 2012- Grid-Based DBSCAN for Clustering Extended Objects in Radar Data Paper

Denoising

  • Deep Convolutional Autoencoder Applied for Noise Reduction in Range-Doppler Maps of FMCW Radars
  • Learning from Natural Noise to Denoise Micro-Doppler Spectrogram

TI Reference Designs

  • TIDEP-01027 High-end corner radar reference design AWR2944; Link
  • TIDEP-01025 mmWave diagnostic and monitoring reference design Link
  • TIDEP-01024 Obstacle detection reference design using 76-Ghz to 81-GHz antenna-on-package (AoP) mmWave sensor AWR1843AOP; Link
  • TIDEP-01023 Child-presence and occupant-detection reference design using 60-GHz antenna-on-package mmWave sensor AWR6843AOP; Link
  • TIDEP-01021 Beamsteering for corner radar reference design AWR1843BOOST; Link
  • TIDEP-01018 Automated doors reference design using TI mmWave sensors IWR6843ISK; Link
  • TIDEP-01013 Gesture controlled HMI with mmWave sensors and Sitaraâ„¢ processors reference design IWR6843ISK; Link
  • TIDEP-01012 Imaging radar using cascaded mmWave sensor reference design AWR2243; Link
  • TIDEP-01011 Automated parking system reference design using 77-GHz mmWave sensor AWR1843; Link
  • TIDEP-01010 Area scanner using mmWave Sensor with integrated antenna-on-package reference design IWR6843; Link
  • TIDEP-0104 Obstacle detection reference design using 77-GHz mmWave sensor AWR1642; Link
  • TIDEP-01006 Autonomous robot reference design using ROS on Sitaraâ„¢ MPU & antenna-on-package mmWave sensors IWR6843; Link
  • TIDEP-01003 Zone occupancy detection using mmWave sensor reference design IWR1443BOOST; Link
  • TIDEP-01001 Vehicle occupant detection reference design AWR6843; Link
  • TIDEP-01000 People Counting and Tracking Reference Design Using mmWave Radar Sensor IWR6843; Link
  • TIDEP-0094 80m-Range Object Detection Reference Design With Integrated Single-Chip mmWave Sensor IWR1642; Link
  • TIDEP-0092 Short-range radar (SRR) reference design IWR1642; Link
  • TIDEP-0091 Power optimization for 77GHz-level transmitter reference design IWR1443; Link
  • TIDEP-0090 Traffic Monitoring Object Detection and Tracking Reference Design Using mmWave Radar Sensor Link

Classification of Clusters

Object Detection

Pre-CFAR Data

Range Azimuth Map

Range Doppler Map

ROD2021 Challenge Paper

Sensor Fusion

Weakly Supervised

  • 2022-A Novel Radar Point Cloud Generation Method for Robot Environment Perception Paper
  • 2022-Look, Radiate, and Learn: Self-supervised Localisation via Radio-Visual Correspondence Arxiv; Simulation; SpatialContrastive; Paper
  • 2021-R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenes 3DIMPVT; nuScenes; SSL; Paper
  • 2021- RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization IJSTSP; CRUW; ConfMap; Paper; Code; Video
  • 2020- RSS-Net: Weakly-Supervised Multi-Class Semantic Segmentation with FMCW Radar IV; Oxford; PoseChain; Paper
  • 2020-Warping of Radar Data into Camera Image for Cross-Modal Supervision in Automotive Applications TVT; Velocity; Paper
  • 2020-Weakly Supervised Deep Learning Method for Vulnerable Road User Detection in FMCW Radar ITSC; Tracking; Paper
  • 2020- Radar as a Teacher: Weakly Supervised Vehicle Detection using Radar Labels ICRA; CoTeaching; Paper

Depth Estimation

  • 2023-Depth Estimation From Camera Image and mmWave Radar Point Cloud CVPR; Paper
  • 2022-RVMDE: Radar Validated Monocular Depth Estimation for Robotics Arxiv; nuScenes Paper; Code
  • 2021-Semantic-guided radar-vision fusion for depth estimation and object detection BMVC; nuScenes; SemanticJoint; Paper
  • 2021-Depth estimation from monocular images and sparse radar using deep ordinal regression network ICIP; nuScenes; DORN ; Paper; Code
  • 2021-R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenes 3DIMPVT; nuScenes; SSL; Paper
  • 2021-Radar-Camera Pixel Depth Association for Depth Completion CVPR; nuScenes; MER ; Paper; Code
  • 2020-Depth Estimation from Monocular Images and Sparse Radar Data IROS; nuScenes; TwoStage; Paper; Code
  • 2020-Camera-Radar Fusion for 3-D Depth Reconstruction IV; RadarRA; Paper; Video

Ego Motion Estimation

  • 2022-A Credible and Robust Approach to Ego-Motion Estimation Using an Automotive Radar RAL; Paper
  • 2021-3D ego-Motion Estimation Using low-Cost mmWave Radars via Radar Velocity Factor for Pose-Graph SLAM ICRA; Paper
  • 2020-milliEgo: Single-chip mmWave Aided Egomotion Estimation with Deep Sensor Fusion SenSys; Paper; Code
  • 2020-Radar-Inertial Ego-Velocity Estimation for Visually Degraded Environments ICRA; Paper
  • 2018-Precise Ego-Motion Estimation with Millimeter-Wave Radar under Diverse and Challenging Conditions ICRA; Paper
  • 2014-Instantaneous Ego-Motion Estimation using Multiple Doppler Radars ICRA; Paper

Velocity Estimation

  • 2023-Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervision CVPR; Paper
  • 2022-Self-Supervised Velocity Estimation for Automotive Radar Object Detection Networks nuScenes; Paper
  • 2022-Self-Supervised Scene Flow Estimation with 4D Automotive Radar RAL; 4DRadar; FlowNet; Paper; Code
  • 2021-Full-Velocity Radar Returns by Radar-Camera Fusion ICCV; nuScenes; OpticalFlow; Paper
  • 2021-3D Radar Velocity Maps for Uncertain Dynamic Environments IROS; Bayesian; Paper; Code
  • 2020-An RLS-Based Instantaneous Velocity Estimator for Extended Radar Tracking IROS; Paper
  • 2018- Instantaneous Actual Motion Estimation with a Single High-Resolution Radar Sensor Nonlinear Paper
  • 2014-Instantaneous Full-Motion Estimation of Arbitrary Objects using Dual Doppler Radar DualRadar; Paper
  • 2013-Instantaneous lateral velocity estimation of a vehicle using Doppler radar MultiPts; Paper

Tracking

Neural Network

  • 2022- Deep Learning Method for Cell-Wise Object Tracking, Velocity Estimation and Projection of Sensor Data over Time Paper
  • 2022-Exploiting Temporal Relations on Radar Perception for Autonomous Driving CVPR; Oxford; Attention; Paper
  • 2021-End-to-End On-Line Multi-object Tracking on Sparse Point Clouds Using Recurrent Convolutional Networks Paper
  • 2021-CFTrack: Center-based Radar and Camera Fusion for 3D Multi-Object Tracking IV; CenterFusion+Track; nuScenes; Paper; Video

Bayesian Filtering

  • 2021-Road-Map Aided GM-PHD Filter for Multi-Vehicle Tracking with Automotive Radar Paper
  • 2021-Bayesradar: Bayesian Metric-Kalman Filter Learning for Improved and Reliable Radar Target Classification Paper
  • 2021-Extended Object Tracking assisted Adaptive Multi-Hypothesis Clustering for Radar in Autonomous Driving Domain Paper
  • 2021-A Graph-Based Track-Before-Detect Algorithm for Automotive Radar Target Detection Paper
  • 2020-BAAS: Bayesian Tracking and Fusion Assisted Object Annotation of Radar Sensor Data for Artificial Intelligence Application RadarConf; Paper
  • 2020-An RLS-Based Instantaneous Velocity Estimator for Extended Radar Tracking IROS; Paper
  • 2021-Automotive Radar-Based Vehicle Tracking Using Data-Region Association TITS; Paper
  • 2020-Extended Object Tracking Using Spatially Resolved Micro-Doppler Signatures TIV; Paper
  • 2019-Extended Object Tracking assisted Adaptive Clustering for Radar in Autonomous Driving Applications Paper
  • 2018- Rfcm for Data Association and Multitarget Tracking Using 3D Radar ICASSP; Paper
  • 2018-Classification Assisted Tracking for Autonomous Driving Domain Paper
  • 2015-Tracking of Extended Objects with High-Resolution Doppler Radar TITS; Paper
  • 2010-Road Intensity Based Mapping Using Radar Measurements With a Probability Hypothesis Density Filter TSP; Paper

Modelling

  • 2022-A Data-driven Approach for Stochastic Modeling of Automotive Radar Detections for Extended Objects GeMic; Paper
  • 2021-A Multi-Layered Approach for Measuring the Simulation-to-Reality Gap of Radar Perception for Autonomous Driving IV; Paper
  • 2021-Learning-Based Extended Object Tracking Using Hierarchical Truncation Measurement Model With Automotive Radar JSTSP; Paper
  • 2020-Extended Object Tracking Using Hierarchical Truncation Measurement Model with Automotive Radar ICASSP; Paper

Prediction

  • 2021-Predicting Vehicle Behavior Using Automotive Radar and Recurrent Neural Networks Paper
  • 2021-Deep-Learning Based Decentralized Frame-to-Frame Trajectory Prediction Over Binary Range-Angle Maps for Automotive Radars TVT; Paper
  • 2020-LiRaNet: End-to-End Trajectory Prediction using Spatio-Temporal Radar Fusion Paper
  • 2020-FISHING Net: Future Inference of Semantic Heatmaps in Grids Paper

Occupancy Grid Map

  • 2022-Radar Occupancy Prediction With Lidar Supervision While Preserving Long-Range Sensing and Penetrating Capabilities RAL; Paper
  • 2020-See Through Smoke: Robust Indoor Mapping with Low-cost mmWave Radar MobiSys; Paper
  • 2019-Road Scene Understanding by Occupancy Grid Learning from Sparse Radar Clusters using Semantic Segmentation ICCV; Paper
  • 2019- Probably Unknown: Deep Inverse Sensor Modelling Radar ICRA; Paper
  • 2019-Occupancy Grids Generation Using Deep Radar Network for Autonomous Driving ITSC; Paper
  • 2015-Automotive Radar Gridmap Representations Paper

Point Cloud Map

  • 2022-High Resolution Point Clouds from mmWave Radar Paper
  • 2020-Remove, then Revert: Static Point cloud Map Construction using Multiresolution Range Images IROS; Paper

Open Space Segmentation

  • 2022-Raw High-Definition Radar for Multi-Task Learning CVPR; Dataset; Paper
  • 2022-Deformable Radar Polygon: A Lightweight and Predictable Occupancy Representation for Short-range Collision Avoidance Paper
  • 2022-Drivable Region Estimation for Self-Driving Vehicles Using Radar TVT; Paper
  • 2021-PolarNet: Accelerated Deep Open Space Segmentation Using Automotive Radar in Polar Domain Paper
  • 2020-Deep Open Space Segmentation using Automotive Radar Dataset; Paper
  • 2018-High Resolution Radar-based Occupancy Grid Mapping and Free Space Detection Paper

Scene Understanding

  • 2020-Semantic Segmentation on 3D Occupancy Grids for Automotive Radar Paper
  • 2020-Statistical Image Segmentation and Region Classification Approaches for Automotive Radar EuRAD; Paper
  • 2019-Scene Understanding With Automotive Radar TIV; Paper
  • 2018-Semantic Segmentation on Radar Point Clouds FUSION; Paper

Place Recognition

  • 2024-TransLoc4D: Transformer-based 4D-Radar Place Recognition CVPR
  • 2022-AutoPlace: Robust Place Recognition with Single-chip Automotive Radar ICRA; Paper; Code
  • 2021-Contrastive Learning for Unsupervised Radar Place Recognition Paper
  • 2021-Radar-to-Lidar: Heterogeneous Place Recognition via Joint Learning Paper
  • 2021-Unsupervised Place Recognition with Deep Embedding Learning over Radar Videos Paper
  • 2020-Look Around You: Sequence-based Radar Place Recognition with Learned Rotational Invariance Paper
  • 2020-MulRan Multimodal Range Dataset for Urban Place Recognition ICRA; Dataset; Paper

Odometry and SLAM

Odometry

  • 2022-Radar Odometry on SE(3) with Constant Acceleration Motion Prior and Polar Measurement Model Paper
  • 2022-Fast-MbyM: Leveraging Translational Invariance of the Fourier Transform for Efficient and Accurate Radar Odometry Paper ICRA; Code
  • 2021-Radar Odometry Combining Probabilistic Estimation and Unsupervised Feature Learning Paper
  • 2021-Radar Odometry on SE(3) With Constant Velocity Motion Prior RAL; Paper
  • 2022-What Goes Around: Leveraging a Constant-curvature Motion Constraint in Radar Odometry RAL; Paper
  • 2021-Do We Need to Compensate for Motion Distortion and Doppler Effects in Spinning Radar Navigation RAL; Paper; Code
  • 2021-A Normal Distribution Transform-Based Radar Odometry Designed For Scanning and Automotive Radars ICRA; Paper
  • 2021-BFAR – Bounded False Alarm Rate detector for improved radar odometry estimation Paper
  • 2021-CFEAR Radarodometry - Conservative Filtering for Efficient and Accurate Radar Odometry IROS; Paper
  • 2021-Continuous-time Radar-inertial Odometry for Automotive Radars IROS; Paper
  • 2021-Oriented surface points for efficient and accurate radar odometry Paper
  • 2020-PhaRaO: Direct Radar Odometry using Phase Correlation ICRA; Paper
  • 2019-Masking by Moving: Learning Distraction-Free Radar Odometry from Pose Information CoRL; Paper

SLAM

  • 2022-CorAl: Introspection for robust radar and lidar perception in diverse environments using differential entropy RAS; Paper
  • 2022-Are We Ready for Radar to Replace Lidar in All-Weather Mapping and Localization Paper
  • 2021-SERALOC: SLAM on semantically annotated radar point-clouds ITSC; Paper
  • 2021-RaLL: End-to-End Radar Localization on Lidar Map Using Differentiable Measurement Model TITS; Paper
  • 2021-Improved Radar Localization on Lidar Maps Using Shared Embedding Paper
  • 2021-Cross-Modal Contrastive Learning of Representations for Navigation using Lightweight, Low-Cost Millimeter Wave Radar for Adverse Environmental Conditions RAL; Paper
  • 2021-RadarLoc: Learning to Relocalize in FMCW Radar ICRA; Paper
  • 2021-Radar SLAM: A Robust SLAM System for All Weather Conditions Paper
  • 2020-RadarSLAM: Radar based Large-Scale SLAM in All Weathers IROS; Paper
  • 2020-Self-Supervised Localisation between Range Sensors and Overhead Imagery Paper
  • 2020-RSL-Net: Localising in Satellite Images From a Radar on the Ground RAL; Paper
  • 2020-Under the Radar: Learning to Predict Robust Keypoints for Odometry Estimation and Metric Localisation in Radar ICRA; Paper
  • 2020-Radar-on-Lidar: metric radar localization on prior lidar maps Paper
  • 2020-kRadar++: Coarse-to-Fine FMCW Scanning Radar Localisation Paper
  • 2020-Kidnapped Radar: Topological Radar Localisation using Rotationally-Invariant Metric Learning ICRA; Paper
  • 2020-A Scalable Framework for Robust Vehicle State Estimation with a Fusion of a Low-Cost IMU, the GNSS, Radar, a Camera and Lidar IROS; Paper
  • 2005-An Augmented State SLAM formulation for Multiple Line-of-Sight Features with Millimetre Wave RADAR IROS; Paper

Automotive SAR

  • 2022-Synthetic Aperture Radar Imaging of Moving Targets for Automotive Applications EuRAD; Bosch; Paper
  • 2022-Performance Analysis of Automotive SAR With Radar Based Motion Estimation GM; Paper
  • 2022-Residual Motion Compensation in Automotive MIMO SAR Imaging RadarConf; Huawei; Paper
  • 2022-A Quick and Dirty processor for automotive forward SAR imaging RadarConf; Huawei; Paper
  • 2021-Cooperative Synthetic Aperture Radar in an Urban Connected Car Scenario Huawei; Paper
  • 2021-Navigation-Aided Automotive SAR for High-Resolution Imaging of Driving Environments Huawei; Paper
  • 2021-Imaging radar for automated driving functions Continental; Paper
  • 2021-MIMO-SAR: A Hierarchical High-resolution Imaging Algorithm for mmWave FMCW Radar in Autonomous Driving TVT; Paper
  • 2020-3D Point Cloud Generation with Millimeter-Wave Radar Paper
  • 2020-High Resolution Radar Dataset for Semi-Supervised Learning of Dynamic Objects CVPRW; Paper

ISAR

  • 2022-Classification Of Automotive Targets Using Inverse Synthetic Aperture Radar Images Paper
  • 2021-Inverse Synthetic Aperture Radar Imaging: A Historical Perspective and State-of-the-Art Survey Paper

Human Activity Recognition

Pointcloud

  • 2022-Cross Vision-RF Gait Re-identification with Low-cost RGB-D Cameras and mmWave Radars Paper
  • 2022-Tesla-Rapture: A Lightweight Gesture Recognition System from mmWave Radar Sparse Point Clouds TMC; Paper
  • 2021-m-Activity Accurate and Real-Time Human Activity Recognition Via Millimeter Wave Radar ICASSP; Paper
  • 2020-Real-time Arm Gesture Recognition in Smart Home Scenarios via MillimeterWave Sensing Paper
  • 2019-RadHAR: Human Activity Recognition from Point Clouds Generated through a Millimeter-wave Radar Paper

Micro-Doppler

  • 2022-Attention-Based Dual-Stream Vision Transformer for Radar Gait Recognition ICASSP; Paper
  • 2021-Human Motion Recognition With Limited Radar Micro-Doppler Signatures TGRS; Paper
  • 2018-Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks TGRS; Paper

RD

  • 2021-RadarNet: Efficient Gesture Recognition Technique Utilizing a Miniature Radar Sensor CHI; Paper
  • 2016-Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum Paper; Video
  • 2015-Short-Range FMCW Monopulse Radar for Hand-Gesture Sensing RadarConf; Paper

Domain Adaption

  • 2022-Unsupervised Learning for Human Sensing Using Radio Signals WACV; Paper
  • 2022-Unsupervised Domain Adaptation across FMCW Radar Configurations Using Margin Disparity Discrepancy Paper
  • 2022-mTransSee: Enabling Environment-Independent mmWave Sensing Based Gesture Recognition via Transfer Learning Paper
  • 2022-Few-Shot User-Definable Radar-Based Hand Gesture Recognition at the Edge Paper
  • 2021-Towards Domain-Independent and Real-Time Gesture Recognition Using mmWave Signal Paper
  • 2021-Semisupervised Human Activity Recognition With Radar Micro-Doppler Signatures TGRS; Paper
  • 2021-Supervised Domain Adaptation for Few-Shot Radar-Based Human Activity Recognition Paper
  • 2021-Towards Cross-Environment Human Activity Recognition Based on Radar Without Source Data Paper
  • 2021-Continual Learning of Micro-Doppler Signature-Based Human Activity Classification GRSL; Paper

Distributed

  • 2022-Exploiting Radar Data Domains for Classification with Spatially Distributed Nodes Paper

Radar-Audio

Speech Recovery

  • 2022-Wavesdropper: Through-wallWord Detection of Human Speech via Commercial mmWave Devices Paper
  • 2022-Radio2Speech: High Quality Speech Recovery from Radio Frequency Signals Paper
  • 2021-mmPhone: Acoustic Eavesdropping on Loudspeakers via mmWave-characterized Piezoelectric Effect INFOCOM; Paper

Vocal Chord

  • 2022-Multi-target Time-Varying Vocal Folds Vibration Detection Using MIMO FMCW Radar Paper
  • 2021-VocalPrint: A mmWave-based Unmediated Vocal Sensing System for Secure Authentication Paper

Separation

  • 2022-RadioSES: mmWave-Based Audioradio Speech Enhancement and Separation System Paper
  • 2021-Wavoice: A Noise-resistant Multi-modal Speech Recognition System Fusing mmWave and Audio Signals SenSys; Paper

Weather Effects

Effect

  • The Impact of Adverse Weather Conditions on Autonomous Vehicles: How Rain, Snow, Fog, and Hail Affect the Performance of a Self-Driving Car Paper
  • Seeing through dust and water vapor: Millimeter wave radar sensors for mining applications Paper
  • Analysis of rain clutter detections in commercial 77 GHz automotive radar Paper
  • The Perception System of Intelligent Ground Vehicles in All Weather Conditions: A Systematic Literature Review Paper
  • Testing and Validation of Automotive Point-Cloud Sensors in Adverse Weather Conditions Paper
  • Object Detection Under Rainy Conditions for Autonomous Vehicles: A Review of State-of-the-Art and Emerging Techniques Paper
  • Testing and Validation of Automotive Point-Cloud Sensors in Adverse Weather Conditions Paper
  • What Happens for a ToF LiDAR in Fog? Paper

Datasets

  • Oxford Foggy Code
  • DENSE
  • RADIATE
  • Boreas
  • K-Radar
    See the dataset section for details.

Methods

  • 2022-Modality-Agnostic Learning for Radar-Lidar Fusion in Vehicle Detection Paper
  • 2021-Robust Multimodal Vehicle Detection in Foggy Weather Using Complementary Lidar and Radar Signals Paper
  • 2020-Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather Paper; Code; Video
  • 2020-Through Fog High Resolution Imaging Using Millimeter Wave Radar Paper; Code; Video

Multi-Path Effect

Dataset

  • 2021-The Radar Ghost Dataset – An Evaluation of Ghost Objects in Automotive Radar Data Paper; Code

Methods

  • 2021-Anomaly Detection in Radar Data Using PointNets Paper
  • 2021-Fast Rule-Based Clutter Detection in Automotive Radar Data Paper
  • 2021-Radar Ghost Target Detection via Multimodal Transformers Paper
  • 2021-Ghost Target Detection in 3D Radar Data using Point Cloud based Deep Neural Network Paper
  • 2020- Using Machine Learning to Detect Ghost Images in Automotive Radar Paper
  • 2020-Seeing Around Street Corners Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar Paper
  • 2019-Identification of Ghost Moving Detections in Automotive Scenarios with Deep Learning Paper
  • 2018-Automotive Radar Multipath Propagation in Uncertain Environments Paper

Mutual Interference

Methods

  • 2022-A Two-stage DNN Model with Mask-gated Convolution for Automotive Radar Interference Detection and Mitigation Paper
  • 2021-Resource-Efficient Deep Neural Networks for Automotive Radar Interference Mitigation Paper
  • 2021-A DNN Autoencoder for Automotive Radar Interference Mitigation Paper
  • 2021-CFAR-Based Interference Mitigation for FMCW Automotive Radar Systems Paper
  • 2021-Mutual Interference Suppression Using Wavelet Denoising in Automotive FMCW Radar Systems Paper
  • 2020-Interference Characterization in FMCW radars Paper
  • 2020-Deep Interference Mitigation and Denoising of Real-World FMCW Radar Signals Paper; Video
  • 2019-Complex Signal Denoising and Interference Mitigation for Automotive Radar Using Convolutional Neural Networks Paper
  • 2018-A Deep Learning Approach for Automotive Radar Interference Mitigation Paper

Reviews

  • 2022-Interference Suppression Using Deep Learning: Current Approaches and Open Challenges Paper
  • 2020-Radar Interference Mitigation for Automated Driving: Exploring proactive strategies Paper
  • 2020-Interference in Automotive Radar Systems Characteristics, mitigation techniques, and current and future research Paper

Range and Doppler Cell Migration

  • 2021-Doppler–Range Processing for Enhanced High-Speed Moving Target Detection Using LFMCW Automotive Radar Paper
  • 2019-Range and Doppler Cell Migration in Wideband Automotive Radar Paper

Tx-Rx Leakage

  • 2022-Mitigation of Leakage and Stationary Clutters in Short-Range FMCW Radar With Hybrid Analog and Digital Compensation Technique Paper
  • 2019-The Effect of Antenna Mutual Coupling on MIMO Radar System Performance Paper

Imperfect Waveform Separation

  • 2020-Slow-Time MIMO-FMCW Automotive Radar Detection with Imperfect Waveform Separation Paper