๐ฆ Griffin
August 26, 2025 ยท View on GitHub
๐ฆ Griffin
A Pioneering Large-scale Dataset and Benchmark for Aerial-Ground Cooperative 3D Perception
๐ฏ What is Griffin?
Griffin is a pioneering publicly large-scale dataset specifically designed for aerial-ground cooperative 3D perception. Our dataset pushes the boundaries of multi-agent perception by combining aerial and ground-based viewpoints for enhanced 3D object detection and tracking.
โจ Key Features
- ๐ฌ 250+ Dynamic Scenes with realistic traffic patterns
- ๐ธ 37K Frames and 340K High-quality Images
- ๐ฏ Instance-aware Occlusion Analysis for precise labels
- โ๏ธ Multi-altitude Drone Simulation (20m-60m)
- ๐ CARLA-AirSim Co-simulation for photorealistic environments
- ๐ช Comprehensive Benchmarks for detection and tracking
- ๐ก Robustness Evaluation under communication interference and localization errors
๐ Table of Contents
๐ฅ Latest News
๐จ Stay updated with the latest developments in Griffin!
| Date | Update | Description |
|---|---|---|
| 2025/8 | ๐ง Robustness Evaluation | Testing configurations for localization errors, communication latency, and packet loss are now available |
| 2025/7 | ๐ Griffin-55m Subset | New subset Griffin-55m and corresponding model checkpoints are released |
| 2025/3 | ๐ค UniV2X Models | Released reimplementation code and pre-trained models for UniV2X |
| 2025/3 | ๐พ Dataset V1.0 | Griffin V1.0 dataset is available on Baidu Netdisk and ๐ค Hugging Face |
| 2025/3 | ๐ Paper Published | Our paper is now available on ArXiv |
๐ Documentation
Comprehensive guides to help you get the most out of Griffin:
| Guide | Description | Link |
|---|---|---|
| ๐ ๏ธ Installation | Step-by-step setup instructions | docs/Installation.md |
| ๐ Dataset Preparation | How to download and organize the data | docs/Dataset_Preparation.md |
| ๐โโ๏ธ Training & Evaluation | Run experiments and evaluate models | docs/Training_and_Evaluation.md |
| ๐จ Visualization | Visualize results and debug your models | docs/Visualization.md |
๐ Main Results
Griffin provides comprehensive benchmarks across multiple models and challenging scenarios. Our evaluation covers detection and multi-object tracking metrics under various conditions.
๐ฏ Baseline Performance
The AP and AMOTA metrics of every baseline among different subsets are shown below. For detailed results with all metrics, see ๐ detailed_results.csv.
๐ Communication Robustness
๐ Localization Robustness
๐ Key Insights
- ๐ค Cooperative Potential: In favorable conditions, cooperative methods achieve substantial performance gains over single-agent baselines by resolving occlusions and expanding the effective field-of-view
- โ๏ธ Altitude Sensitivity: Strong sensitivity to drone flight altitude affects performance, with instance-level fusion strategies proving more resilient to perspective shifts than dense BEV-level approaches
- ๐ฏ Adaptive Filtering: Resilience to localization errors is directly linked to adaptive data filteringโmethods with selective fusion (instance-level filtering or spatial confidence maps) demonstrate superior robustness
- ๐ฎ Future Directions: Research should focus on altitude-adaptive fusion mechanisms, sparse communication-efficient methods, and dynamic trust mechanisms for reliable real-world deployment
๐ Citation
If you find Griffin useful for your research, please consider giving us a โญ and citing our work:
@misc{wang2025griffinaerialgroundcooperativedetection,
title={Griffin: Aerial-Ground Cooperative Detection and Tracking Dataset and Benchmark},
author={Jiahao Wang and Xiangyu Cao and Jiaru Zhong and Yuner Zhang and Haibao Yu and Lei He and Shaobing Xu},
year={2025},
eprint={2503.06983},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2503.06983},
}
๐ Acknowledgements
We extend our heartfelt gratitude to the amazing open-source community and these outstanding projects that made Griffin possible:
| Project | Contribution | Link |
|---|---|---|
| ๐ง MMDetection3D | Core 3D detection framework and infrastructure | GitHub |
| ๐ค UniV2X | Cooperative perception methodologies and inspiration | GitHub |
| ๐ BEVFormer | Bird's-eye-view 3D object detection baseline | GitHub |
| ๐ฏ AB3DMOT | 3D multi-object tracking algorithms and evaluation | GitHub |
Star โญ this repository if you found it helpful!
Made with โค๏ธ by the Griffin team