๐Ÿฆ… Griffin

August 26, 2025 ยท View on GitHub

๐Ÿฆ… Griffin

A Pioneering Large-scale Dataset and Benchmark for Aerial-Ground Cooperative 3D Perception

arXiv Dataset Dataset GitHub License


๐ŸŽฏ What is Griffin?

Griffin Dataset Examples

Griffin is a pioneering publicly large-scale dataset specifically designed for aerial-ground cooperative 3D perception. Our dataset pushes the boundaries of multi-agent perception by combining aerial and ground-based viewpoints for enhanced 3D object detection and tracking.

โœจ Key Features

  • ๐ŸŽฌ 250+ Dynamic Scenes with realistic traffic patterns
  • ๐Ÿ“ธ 37K Frames and 340K High-quality Images
  • ๐ŸŽฏ Instance-aware Occlusion Analysis for precise labels
  • โœˆ๏ธ Multi-altitude Drone Simulation (20m-60m)
  • ๐ŸŒ CARLA-AirSim Co-simulation for photorealistic environments
  • ๐ŸŽช Comprehensive Benchmarks for detection and tracking
  • ๐Ÿ“ก Robustness Evaluation under communication interference and localization errors
Dataset Comparison

๐Ÿ“‹ Table of Contents


๐Ÿ”ฅ Latest News

๐Ÿšจ Stay updated with the latest developments in Griffin!

DateUpdateDescription
2025/8๐Ÿ”ง Robustness EvaluationTesting configurations for localization errors, communication latency, and packet loss are now available
2025/7๐Ÿ“Š Griffin-55m SubsetNew subset Griffin-55m and corresponding model checkpoints are released
2025/3๐Ÿค– UniV2X ModelsReleased reimplementation code and pre-trained models for UniV2X
2025/3๐Ÿ’พ Dataset V1.0Griffin V1.0 dataset is available on Baidu Netdisk and ๐Ÿค— Hugging Face
2025/3๐Ÿ“„ Paper PublishedOur paper is now available on ArXiv

๐Ÿ“š Documentation

Comprehensive guides to help you get the most out of Griffin:

GuideDescriptionLink
๐Ÿ› ๏ธ InstallationStep-by-step setup instructionsdocs/Installation.md
๐Ÿ“Š Dataset PreparationHow to download and organize the datadocs/Dataset_Preparation.md
๐Ÿƒโ€โ™‚๏ธ Training & EvaluationRun experiments and evaluate modelsdocs/Training_and_Evaluation.md
๐ŸŽจ VisualizationVisualize results and debug your modelsdocs/Visualization.md

๐Ÿ“ˆ Main Results

Griffin provides comprehensive benchmarks across multiple models and challenging scenarios. Our evaluation covers detection and multi-object tracking metrics under various conditions.

๐ŸŽฏ Baseline Performance

The AP and AMOTA metrics of every baseline among different subsets are shown below. For detailed results with all metrics, see ๐Ÿ“Š detailed_results.csv.

Model Performance Comparison

๐ŸŒ Communication Robustness

Communication Robustness

๐Ÿ“ Localization Robustness

Localization Robustness

๐Ÿ† Key Insights

  • ๐Ÿค Cooperative Potential: In favorable conditions, cooperative methods achieve substantial performance gains over single-agent baselines by resolving occlusions and expanding the effective field-of-view
  • โœˆ๏ธ Altitude Sensitivity: Strong sensitivity to drone flight altitude affects performance, with instance-level fusion strategies proving more resilient to perspective shifts than dense BEV-level approaches
  • ๐ŸŽฏ Adaptive Filtering: Resilience to localization errors is directly linked to adaptive data filteringโ€”methods with selective fusion (instance-level filtering or spatial confidence maps) demonstrate superior robustness
  • ๐Ÿ”ฎ Future Directions: Research should focus on altitude-adaptive fusion mechanisms, sparse communication-efficient methods, and dynamic trust mechanisms for reliable real-world deployment

๐Ÿ“ Citation

If you find Griffin useful for your research, please consider giving us a โญ and citing our work:

@misc{wang2025griffinaerialgroundcooperativedetection,
      title={Griffin: Aerial-Ground Cooperative Detection and Tracking Dataset and Benchmark},
      author={Jiahao Wang and Xiangyu Cao and Jiaru Zhong and Yuner Zhang and Haibao Yu and Lei He and Shaobing Xu},
      year={2025},
      eprint={2503.06983},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2503.06983},
}

๐Ÿ™ Acknowledgements

We extend our heartfelt gratitude to the amazing open-source community and these outstanding projects that made Griffin possible:

ProjectContributionLink
๐Ÿ”ง MMDetection3DCore 3D detection framework and infrastructureGitHub
๐Ÿค UniV2XCooperative perception methodologies and inspirationGitHub
๐Ÿš— BEVFormerBird's-eye-view 3D object detection baselineGitHub
๐ŸŽฏ AB3DMOT3D multi-object tracking algorithms and evaluationGitHub

Star โญ this repository if you found it helpful!

GitHub stars GitHub forks

Made with โค๏ธ by the Griffin team