data.md

September 23, 2024 · View on GitHub

Preparing Data for Mamba-YOLO-World

Overview

For pre-training Mamba-YOLO-World, we adopt several datasets as listed in the below table:

DataSamplesTypeBoxes
Objects365v1609kdetection9,621k
GQA621kgrounding3,681k
Flickr149kgrounding641k

Dataset Directory

We put all data into the data directory, such as:

├── coco
   ├── annotations
   ├── instances_val2017.json
   └── instances_train2017.json
   ├── lvis
   └── lvis_v1_minival_inserted_image_name.json
   ├── train2017
   └── val2017
├── flickr
   ├── final_flickr_separateGT_train.json
   └── images
├── mixed_grounding
   ├── final_mixed_train_no_coco.json
   ├── images
├── objects365v1
   ├── objects365_train.json
   └── train
└── texts

NOTE: We strongly suggest that you check the directories or paths in the dataset part of the config file, especially for the values ann_file, data_root, and data_prefix.

We provide the annotations of the pre-training data in the below table:

DataimagesAnnotation File
Objects365v1Objects365 trainobjects365_train.json
MixedGroundingGQAfinal_mixed_train_no_coco.json
Flickr30kFlickr30kfinal_flickr_separateGT_train.json
LVIS-minivalCOCO val2017lvis_v1_minival_inserted_image_name.json

Acknowledgement: We sincerely thank GLIP and mdetr for providing the annotation files for pre-training.