README.md

January 28, 2025 ยท View on GitHub

Dataset

To download and prepare the ADE20K dataset, execute the following commands:

wget http://data.csail.mit.edu/places/ADEchallenge/ADEChallengeData2016.zip
unzip -q ADEChallengeData2016.zip
rm ADEChallengeData2016.zip

Then in config/base/datasets/ade20k.py, change data_root path to dataset

Training

FastVimT: ./segmentation/tools/dist_train.sh "segmentation/configs/FastVim/uppernet_FastVim_tiny_noclstok_rotate_layernorm_8xb2-160k_ade20k-512x512.py" 8 "path_to_imagenet_supervised_ckpt" 

FastVimS: ./segmentation/tools/dist_train.sh "segmentation/configs/FastVim/uppernet_FastVim_small_noclstok_rotate_layernorm_8xb2-160k_ade20k-512x512.py" 8 "path_to_imagenet_supervised_ckpt" 

FastVimB: ./segmentation/tools/dist_train.sh "segmentation/configs/FastVim/uppernet_FastVim_base_noclstok_rotate_layernorm_8xb2-160k_ade20k-512x512.py" 8 "path_to_imagenet_supervised_ckpt" 

Model weights and configurations

ModelmIOU
FastVim-T.ckpt41.8
FastVim-S.ckpt44.9
FastVim-B.ckpt47.8