Benchmarks and Checkpoints

August 14, 2022 ยท View on GitHub

Each zip file contains 4 types of files

  • a checkpoint of the model, typically, named as model_best.pth.tar
  • the md5 of the checkpoint
  • a hyper-parameter json file, typically, named as hparams_train.json
  • tensorboard log file, you can use tensorboard to visualize the log. It is in the val directory within the zip file.

Hope you have fun with these checkpoints. Any issues about checkpoints should be raised at checkpoints.

ImageNet

General training protocols: batch size 256, epochs 120, cos learning rate 0.1, AutoAugment/RandAugment, Label smoothing, mixup, random erasing.

MethodsTop-1/Top-5 AccMParams/GFLOPsCheckpoints
ResNet-50, 224px78.84 / 94.4725.7 / 5.5resnet50_split1_imagenet_256_06
SE-ResNet-50, 224px79.47 / 94.5428.2 / 4.9se_resnet50_split1_imagenet_256_01
ResNeXSt-50, 4x16d, 224px79.85 / 94.9817.8 / 4.3resnexst50_4x16d_split1_imagenet_256_01
ResNeXSt-50, 8x16d, 224px80.90 / 95.3630.5 / 6.8resnexst50_8x16d_split1_imagenet_256_03
ResNeXSt-50, 4x32d, 224px81.10 / 95.4937.1 / 8.3resnexst50_4x32d_split1_imagenet_256_05
ResNet-110, 224px80.16 / 94.5444.8 / 9.2resnet101_split1_imagenet_256_01
WRN-50-2, 224px80.66 / 95.1668.9 / 12.8wide_resnet50_2_split1_imagenet_256_01
WRN-50-2, S=2, 224px79.64 / 94.8251.4 / 10.9wide_resnet50_2_split2_imagenet_256_02
WRN-50-3, 224px80.74 / 95.40135.0 / 23.8wide_resnet50_3_split1_imagenet_256_01
WRN-50-3, S=2, 224px81.42 / 95.62138.0 / 25.6wide_resnet50_3_split2_imagenet_256_02
ResNeXt-101, 64x4d, 224px81.57 / 95.7383.6 / 16.9resnext101_64x4d_split1_imagenet_256_01
ResNeXt-101, 64x4d, S=2, 224px82.13 / 95.9888.6 / 18.8resnext101_64x4d_split2_imagenet_256_02
EfficientNet-B7, 320px81.83 / 95.7866.7 / 10.6efficientnetb7_split1_imagenet_128_03
EfficientNet-B7, S=2, 320px82.74 / 96.3068.2 / 10.5efficientnetb7_split2_imagenet_128_02
SE-ResNeXt-101, 64x4d, S=2, 416px, 120 epochs83.34 / 96.6198.0 / 61.1se_resnext101_64x4d_split2_imagenet_128_02
SE-ResNeXt-101, 64x4d, S=2, 320px, 350 epochs83.60 / 96.6998.0 / 38.2se_resnext101_64x4d_B_split2_imagenet_128_05

CIFAR-100

MethodsTop-1 AccMParams/GFLOPsCheckpoints
WRN-28-1084.5036.5 / 5.25wide_resnet28_10_split1_cifar100_128_01_acc84.5
WRN-28-10, S=285.5235.8 / 5.16wide_resnet28_10_split2_cifar100_128_02_acc85.52
WRN-28-10, S=485.7436.7 / 5.28wide_resnet28_10_split4_cifar100_128_03_acc85.74
WRN-40-1083.9855.9 / 8.08wide_resnet40_10_split1_cifar100_128_06_acc83.98
WRN-40-10, S=285.9154.8 / 7.94wide_resnet40_10_split2_cifar100_128_05_acc85.91
WRN-40-10, S=486.9056.0 / 8.12wide_resnet40_10_split4_cifar100_128_04_acc86.90
DenseNet-BC-19085.9025.8 / 9.39densenet190_split1_cifar100_64_01_acc85.90
DenseNet-BC-190, S=287.3625.5 / 9.24densenet190_split2_cifar100_128_02_acc87.36
DenseNet-BC-190, S=487.4426.3 / 9.48densenet190_split4_cifar100_64_03_acc87.44
PyramidNet-27288.9826.8 / 4.55pyramidnet272_split1_cifar100_128_01_88.98
PyramidNet-272, S=289.2528.9 / 5.24pyramidnet272_split2_cifar100_128_06_acc89.25
PyramidNet-272, S=489.4632.8 / 6.33pyramidnet272_split4_cifar100_128_07_acc89.46

CIFAR-10

MethodsTop-1 AccMParams/GFLOPsCheckpoints
WRN-28-1097.5936.5 / 5.25wide_resnet28_10_split1_cifar10_128_08_acc97.59
WRN-28-10, S=298.1935.8 / 5.16wide_resnet28_10_split2_cifar10_128_07_acc98.19
WRN-28-10, S=498.3236.5 / 5.28wide_resnet28_10_split4_cifar10_128_24_acc98.32
WRN-40-1097.8155.8 / 8.08wide_resnet40_10_split1_cifar10_128_04_acc97.81
WRN-40-10, S=498.3855.9 / 8.12wide_resnet40_10_split4_cifar10_128_05_acc98.38
Shake-Shake 26 2x96d98.0026.2 / 3.78shake_resnet26_2x96d_split1_cifar10_128_07_acc98.00
Shake-Shake 26 2x96d, S=298.2523.3 / 3.38shake_resnet26_2x96d_split2_cifar10_128_12
Shake-Shake 26 2x96d, S=498.3126.3 / 3.81shake_resnet26_2x96d_split4_cifar10_128_09
PyramidNet-27298.6726.2 / 4.55pyramidnet272_split1_cifar10_128_01_acc98.67
PyramidNet-272, S=498.7132.6 / 6.33pyramidnet272_split4_cifar10_128_05_acc98.71

COCO val2017 (SSD300)

BackbonesmAPMParams/GFLOPsCheckpoints
WRN-50-230.339.3 / 48.1ssd300_coco_ssdv2_02
WRN-50-2, S=229.931.7 / 45.3ssd300_coco_ssdv2_06
WRN-50-330.764.1 / 86.8ssd300_coco_ssdv2_07
WRN-50-3, S=231.664.3 / 96.3ssd300_coco_ssdv2_09
ResNeXt-101, 64x4d32.668.9 / 90.1ssd300_coco_ssdv2_14
ResNeXt-101, 64x4d, S=234.169.8 / 100.5ssd300_coco_ssdv2_15