result_det.md

August 19, 2021 ยท View on GitHub

Here lists selected experiment result. The performance is potentially being better if more effort is paid on tuning. See experience.md to communicate training skills.

Detection

For training and inference instructions, refer detectron2.md. As the project is keeping upgrading, the pretrained model provided on Google Drive might show better performance compared with the one in table. For more details, please refer to our paper.

DatasetTask MethodQuantization methodModelA/WReportedAPFlags
COCORetina-Net-Torch-1832/32-31.51x
COCORetina-Net-Torch-1832/32-32.81x, FPN-BN,Head-GN
COCORetina-Net-Torch-1832/32-33.01x, FPN-BN,Head-BN
COCORetina-Net-Torch-3432/32-35.21x
COCORetina-Net-Torch-5032/32-36.61x
COCORetina-Net-Torch-5032/32-37.81x, FPN-BN,Head-BN
COCORetina-Net-MSRA-R5032/32-36.41x
COCORetina-Net-Torch-184/4-34.01x,Full-BN, Quantize-All
COCORetina-Net-Torch-183/3-32.81x,Full-BN, Quantize-All
COCORetina-Net-Torch-182/2-29.61x,Full-BN, Quantize-All
COCORetina-Net-Torch-344/4-37.01x,Full-BN, Quantize-All
COCORetina-Net-Torch-343/3-35.91x,Full-BN, Quantize-All
COCORetina-Net-Torch-342/2-33.11x,Full-BN, Quantize-All
COCOFCOS-MSRA-R5032/32-38.61x
COCOFCOS-Torch-5032/32-38.41x
COCOFCOS-Torch-5032/32-38.51x,FPN-BN
COCOFCOS-Torch-5032/32-38.91x,FPN-BN,Head-BN
COCOFCOS-Torch-3432/32-37.31x
COCOFCOS-Torch-1832/32-32.21x
COCOFCOS-Torch-1832/32-33.41x,FPN-BN
COCOFCOS-Torch-1832/32-33.91x,FPN-BN, FP16
COCOFCOS-Torch-1832/32-33.91x,FPN-BN,Head-BN
COCOFCOS-Torch-1832/32-34.31x,FPN-SyncBN,Head-SyncBN
COCOFCOS-Torch-184/4-35.21x,FPN-BN, Quantize-All, double-init
COCOFCOS-Torch-183/3-34.11x,FPN-BN, Quantize-All, double-init
COCOFCOS-Torch-182/2-33.41x,FPN-BN, Quantize-Backbone, double-init
COCOFCOS-Torch-182/2-32.01x,FPN-BN, Quantize-All, singe-pass-init
COCOFCOS-Torch-182/2-30.31x,FPN-BN, Quantize-All, double-init
COCOFCOSLQ-NetTorch-18ter/ter-32.61x,FPN-BN, Quantize-Backbone, double-init
COCOFCOSLQ-NetTorch-18ter/ter-26.21x,FPN-BN, Quantize-All, double-init

Flags:

FPN-BN indicates adding BN and RELU in the FPN; FP16 implies the case is trained in FP16 (half float) mode; Head-BN represents the prospoal header employes non shared BatchNorm. Full-BN indicates combining FPN-BN and Head-BN. Torch-18/34/50 means the backbone is the Pytorch ResNet-18/34/50.