Multi-task Self-supervised Object Detection

April 22, 2019 ยท View on GitHub

This is an implementation of CVPR 2019: "Multi-task Self-supervised Object Detection via Recycling of Bounding Box Annotations" This is a novel object detection approach that takes advantage of both multi-task learning (MTL) and self-supervised learning (SSL). We propose a set of auxiliary tasks that help improve the accuracy of object detection.

The code is modified from Tensorflow Object Detection API.

Table of contents

Evaluation of models

Model name (baseline/ours)DetectorBackboneTrainingEvalBaselineOurs
model11 / model12Faster R-CNNResNet101VOC 07 trainvalVOC 07 test77.078.7
model21 / model22Faster R-CNNResNet101COCO 2017 trainCOCO 2017 val32.734.6
model31 / model32Faster R-CNNResNet101VOC 07+12 trainvalVOC 07 test81.783.7
model41 / model42R-FCNResNet101VOC 07 trainvalVOC 07 test73.574.7
model51 / model52Faster R-CNNMobileNetVOC 07 trainvalVOC 07 test61.263.8
model61 / model62Faster R-CNNInception ResNet v2VOC 07 trainvalVOC 07 test80.781.8
model71 / model72R-FCNResNet101VOC 07+12 trainvalVOC 07 test78.680.6
model81 / model82Faster R-CNNMobileNetVOC 07+12 trainvalVOC 07 test68.670.8
model91 / model92Faster R-CNNInception ResNet v2VOC 07+12 trainvalVOC 07 test84.386.0