Instance As Identity: A Generic Online Paradigm for Video Instance Segmentation

September 19, 2022 ยท View on GitHub

Introduction

This repo is the official implementation of IAI paradigm for video instance segmentation. The overview of IAI paradigm is shown below.

Visualization on YTVIS-2019 & OVIS

Performance

DatasetModel NameBackbonemAPFPSFPS (4GPUs)
YTVIS2019IAI+CondInstR5039.932101
YTVIS2019IAI+CondInstR10143.72896
YTVIS2021IAI+CondInstR5038.030109
OVISIAI+CondInstR5020.61450

Installation

Please refer to INSTALL.md for installation instructions.

Getting Started

Please refer to Preparing Dataset.

Please refer to Getting Started with IAI.

Citation

@inproceedings{iai,
  title={Instance As Identity: A Generic Online Paradigm for Video Instance Segmentation},
  author={Zhu, Feng and Yang, Zongxin and Yu, Xin and Yang, Yi and Wei, Yunchao},
  booktitle={ECCV},
  year={2022},
}

Acknowledegement

This repo is based on MMDetection and AOT. Thanks for their wonderful works.