Suppress and Balance: A Simple Gated Network for Salient Object Detection, ECCV 2020 oral (master branch)

Towards Diverse Binary Segmentation via A Simple yet General Gated Network, IJCV 2024 (gatenetv2 branch)

Towards Diverse Binary Segmentation via A Simple yet General Gated Network

IJCV, 2024
Xiaoqi Zhao* · Youwei Pang* · Lihe Zhang · Huchuan Lu · Lei Zhang

Binary Segmentation and Context-dependent (CD) Concepts

More introductions to the CD concept can be found in our Spider and SAM-EVA.

Motivation - Unified Structure and Multi-concept Generalization

We survey 200+ works on binary segmenation of different CD concepts.

• Previous research focused too much on single concept studies
• Repeated designs
• Similar technical challenges

Motivation - Gate Units-v1 vs. Gate Units-v2

GateNetv2 Framework

Single Stream

Two Streams

Datasets

Trained Models

• GateNetv2_res2net50_polyp GitHub Release
• GateNetv2_res2net50_rgbdsod GitHub Release
• GateNetv2_resnet50d_cod GitHub Release
• GateNetv2_resnet50d_duts GitHub Release
• GateNetv2_resnet50d_rgbdsod GitHub Release
• GateNetv2_resnet50d_transparent GitHub Release
• GateNetv2_resnext101_GDD GitHub Release
• GateNetv2_resnext101_istd GitHub Release
• GateNetv2_resnext101_MSD GitHub Release
• GateNetv2_resnext101_sbu GitHub Release
• GateNetv2_vgg16_DBD GitHub Release
• GateNetv2_vgg16_EORSSD GitHub Release
• GateNetv2_vgg16_ORSI_4199 GitHub Release
• GateNetv2_vgg16_ORSSD GitHub Release

Prediction Maps

• RGB Salient Object Detection GitHub Release
• RGBD Salient Object Detection GitHub Release
• ORSI Salient Object Detection [EORSSD] GitHub Release
• ORSI Salient Object Detection [ORSI_4199] GitHub Release
• ORSI Salient Object Detection [ORSSD] GitHub Release
• Camouflaged Object Detection GitHub Release
• Transparent Object Segmentation GitHub Release
• Glass Detection GitHub Release
• Shadow Detection [ISTD] GitHub Release
• Shadow Detection [SBU,UCF] GitHub Release
• Mirror Detection GitHub Release
• Defocus Blur Detction GitHub Release
• Colon Polyp Segmentation GitHub Release

Training

Set the path of training sets in train_GateNetv2_RGB.py or train_GateNetv2_RGB-D.py

python train_GateNetv2_RGB.py / train_GateNetv2_RGB-D.py

Testing

Set the path of testing sets in utils/config.py

python prediction_rgb.py / prediction_rgbd.py

Gatevalue

python compute_gatevalue.py / compute_gatevalue_two_stream.py

Evaluation Tools

• https://github.com/Xiaoqi-Zhao-DLUT/PySegMetric_EvalToolkit

BibTex

@article{GateNetv2,
  title={Towards diverse binary segmentation via a simple yet general gated network},
  author={Zhao, Xiaoqi and Pang, Youwei and Zhang, Lihe and Lu, Huchuan and Zhang, Lei},
  journal={International Journal of Computer Vision},
  volume={132},
  number={10},
  pages={4157--4234},
  year={2024}
}