SROSDA (ICCV 2021)

June 13, 2023 · View on GitHub

implementation of the ICCV work Towards Novel Target Discovery Through Open-Set Domain Adaptation [Paper].

:zap: Please check the extension journal work "Interpretable Novel Target Discovery Through Open-Set Domain Adaptation" (XSR-OSDA).

image

Data Preparation


DatasetDomainRole#Images#Attributes#Classes
D2AwAA
P
R
source / target9,343 / 16,306
3,441 / 5,760
5,251 / 10,047
8510 / 17
I2AwAI
Aw
source / target2,970 / 37,3228540 / 50

(1) To extract pre-trained ResNet-50 features, check script:

./data/N2AwA/features/extract_resnet_features.ipynb

(2) Collect attributes for all samples based on their labels, check script:

./data/N2AwA/attributes/check_N2AwA_data.ipynb

Dependencies


  • Python 3.6
  • Pytorch 1.1

Training


Step 1: Initialization clustering on target data (Seen/Unseen Initialization)

./data/N2AwA/refine_cluster-samples.ipynb

Note: Or use our clustering initialization results ./data/N2AwA/ directly.

Step 2: Train with the initialized clustering and pseudo labels on the extracted features.

python main.py

Evaluation


  • Open-set Domain Adaptation Task

OSOS^*: class-wise average accuracy on the seen categories.

OSOS^\diamond: class-wise average accuracy on the unseen categories correctly classified as "unknown".

OSOS: OS×Cshr+OSCshr+1\frac{OS^* \times C_{shr} + OS^\diamond}{C_{shr} + 1}

CshrC_{shr} is the number of shared categories between the source and target domains.

  • Semantic-Recovery Open-Set Domain Adaptation Task

SS: class-wise average accuracy on shared classes

UU: class-wise average accuracy on unknown classes

H=2×S×US+UH = \frac{2 \times S \times U}{ S + U}

Citation


If you think this work is interesting, please cite:

@InProceedings{Jing_2021_ICCV,
author = {Jing, Taotao and Liu, Hongfu and Ding, Zhengming},
title = {Towards Novel Target Discovery Through Open-Set Domain Adaptation},
booktitle = {International Conference on Computer Vision (ICCV)},
year = {2021}
}

Contact


If you have any questions about this work, feel free to contact