TL;DR: We present a novel, training-free approach to scene change detection by leveraging a tracking model.

Prerequisites

Environmental Setup

conda env create -f environment.yml
conda activate zsscd

Pretrained Weights

• Download the DEVA weights from this repository or use the bash command:

wget -P ./model_weights/ https://github.com/hkchengrex/Tracking-Anything-with-DEVA/releases/download/v1.0/DEVA-propagation.pth

• Download the SAM weights from this repository or use the bash command:

wget -P ./model_weights/ https://dl.fbaipublicfiles.com/segment_anything/sam_vit_h_4b8939.pth

• Place the downloaded weights in the model_weights folder.

Dataset Preparation

Download the datasets and set the file structure as follows.
Only the test set is required.
Edit dataset/path_config.py to set the dataset directory path.

ChangeSim
├── Query
│   └── Query_Seq_Test
│       ├── Warehouse_6
│       │   ├── Seq_0
│       │   │   └── ...
│       │   └── Seq_1
│       │       └── ...
│       ├──  ...
│       │
│       └── Warehouse_8
│           ├── Seq_0
│           │   └── ...
│           └── Seq_1
│               └── ...
│
└── Ref
    └── Ref_Seq_Test
        ├── Warehouse_6
        │   ├── Seq_0
        │   │   └── ...
        │   └── Seq_1
        │       └── ...
        ├──  ...
        │
        └── Warehouse_8
            ├── Seq_0
            │   └── ...
            └── Seq_1
                └── ...

VL-CMU-CD-binary255
└── test
    ├── t0
    ├── t1
    └── mask

PCD
├── TSUNAMI
│   ├── t0
│   ├── t1
│   ├── ground_truth
│   └── mask
└── GSV
    ├── t0
    ├── t1
    ├── ground_truth
    └── mask

Evaluation

• ChangeSim

$ python main.py
$ python main.py --changesim_subset dark
$ python main.py --changesim_subset dust

• VL_CMU_CD

$ python main.py --dataset VL_CMU_CD

• PCD

$ python main.py --dataset TSUNAMI
$ python main.py --dataset GSV

Acknowledgements

Our PyTorch-based implementation is based on the following projects and repos.

• Segment Anything
• DEVA
• GCDSS

Cite

Please cite our paper if our work is helpful to your research:

@inproceedings{cho2025zero,
  title={Zero-shot scene change detection},
  author={Cho, Kyusik and Kim, Dong Yeop and Kim, Euntai},
  booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
  volume={39},
  number={3},
  pages={2509--2517},
  year={2025}
}