Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction (NeurIPS 2021)
October 31, 2021 ยท View on GitHub
Trained Models and Saliency Maps
We provide the trained models and saliency maps for RGB image based salient object detection and RGB-D image pair based salient object detection with both CNN backbone and transformer backbone.
For RGB image based models, we provide results on six testing datasets: DUTS_Test, ECSSD, DUT, HKU-IS, PASCAL-S and SOD.
Model and results of CNN based model: https://drive.google.com/drive/folders/1Sz-7j2Hl_oaMznkX3gX6v0Trm2WPc6XX?usp=sharing
Model and results of transformer based model: https://drive.google.com/drive/folders/1LQEXdrbiZv_BIbKhPPbeymCkav-jTeZH?usp=sharing
For RGB-D image pair based models, we provide results on six testing datasets: NJU2K, NLPR, LFSD, SIP, DES and STERE.
Model and results of CNN based model: https://drive.google.com/file/d/1vkatlwTjsTQpiw7Or_eV_Q4YKNI-E_LZ/view?usp=sharing
Model and results of transformer based model: https://drive.google.com/file/d/1UV5HBjtYuJnJIKj58r-laP8gjUCAzPTs/view?usp=sharing
Our Bib:
Please cite our paper if necessary:
@inproceedings{jing_ebm_sod21,
title={Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction},
author={Zhang, Jing and Xie, Jianwen and Barnes, Nick and Li, Ping},
booktitle={2021 Conference on Neural Information Processing Systems},
year={2021}
}
Contact
Please drop me an email for further problems or discussion: zjnwpu@gmail.com
Acknowledgment
Thanks Yuxin Mao (maoyuxin@mail.nwpu.edu.cn) for setting up the transformer framework for salient object detection. Please refer to paper below for details:
@article{mao2021transformer,
title={Transformer transforms salient object detection and camouflaged object detection},
author={Mao, Yuxin and Zhang, Jing and Wan, Zhexiong and Dai, Yuchao and Li, Aixuan and Lv, Yunqiu and Tian, Xinyu and Fan, Deng-Ping and Barnes, Nick},
journal={arXiv preprint arXiv:2104.10127},
year={2021}
}