"TDAM: Top-Down Attention Module for Contextually Guided Feature Selection in CNNs"

October 29, 2022 ยท View on GitHub

  • PyTorch implementation for paper "Top-Down Attention Module for Contextually Guided Feature Selection in CNNs" (ECCV 2022; paper).

Poster

  • To run code, ideally create a virtual/conda environment and install requirements listed in requirements.txt by running:
pip install -r requirements.txt
  • For module usage and performing training/analysis, please see provided scripts in training_and_analysis_scripts directory (specifically TDAM_usage_and_visualization.ipynb with instructions in that directory's README.md.

  • For just the module and model integration/implementation code, please see modules_and_models directory.

ImageNet-1k pre-trained models

ModelTop-1(%)Top-5(%)GoogleDrive
TDAM(t2,m2)-RNet1872.1690.61TD_ResNet18
TDAM(t2,m2)-RNet3475.7592.58TD_ResNet34
TDAM(t2,m1)-RNet5078.9694.19TD_ResNet50
TDAM(t2,m1)-RNet10181.6295.76TD_ResNet101

Citation

@inproceedings{jaiswal2022tdam,
 title={TDAM: Top-Down Attention Module for Contextually Guided Feature Selection in CNNs},
 author={Jaiswal, Shantanu and Fernando, Basura and Tan, Cheston},
 booktitle={European Conference on Computer Vision},
 pages={259--276},
 year={2022},
 organization={Springer}
}

Code environment

The codebase and associated experiments are performed in following environment:

  • OS: Ubuntu 20.04.4 LTS
  • CUDA: 11.4
  • GPU: NVIDIA Tesla V100 DGXS (16GB)
  • Python: 3.8.10
  • Python packages/toolkits: See requirements.txt

Acknowledgement

The codebase utilizes the timm and torchvision libraries.

License

This project's codebase is released under the MIT license. Please see the LICENSE file for more information.

Contact Information

In case of any suggestions or questions, please leave a message here or contact me directly at jaiswals@ihpc.a-star.edu.sg, thanks!