Parameter-Efficient Transfer Learning on Vision Transformers

August 1, 2023 ยท View on GitHub

Some exploration of Parameter-Efficient Transfer Learning in vision.

  • Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy

    • [ICCV 2023] Arxiv link Github link

  • FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer

    • [AAAI 2023 Oral] Arxiv link Github link

  • Convolutional Bypasses Are Better Vision Transformer Adapters

    • [Tech Report 2022] Arxiv link Github link