PELA: Learning Parameter-Efficient Models with Low-Rank Approximation [CVPR 2024]

Code contribution:

• Yangyang Guo -- ALBEF
• Guangzhi Wang -- DeiT and Swin.

Detailed configuration of each model can be found on each model directory.

Acknowledgement

If you found this repo helpful, please consider cite the following paper:

@inproceedings{pela,
  author       = {Yangyang Guo and Guangzhi Wang and Mohan Kankanhalli},
  title        = {PELA: Learning Parameter-Efficient Models with Low-Rank Approximation},
  booktitle    = {CVPR},
  year         = {2024}
}