Stitched LLaMA

This is the official repository of our paper: Efficient Stitchable Task Adaptation.

In this repo, we provide a framework to fine-tune LLaMAs on the instruction-following task and get many Stitched LLaMAs with customized numbers of parameters, e.g., Stitched LLaMA 8B, 9B, and 10B...

The source code will be released soon.