FineTuning_Qlora.md

Fine-tuning Phi-3 with QLoRA

Fine-tuning Microsoft’s Phi-3 Mini language model using QLoRA (Quantum Low-Rank Adaptation).

QLoRA will help improve conversational understanding and response generation.

To load models in 4bits with transformers and bitsandbytes, you have to install accelerate and transformers from source and make sure you have the latest version of the bitsandbytes library.

Samples

• Learn More with this sample notebook
• Example of Python FineTuning Sample
• Example of Hugging Face Hub Fine Tuning with LORA
• Example of Hugging Face Hub Fine Tuning with QLORA