LoRA

April 5, 2023 ยท View on GitHub

Efficient-Finetuning Method: LoRA: Low-Rank Adaptation of Large Language Models

Training Step

bash alpaca/scripts/lora/run_train.sh

Inference Step

  • (Batch-Level) Please prepare the test file.

    bash alpaca/scripts/lora/inference/run_inf.sh

  • (Instance-Level) Using alpaca/src/inference.py line 17 to set prompts.

    bash alpaca/scripts/lora/inference/run_inf_hub.sh

Contents

  1. 1Training Step
  2. 2Inference Step