From 326bc9214ab9da6c4089b03e3cd037929e63418f Mon Sep 17 00:00:00 2001 From: John Smith Date: Sat, 18 Mar 2023 13:26:04 +0800 Subject: [PATCH] Update README.md --- README.md | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 2afa12b..1e4c489 100644 --- a/README.md +++ b/README.md @@ -1 +1,9 @@ -# alpaca_lora_4bit \ No newline at end of file +# alpaca_lora_4bit + +Made some adjust for the code in peft and gptq for llama, and make it possible for lora finetuning with a 4 bits base model. The same adjustment can be made for 2, 3 and 8 bits. + +# packages required +gptq-for-llama: https://github.com/qwopqwop200/GPTQ-for-LLaMa + + +