diff --git a/README.md b/README.md index 2afa12b..1e4c489 100644 --- a/README.md +++ b/README.md @@ -1 +1,9 @@ -# alpaca_lora_4bit \ No newline at end of file +# alpaca_lora_4bit + +Made some adjust for the code in peft and gptq for llama, and make it possible for lora finetuning with a 4 bits base model. The same adjustment can be made for 2, 3 and 8 bits. + +# packages required +gptq-for-llama: https://github.com/qwopqwop200/GPTQ-for-LLaMa + + +