ilotoki_thu
/
alpaca_lora_4bit
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Update README.md

This commit is contained in:
John Smith 2023-03-31 14:17:35 +08:00 committed by GitHub
parent dd0efc721f
commit 00bf0a1e1b
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@ -16,9 +16,9 @@ Made some adjust for the code in peft and gptq for llama, and make it possible f
* Added offload support. load_llama_model_4bit_low_ram_and_offload_to_cpu function can be used.
# Requirements
gptq-for-llama: https://github.com/qwopqwop200/GPTQ-for-LLaMa<br>
peft: https://github.com/huggingface/peft.git<br>
<br>
gptq-for-llama <br>
peft<br>
The specific version is inside requirements.txt<br>
# Install
~copy files from GPTQ-for-LLaMa into GPTQ-for-LLaMa path and re-compile cuda extension~<br>