ilotoki_thu/alpaca_lora_4bit
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

optimized attention and mlp for performance, add lora monkey patch for models here and GPTQ_For_Llama models using optimization

Browse Source
This commit is contained in:
John Smith
2023-04-22 15:18:54 +08:00
parent 35caccd376
commit de3c91834e
4 changed files with 365 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
.gitignore vendored
View File

@@ -5,3 +5,6 @@ llama-13b-4bit
llama-13b-4bit.pt
text-generation-webui/
repository/
build/
dist/
*.egg-info*