ilotoki_thu
/
alpaca_lora_4bit
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
86 Commits 1 Branch 0 Tags 599 KiB
Commit Graph

7 Commits

Author SHA1 Message Date
Andrey Glushenkov f20570343f
GPTQv2 support 
GPTQv2 support.
1. Adds dependency on `triton`
2. Refactors autograd_4bit to include both GPTQv1 and GPTQv2
3. Introduces new environment variable GPTQ_VERSION to select autograd_4bit version
4. Fixes triton kernels
5. Matrix multiplications are in fp16
 2023-04-06 02:29:36 +03:00
Wing Lian b47da33084 fixes for most recent update 2023-03-28 10:56:35 -04:00
Wing Lian 101d314bd9 add missing dependency to train with LlamaTokenizer 2023-03-27 16:13:46 -04:00
Wing Lian 62e54ac1c7 backwards support for pre-py3.10, add datasets requirement used in train 2023-03-27 16:08:20 -04:00
Star Dorminey 96440c8717 Removing submodules actually. 2023-03-25 20:20:38 -07:00
John Smith dc036373b2 add more scripts and adjust code for transformer branch 2023-03-22 04:09:04 +00:00
John Smith 551f62a0e8
add patch for gptq and peft 2023-03-18 13:31:48 +08:00