Commit Graph

4 Commits

Author SHA1 Message Date
John Smith
de3c91834e optimized attention and mlp for performance, add lora monkey patch for models here and GPTQ_For_Llama models using optimization 2023-04-22 15:36:56 +08:00
John Smith
dba3773b30 add triton backend support for v2 model 2023-04-07 15:34:06 +08:00
Star Dorminey
17f3da744c Fix repos. 2023-03-25 20:16:48 -07:00
kooshi
8e471516b8 distributed data parallelism with torchrun 2023-03-24 23:56:06 -05:00