ilotoki_thu/alpaca_lora_4bit
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Commit Graph

  • 5986649b37 Update README.md John Smith 2023-03-29 14:46:28 +08:00
  • 1c02d4262d add resume checkpoint to continue a training John Smith 2023-03-29 14:35:39 +08:00
  • 2a1cb42966 add padding support as an option John Smith 2023-03-29 11:20:16 +08:00
  • cff57ebfa4 Merge pull request #39 from winglian/fix-prompt-eos-token John Smith 2023-03-29 10:35:46 +08:00
  • daad59f8ef properly include the eos token so inference doesn't blabber on Wing Lian 2023-03-28 20:53:16 -04:00
  • 1719bd0ce3 fix bug John Smith 2023-03-29 08:09:40 +08:00
  • 1043ded7d9 Merge branch 'main' of github.com:johnsmith0031/alpaca_lora_4bit John Smith 2023-03-29 01:26:20 +08:00
  • d28ee06202 fix bug John Smith 2023-03-29 01:25:37 +08:00
  • b5e3dae573 Merge pull request #34 from winglian/v2-fixes John Smith 2023-03-28 23:49:56 +08:00
  • b47da33084 fixes for most recent update Wing Lian 2023-03-28 10:56:35 -04:00
  • 234004ceb5 fix bug John Smith 2023-03-28 22:05:18 +08:00
  • f26615fc0c fix bug John Smith 2023-03-28 21:47:22 +08:00
  • 0768d0fdff update finetune data format John Smith 2023-03-28 21:45:33 +08:00
  • 8a6c8661df Merge branch 'main' of github.com:johnsmith0031/alpaca_lora_4bit merged John Smith 2023-03-28 21:14:35 +08:00
  • 211af574b6 fix bug John Smith 2023-03-28 21:12:51 +08:00
  • ac07457473 Update README.md John Smith 2023-03-28 20:44:02 +08:00
  • bff039de95 add v2 model support John Smith 2023-03-28 20:33:55 +08:00
  • 667e43cb5b Merge pull request #30 from winglian/features/python-fixes John Smith 2023-03-28 09:34:50 +08:00
  • 101d314bd9 add missing dependency to train with LlamaTokenizer Wing Lian 2023-03-27 16:13:46 -04:00
  • 62e54ac1c7 backwards support for pre-py3.10, add datasets requirement used in train Wing Lian 2023-03-27 16:08:20 -04:00
  • 6c8c07e7ad Update README.md John Smith 2023-03-27 18:03:28 +08:00
  • cf94d7af68 Update README.md John Smith 2023-03-27 17:52:35 +08:00
  • 1ca9b8abf8 Update README.md John Smith 2023-03-27 17:51:04 +08:00
  • 0b5b376de1 Merge pull request #23 from sterlind/star/repos John Smith 2023-03-27 17:47:39 +08:00
  • 399c3d124e Tested and should be ready! Star Dorminey 2023-03-25 20:52:38 -07:00
  • a2a4c1d117 Remove gitmodules. Star Dorminey 2023-03-25 20:23:46 -07:00
  • 96440c8717 Removing submodules actually. Star Dorminey 2023-03-25 20:20:38 -07:00
  • 17f3da744c Fix repos. Star Dorminey 2023-03-25 20:16:48 -07:00
  • 8e705eddcb Add GPTQ and peft as submodules. Star Dorminey 2023-03-25 20:00:13 -07:00
  • 82dd6dd13e Merge pull request #20 from kooshi/multi-gpu John Smith 2023-03-25 15:06:01 +08:00
  • 8e471516b8 distributed data parallelism with torchrun kooshi 2023-03-24 23:56:06 -05:00
  • 2bc64597aa model parallelism kooshi 2023-03-24 23:03:43 -05:00
  • cd1a299ba3 Merge pull request #18 from s4rduk4r/finetune-refactor John Smith 2023-03-25 10:29:36 +08:00
  • 0879580006 Merge branch 'main' into finetune-refactor John Smith 2023-03-25 10:29:02 +08:00
  • e64bd6a214 Create LICENSE John Smith 2023-03-25 10:17:44 +08:00
  • 397f5041c3 Reflect last changes in main Andrey Glushenkov 2023-03-24 15:46:03 +03:00
  • 50dbb101e9 Refactor finetune.py Andrey Glushenkov 2023-03-24 14:15:07 +03:00
  • 4906961bf1 fix bug John Smith 2023-03-23 23:37:39 +08:00
  • 94851cec68 Merge pull request #14 from Ph0rk0z/AtomicAddHalf John Smith 2023-03-23 20:40:29 +08:00
  • 58998acc9f Fix cuda kernel for Pascal & Cuda 6/6.1 Forkoz 2023-03-23 07:33:57 -05:00
  • 60b227d0ba fix minor bug John Smith 2023-03-23 08:43:18 +00:00
  • 619a177fbb Update README.md John Smith 2023-03-23 16:31:49 +08:00
  • 44978669cf Add gradient checkpointing John Smith 2023-03-23 08:25:29 +00:00
  • eb8ce878d4 Merge pull request #6 from sterlind/patch-1 John Smith 2023-03-22 16:07:25 +08:00
  • 9b04b8eec6 add monkey patch for webui John Smith 2023-03-22 07:58:51 +00:00
  • 0aea8f45e3 Fix path to autograd_4bit.py in install.sh sterlind 2023-03-22 00:24:52 -07:00
  • 45d2f22c14 Update README.md John Smith 2023-03-22 14:56:50 +08:00
  • cab067fef9 Update README.md John Smith 2023-03-22 14:55:24 +08:00
  • 02bd0338f1 add data John Smith 2023-03-22 12:13:34 +08:00
  • dc036373b2 add more scripts and adjust code for transformer branch John Smith 2023-03-22 04:09:04 +00:00
  • a955a1c2a5 fix bug John Smith 2023-03-22 00:18:24 +08:00
  • 467849d13a Merge branch 'main' of https://github.com/johnsmith0031/alpaca_lora_4bit John Smith 2023-03-21 09:45:06 +00:00
  • ef0a326cec update autograd John Smith 2023-03-21 09:41:18 +00:00
  • 3be75bb3db Update README.md John Smith 2023-03-21 16:49:08 +08:00
  • 8d198e0171 Update README.md John Smith 2023-03-21 16:48:17 +08:00
  • 3471be4e56 add fast_4bit_matmul and auto switch 2 methods according to bottleneck John Smith 2023-03-21 08:43:07 +00:00
  • dd0d5a31f7 add half support John Smith 2023-03-20 09:37:51 +00:00
  • 5b64833390 add half support on cuda kernel John Smith 2023-03-20 09:19:05 +00:00
  • 5c1411ff18 Update README.md John Smith 2023-03-20 15:04:18 +08:00
  • 04f5575a23 reduced memory usage by a little John Smith 2023-03-20 00:51:52 +08:00
  • 2b84b32fbe Update autograd_4bit.py John Smith 2023-03-18 22:13:11 +08:00
  • 6f4bbb40a9 Update autograd_4bit.py John Smith 2023-03-18 18:49:26 +08:00
  • fecce0e1a5 Update README.md John Smith 2023-03-18 18:21:01 +08:00
  • ae04f88e57 Update README.md John Smith 2023-03-18 13:36:06 +08:00
  • bbaf1b1bf5 Update README.md John Smith 2023-03-18 13:35:36 +08:00
  • 551f62a0e8 add patch for gptq and peft John Smith 2023-03-18 13:31:48 +08:00
  • 326bc9214a Update README.md John Smith 2023-03-18 13:26:04 +08:00
  • 42118e3267 Initial commit John Smith 2023-03-18 13:21:20 +08:00