Commit Graph

5 Commits

Author SHA1 Message Date
John Smith 0768d0fdff update finetune data format 2023-03-28 21:45:33 +08:00
John Smith bff039de95 add v2 model support 2023-03-28 20:33:55 +08:00
kooshi 8e471516b8
distributed data parallelism with torchrun 2023-03-24 23:56:06 -05:00
Andrey Glushenkov 397f5041c3
Reflect last changes in main
Reflect commits:
4906961bf1
60b227d0ba
2023-03-24 15:46:03 +03:00
Andrey Glushenkov 50dbb101e9
Refactor finetune.py
1. Add command line arguments support
2. Add Stanford Alpaca-like dataset support. Used code from - https://github.com/tloen/alpaca-lora
3. Fix LoRA pre-train application
2023-03-24 14:15:07 +03:00