4 Commits

Author	SHA1	Message	Date
Wing Lian	c2b33bacc9	use monkey patch instead of forked peft	2023-04-09 11:40:58 -04:00
yamashi	2bf5d42f28	Add position_ids to flash attention	2023-04-06 17:46:15 +02:00
yamashi	7770e76c9c	Fix args of flash attention	2023-04-06 17:32:01 +02:00
yamashi	7b18b39dd8	Create llama_flash_attn_monkey_patch.py	2023-04-06 13:49:36 +02:00