4 Commits

Author	SHA1	Message	Date
John Smith	4261bd8070	add xformers support	2023-04-12 12:59:44 +08:00
yamashi	2bf5d42f28	Add position_ids to flash attention	2023-04-06 17:46:15 +02:00
yamashi	7770e76c9c	Fix args of flash attention	2023-04-06 17:32:01 +02:00
yamashi	7b18b39dd8	Create llama_flash_attn_monkey_patch.py	2023-04-06 13:49:36 +02:00