Commit Graph

3 Commits

Author SHA1 Message Date
yamashi 2bf5d42f28
Add position_ids to flash attention 2023-04-06 17:46:15 +02:00
yamashi 7770e76c9c
Fix args of flash attention 2023-04-06 17:32:01 +02:00
yamashi 7b18b39dd8
Create llama_flash_attn_monkey_patch.py 2023-04-06 13:49:36 +02:00