diff options
| author | Michael Feil <63565275+michaelfeil@users.noreply.github.com> | 2024-12-31 10:04:47 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-12-31 10:04:47 +0100 |
| commit | 2a705e6f3739cd43b40139b1ee58141b733bcfc1 (patch) | |
| tree | 13cc9822fc8b9e471335243651ccbd0bcbb4159f /candle-flash-attn/kernels/flash_fwd_hdim64_fp16_causal_sm80.cu | |
| parent | a594ef669ca5ed82c1f19d2230b4b3dc9cb46f43 (diff) | |
| download | candle-2a705e6f3739cd43b40139b1ee58141b733bcfc1.tar.gz candle-2a705e6f3739cd43b40139b1ee58141b733bcfc1.tar.bz2 candle-2a705e6f3739cd43b40139b1ee58141b733bcfc1.zip | |
Flash-Attn upgrade / SoftCap Candle-FlashAttn [3/n] (#2690)
* update flash-attn v1
* restore: hdim224
* add 224 flash_fwd_template
* remove whitespace
* softcap is working, including test and api.
* make softcap test case better
* unpadded lse added
Diffstat (limited to 'candle-flash-attn/kernels/flash_fwd_hdim64_fp16_causal_sm80.cu')
0 files changed, 0 insertions, 0 deletions