From 71cd6d55337b1541f602c1afffa6baf6dd75b09c Mon Sep 17 00:00:00 2001 From: Michael Feil <63565275+michaelfeil@users.noreply.github.com> Date: Tue, 31 Dec 2024 09:32:22 +0100 Subject: Flash-Attn upgrade / SoftCap Candle-FlashAttn [1/n] (#2688) * update flash-attn v1 * restore: hdim224 * add 224 flash_fwd_template * remove whitespace --- candle-flash-attn/kernels/flash_fwd_hdim32_bf16_causal_sm80.cu | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to 'candle-flash-attn/kernels/flash_fwd_hdim32_bf16_causal_sm80.cu') diff --git a/candle-flash-attn/kernels/flash_fwd_hdim32_bf16_causal_sm80.cu b/candle-flash-attn/kernels/flash_fwd_hdim32_bf16_causal_sm80.cu index 29097ac3..e21d0408 100644 --- a/candle-flash-attn/kernels/flash_fwd_hdim32_bf16_causal_sm80.cu +++ b/candle-flash-attn/kernels/flash_fwd_hdim32_bf16_causal_sm80.cu @@ -1,4 +1,4 @@ -// Copyright (c) 2023, Tri Dao. +// Copyright (c) 2024, Tri Dao. // Splitting the different head dimensions to different files to speed up compilation. // This file is auto-generated. See "generate_kernels.py" -- cgit v1.2.3