diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-07-26 20:56:00 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-26 20:56:00 +0100 |
| commit | 4f92420132d831e5d344f974c263c9f341e50906 (patch) | |
| tree | a43610e4869d0d814248e6cbcdd4242dc85eadf9 /candle-flash-attn/Cargo.toml | |
| parent | ded197497c48485aa6b00c45318db7cf7e7cdf96 (diff) | |
| download | candle-4f92420132d831e5d344f974c263c9f341e50906.tar.gz candle-4f92420132d831e5d344f974c263c9f341e50906.tar.bz2 candle-4f92420132d831e5d344f974c263c9f341e50906.zip | |
Add some flash attn test (#253)
* Add some flash-attn test.
* Add the cpu test.
* Fail when the head is not a multiple of 8.
* Polish the flash attention test.
Diffstat (limited to 'candle-flash-attn/Cargo.toml')
| -rw-r--r-- | candle-flash-attn/Cargo.toml | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/candle-flash-attn/Cargo.toml b/candle-flash-attn/Cargo.toml index 9d21cf4a..013da854 100644 --- a/candle-flash-attn/Cargo.toml +++ b/candle-flash-attn/Cargo.toml @@ -18,3 +18,6 @@ half = { version = "2.3.1", features = ["num-traits"] } anyhow = { version = "1", features = ["backtrace"] } num_cpus = "1.15.0" rayon = "1.7.0" + +[dev-dependencies] +anyhow = { version = "1", features = ["backtrace"] } |