diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-09-02 08:56:12 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-09-02 07:56:12 +0100 |
| commit | dabaa479b966296faad294c40b69d321d51ee4df (patch) | |
| tree | 8ecafde0bb815228c6e532eb8a30902d00b164f6 | |
| parent | 2c1df6bba1a2017b8b4aec87a725b5b06b48cdab (diff) | |
| download | candle-dabaa479b966296faad294c40b69d321d51ee4df.tar.gz candle-dabaa479b966296faad294c40b69d321d51ee4df.tar.bz2 candle-dabaa479b966296faad294c40b69d321d51ee4df.zip | |
Update README.md (#714)
| -rw-r--r-- | README.md | 16 |
1 files changed, 16 insertions, 0 deletions
@@ -227,6 +227,22 @@ conditions](https://huggingface.co/meta-llama/Llama-2-7b-hf), and set up your authentication token. See issue [#350](https://github.com/huggingface/candle/issues/350) for more details. +#### Missing cute/cutlass headers when compiling flash-attn + +``` + In file included from kernels/flash_fwd_launch_template.h:11:0, + from kernels/flash_fwd_hdim224_fp16_sm80.cu:5: + kernels/flash_fwd_kernel.h:8:10: fatal error: cute/algorithm/copy.hpp: No such file or directory + #include <cute/algorithm/copy.hpp> + ^~~~~~~~~~~~~~~~~~~~~~~~~ + compilation terminated. + Error: nvcc error while compiling: +``` +[cutlass](https://github.com/NVIDIA/cutlass) is provided as a git submodule so you may want to run the following command to check it in properly. +```bash +git submodule update --init +``` + #### Tracking down errors You can set `RUST_BACKTRACE=1` to be provided with backtraces when a candle |