summaryrefslogtreecommitdiff
path: root/candle-examples/examples/llama2-c
diff options
context:
space:
mode:
authorLaurent Mazare <laurent.mazare@gmail.com>2023-08-17 07:03:32 +0100
committerGitHub <noreply@github.com>2023-08-17 07:03:32 +0100
commit306c8eee7ac96d23d1d6a7a13b4311edc6c4f98a (patch)
tree517f84b8b462d7703311edc59b127edeb87f6c56 /candle-examples/examples/llama2-c
parent098909de40b1478dfd6fba92f9907b8cd88984a6 (diff)
downloadcandle-306c8eee7ac96d23d1d6a7a13b4311edc6c4f98a.tar.gz
candle-306c8eee7ac96d23d1d6a7a13b4311edc6c4f98a.tar.bz2
candle-306c8eee7ac96d23d1d6a7a13b4311edc6c4f98a.zip
AVX version of the vecdot for q4_0. (#474)
* AVX version of the vecdot for q4_0. * Tweak the avx bits. * Add a qmatmul benchmark. * Fix the quantized test.
Diffstat (limited to 'candle-examples/examples/llama2-c')
0 files changed, 0 insertions, 0 deletions