diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-08-16 20:59:40 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-08-16 20:59:40 +0100 |
| commit | 098909de40b1478dfd6fba92f9907b8cd88984a6 (patch) | |
| tree | 6ca3c6ab477d34abf365fb1428f98c567f40e52d /candle-examples/examples/llama2-c | |
| parent | 3bedba1fcedb26e3ee850a9c1f20e320d679bf3b (diff) | |
| download | candle-098909de40b1478dfd6fba92f9907b8cd88984a6.tar.gz candle-098909de40b1478dfd6fba92f9907b8cd88984a6.tar.bz2 candle-098909de40b1478dfd6fba92f9907b8cd88984a6.zip | |
Add vecdot for q6k-q8k. (#476)
* Add vecdot for q6k-q8k.
* Add some testing for q8k.
* Use QMatMul for the output layer.
Diffstat (limited to 'candle-examples/examples/llama2-c')
0 files changed, 0 insertions, 0 deletions