diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2024-04-04 09:27:54 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-04 09:27:54 +0200 |
| commit | f48c07e2428a6d777ffdea57a2d1ac6a7d58a8ee (patch) | |
| tree | e371fa03e3a8a16ddbbab7563547cec242613d46 /candle-core/examples/cuda_basics.rs | |
| parent | 8967c46563221c01db4fc6a920231a9ef0d6f7bc (diff) | |
| download | candle-f48c07e2428a6d777ffdea57a2d1ac6a7d58a8ee.tar.gz candle-f48c07e2428a6d777ffdea57a2d1ac6a7d58a8ee.tar.bz2 candle-f48c07e2428a6d777ffdea57a2d1ac6a7d58a8ee.zip | |
Include topk sampling in the quantized example. (#2005)
* Include topk sampling in the quantized example.
* Also sample with top-k on the mistral side.
Diffstat (limited to 'candle-core/examples/cuda_basics.rs')
0 files changed, 0 insertions, 0 deletions