summaryrefslogtreecommitdiff
path: root/candle-transformers/src/generation
Commit message (Collapse)AuthorAgeFilesLines
* Add a Context trait similar to anyhow::Context. (#2676)Laurent Mazare2024-12-221-2/+2
| | | | | * Add a Context trait similar to anyhow::Context. * Switch two unwrap to context.
* 20241118 docs (#2629)zachcp2024-11-191-0/+5
| | | | | | | | | | | | | | | | | * module docs * varbuilder gguf docs * add a link to gguf files * small additonal mod doc titles * safetensor docs * more core docs * more module docs in canlde_core * 2 more link fixes
* Include topk sampling in the quantized example. (#2005)Laurent Mazare2024-04-041-1/+25
| | | | | * Include topk sampling in the quantized example. * Also sample with top-k on the mistral side.
* Allow for arbitrary temperature modifications.laurent2024-03-231-1/+7
|
* Add topk sampling. (#1923)Laurent Mazare2024-03-231-24/+61
|
* Use softmax-last-dim in the quantized example. (#848)Laurent Mazare2023-09-141-19/+22
|
* Implement top_p / nucleus sampling (#819)Juarez Bochi2023-09-121-13/+57
| | | | | | | | | | | | | * Implement top_p / nucleus sampling * Update changelog * rustfmt * Add tests * Fix clippy warning * Fix another clippy error
* Better handling of zero temperatures. (#532)Laurent Mazare2023-08-211-1/+2
|
* Softmax numerical stability. (#267)Laurent Mazare2023-07-281-1/+1
| | | | | * Softmax numerical stability. * Fix the flash-attn test.
* Sketch the candle-transformers crate. (#147)Laurent Mazare2023-07-121-0/+35
* Sketch the candle-transformers crate. * Format the empty files.