diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-09-01 21:38:58 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-09-01 20:38:58 +0100 |
| commit | 2c1df6bba1a2017b8b4aec87a725b5b06b48cdab (patch) | |
| tree | a08329097c25cb79c7413e21c440f700ecc7ed41 /candle-wasm-examples/llama2-c | |
| parent | 4d56cef58398a5f676ab1fe12d3ecc2e5c4edc66 (diff) | |
| download | candle-2c1df6bba1a2017b8b4aec87a725b5b06b48cdab.tar.gz candle-2c1df6bba1a2017b8b4aec87a725b5b06b48cdab.tar.bz2 candle-2c1df6bba1a2017b8b4aec87a725b5b06b48cdab.zip | |
Add a repeat penality to the llama2-c command line example. (#713)
* Add a repeat penality to the llama2-c command line example.
* Another fix attempt.
Diffstat (limited to 'candle-wasm-examples/llama2-c')
| -rw-r--r-- | candle-wasm-examples/llama2-c/src/bin/m.rs | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/candle-wasm-examples/llama2-c/src/bin/m.rs b/candle-wasm-examples/llama2-c/src/bin/m.rs index a71508ee..d014e38a 100644 --- a/candle-wasm-examples/llama2-c/src/bin/m.rs +++ b/candle-wasm-examples/llama2-c/src/bin/m.rs @@ -25,7 +25,7 @@ impl Model { candle_transformers::utils::apply_repeat_penalty( &logits, self.repeat_penalty, - &tokens[start_at..], + &self.tokens[start_at..], )? }; |