diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-09-30 16:04:11 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-09-30 15:04:11 +0100 |
| commit | 06207332bc58e20680dd1925b7d90bac51f4f21c (patch) | |
| tree | 21602b4923638fcea5463cf02567865a8a7b3806 /candle-examples/src/lib.rs | |
| parent | 4021272875605aa8a7196a5d08ccf901c3ea6c4b (diff) | |
| download | candle-06207332bc58e20680dd1925b7d90bac51f4f21c.tar.gz candle-06207332bc58e20680dd1925b7d90bac51f4f21c.tar.bz2 candle-06207332bc58e20680dd1925b7d90bac51f4f21c.zip | |
Streaming mode for reporting the generated tokens (#1007)
* Token streaming.
* Use the token output stream.
* Flush the output.
* Ensure that the last characters get reported.
Diffstat (limited to 'candle-examples/src/lib.rs')
| -rw-r--r-- | candle-examples/src/lib.rs | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/candle-examples/src/lib.rs b/candle-examples/src/lib.rs index 5e0b44fb..4ef97f88 100644 --- a/candle-examples/src/lib.rs +++ b/candle-examples/src/lib.rs @@ -1,5 +1,6 @@ pub mod coco_classes; pub mod imagenet; +pub mod token_output_stream; use candle::{Device, Result, Tensor}; |