diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2024-05-18 15:58:18 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-05-18 15:58:18 +0200 |
| commit | 01545f73038cb8c90426214ddf4bcedd59e291e8 (patch) | |
| tree | 2f2af0905b404bd42ee22962f94ea812e3caaa9e /candle-onnx | |
| parent | 349c3e806a15399df8289c41b2e24c3fa24b6d84 (diff) | |
| download | candle-01545f73038cb8c90426214ddf4bcedd59e291e8.tar.gz candle-01545f73038cb8c90426214ddf4bcedd59e291e8.tar.bz2 candle-01545f73038cb8c90426214ddf4bcedd59e291e8.zip | |
Add a slice_set op. (#2193)
* Add a slice_set op.
* Add some testing.
* Add the dedicated kv-cache module.
* Derive debug and clone.
* Expose more kv-cache functions.
* Return the current data when appending.
* Use the new cache in the quantized phi3 model.
Diffstat (limited to 'candle-onnx')
0 files changed, 0 insertions, 0 deletions