diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-09-02 12:26:05 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-09-02 11:26:05 +0100 |
| commit | e8e33752f4562d69cbef3de61d02676da112dfb8 (patch) | |
| tree | 9b8b8587aa1bb60eef0ac3a44ef6f4a0f86916cc /candle-pyo3/test.py | |
| parent | dabaa479b966296faad294c40b69d321d51ee4df (diff) | |
| download | candle-e8e33752f4562d69cbef3de61d02676da112dfb8.tar.gz candle-e8e33752f4562d69cbef3de61d02676da112dfb8.tar.bz2 candle-e8e33752f4562d69cbef3de61d02676da112dfb8.zip | |
Sketch a quantized llama using the pyo3 api. (#715)
* Sketch a quantized llama using the pyo3 api.
* Add more ops.
* Expose a few more functions to use in the quantized model.
* Rope embeddings.
* Get the forward pass to work.
Diffstat (limited to 'candle-pyo3/test.py')
0 files changed, 0 insertions, 0 deletions