diff options
| author | yinqiwen <yinqiwen@gmail.com> | 2024-04-01 18:10:08 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-04-01 12:10:08 +0200 |
| commit | 5522bbc57c2967f3c8fb8fa9ab8a82d2c9ff8db8 (patch) | |
| tree | b3601f0478fcc10b2bb97ae2bf9a77f27325ae1e /candle-pyo3 | |
| parent | 888c09a3dbf8413c3aa76076e49cf52460334bbd (diff) | |
| download | candle-5522bbc57c2967f3c8fb8fa9ab8a82d2c9ff8db8.tar.gz candle-5522bbc57c2967f3c8fb8fa9ab8a82d2c9ff8db8.tar.bz2 candle-5522bbc57c2967f3c8fb8fa9ab8a82d2c9ff8db8.zip | |
Add fn 'get_with_hints_dtype' in VarBuilder (#1877) (#1897)
* quantized models(awq/squeezellm/...) have multiple data type tensors, use 'get_with_hints_dtype' to load tensors with given dtype
Diffstat (limited to 'candle-pyo3')
0 files changed, 0 insertions, 0 deletions