diff options
| author | Nicolas Patry <patry.nicolas@protonmail.com> | 2024-02-13 16:28:56 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-13 16:28:56 +0100 |
| commit | c1b418586c9477a85150ce6c15dcfe4c93d3a27d (patch) | |
| tree | daabda27c6689f7ea9db68ceb8f6bd74ebf8f4b1 /candle-core/src/quantized/metal.rs | |
| parent | ad73e93da2cf7311cb5c5bc39250aa335c5f9b76 (diff) | |
| download | candle-c1b418586c9477a85150ce6c15dcfe4c93d3a27d.tar.gz candle-c1b418586c9477a85150ce6c15dcfe4c93d3a27d.tar.bz2 candle-c1b418586c9477a85150ce6c15dcfe4c93d3a27d.zip | |
Fixing quantized llama demo on metal. (#1703)
Diffstat (limited to 'candle-core/src/quantized/metal.rs')
| -rw-r--r-- | candle-core/src/quantized/metal.rs | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/candle-core/src/quantized/metal.rs b/candle-core/src/quantized/metal.rs index fe57ce14..94105327 100644 --- a/candle-core/src/quantized/metal.rs +++ b/candle-core/src/quantized/metal.rs @@ -14,6 +14,10 @@ impl QMetalStorage { self.dtype } + pub fn device(&self) -> &MetalDevice { + &self.device + } + pub fn buffer(&self) -> &Buffer { &self.buffer } |