diff options
author | Laurent Mazare <laurent.mazare@gmail.com> | 2024-05-04 10:14:57 +0200 |
---|---|---|
committer | GitHub <noreply@github.com> | 2024-05-04 10:14:57 +0200 |
commit | b13a82a4387a55df07bec4e2eb6f7a8ebd0b98a2 (patch) | |
tree | aed5a019e7e053900ffa5be57ddfd20bdfad8582 /candle-core/src/metal_backend/mod.rs | |
parent | 59b18d974ec3cad6963b774aa245e23f8c80414f (diff) | |
download | candle-b13a82a4387a55df07bec4e2eb6f7a8ebd0b98a2.tar.gz candle-b13a82a4387a55df07bec4e2eb6f7a8ebd0b98a2.tar.bz2 candle-b13a82a4387a55df07bec4e2eb6f7a8ebd0b98a2.zip |
Separate quantized phi-3 implementation. (#2157)
* Separate quantized phi-3 implementation.
* Integrate the quantized phi3 model.=
* Small fixes, get the generation to work properly.
* Keep the old llama implementation around.
* Change the default.
Diffstat (limited to 'candle-core/src/metal_backend/mod.rs')
-rw-r--r-- | candle-core/src/metal_backend/mod.rs | 3 |
1 files changed, 0 insertions, 3 deletions
diff --git a/candle-core/src/metal_backend/mod.rs b/candle-core/src/metal_backend/mod.rs index c0f6a844..e00566ca 100644 --- a/candle-core/src/metal_backend/mod.rs +++ b/candle-core/src/metal_backend/mod.rs @@ -676,9 +676,6 @@ impl BackendStorage for MetalStorage { } } - if layout.is_contiguous() { - } else { - } Ok(Self::new(buffer, device.clone(), el_count, dtype)) } |