diff options
| author | Juarez Bochi <juarez.bochi@grammarly.com> | 2023-11-09 12:55:09 -0500 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-09 18:55:09 +0100 |
| commit | 18d30005c577c029dec611a0bdd0260946468cdb (patch) | |
| tree | a465377a7671832df8dad41f64f10074d9656b44 /candle-nn | |
| parent | 695838432747b9c9460e74cd3f5086642b6897a9 (diff) | |
| download | candle-18d30005c577c029dec611a0bdd0260946468cdb.tar.gz candle-18d30005c577c029dec611a0bdd0260946468cdb.tar.bz2 candle-18d30005c577c029dec611a0bdd0260946468cdb.zip | |
Add support to UL2 model family (#1300)
* Add support to UL2 model family
* Update docs with UL2
* Create ActivationWithOptionalGating to avoid polluting activations
* Also refactor quantized t5
* Remove useless conversion
* Revert Activation::NewGelu name change
* Remove useless return
* Apply rustfmt and clippy recommendations
* Reuse t5::ActivationWithOptionalGating in quantized version
* (cosmetic change) use a match rather than ifs + avoid early returns.
---------
Co-authored-by: Laurent <laurent.mazare@gmail.com>
Diffstat (limited to 'candle-nn')
| -rw-r--r-- | candle-nn/src/activation.rs | 1 |
1 files changed, 0 insertions, 1 deletions
diff --git a/candle-nn/src/activation.rs b/candle-nn/src/activation.rs index 77e709d2..a2650634 100644 --- a/candle-nn/src/activation.rs +++ b/candle-nn/src/activation.rs @@ -6,7 +6,6 @@ use serde::Deserialize; pub enum Activation { #[default] Gelu, - #[serde(rename = "gated-gelu")] NewGelu, Relu, Relu2, |