summaryrefslogtreecommitdiff
path: root/README.md
diff options
context:
space:
mode:
authorJuarez Bochi <juarez.bochi@grammarly.com>2023-11-09 12:55:09 -0500
committerGitHub <noreply@github.com>2023-11-09 18:55:09 +0100
commit18d30005c577c029dec611a0bdd0260946468cdb (patch)
treea465377a7671832df8dad41f64f10074d9656b44 /README.md
parent695838432747b9c9460e74cd3f5086642b6897a9 (diff)
downloadcandle-18d30005c577c029dec611a0bdd0260946468cdb.tar.gz
candle-18d30005c577c029dec611a0bdd0260946468cdb.tar.bz2
candle-18d30005c577c029dec611a0bdd0260946468cdb.zip
Add support to UL2 model family (#1300)
* Add support to UL2 model family * Update docs with UL2 * Create ActivationWithOptionalGating to avoid polluting activations * Also refactor quantized t5 * Remove useless conversion * Revert Activation::NewGelu name change * Remove useless return * Apply rustfmt and clippy recommendations * Reuse t5::ActivationWithOptionalGating in quantized version * (cosmetic change) use a match rather than ifs + avoid early returns. --------- Co-authored-by: Laurent <laurent.mazare@gmail.com>
Diffstat (limited to 'README.md')
-rw-r--r--README.md2
1 files changed, 1 insertions, 1 deletions
diff --git a/README.md b/README.md
index c3cdc092..e70c97e4 100644
--- a/README.md
+++ b/README.md
@@ -175,7 +175,7 @@ If you have an addition to this list, please submit a pull request.
- Replit-code-v1.5-3B.
- Bert.
- Text to text.
- - T5 and its variants: FlanT5, MADLAD400 (translation), CoEdit (Grammar correction).
+ - T5 and its variants: FlanT5, UL2, MADLAD400 (translation), CoEdit (Grammar correction).
- Marian MT (Machine Translation).
- Whisper (multi-lingual support).
- Text to image.