diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2024-02-14 10:58:32 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-02-14 10:58:32 +0100 |
| commit | 2d5f2a728d9ade10ce4b7b618ee4dba8075064dd (patch) | |
| tree | 304d99d8330c116bea92c2997474311c199e579a /candle-transformers/src/models/mod.rs | |
| parent | 68f76558956f7f56cb5014bb5f7c7c5534436b72 (diff) | |
| download | candle-2d5f2a728d9ade10ce4b7b618ee4dba8075064dd.tar.gz candle-2d5f2a728d9ade10ce4b7b618ee4dba8075064dd.tar.bz2 candle-2d5f2a728d9ade10ce4b7b618ee4dba8075064dd.zip | |
Add the RWKV model (v5). (#1707)
* Start adding the RWKV model.
* More of the forward step.
* Handle rescaling.
* FeedForward.
* More work on RWKV.
* Better state tracking.
* Finish a first pass on forward.
* Fix the shape mismatches.
* Do not rescale in f32.
* Rename to rwkv-v5.
* Add the new models to the readme.
Diffstat (limited to 'candle-transformers/src/models/mod.rs')
| -rw-r--r-- | candle-transformers/src/models/mod.rs | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/candle-transformers/src/models/mod.rs b/candle-transformers/src/models/mod.rs index 769fd650..8eab4744 100644 --- a/candle-transformers/src/models/mod.rs +++ b/candle-transformers/src/models/mod.rs @@ -34,6 +34,7 @@ pub mod quantized_t5; pub mod qwen2; pub mod repvgg; pub mod resnet; +pub mod rwkv_v5; pub mod segment_anything; pub mod stable_diffusion; pub mod stable_lm; |