diff options
| author | Santiago Medina <santiagm08@gmail.com> | 2024-03-30 23:54:56 -0700 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-03-31 08:54:56 +0200 |
| commit | 92f81d2fcb4a116fd30d5bd1b6fd46dc6c0e8463 (patch) | |
| tree | bd7ad86b7c5f73585f5bd44e3f28b149c061e447 /candle-transformers/src/models/mod.rs | |
| parent | 3144150b8d1b80b2c6b469dcab5b717598f0a458 (diff) | |
| download | candle-92f81d2fcb4a116fd30d5bd1b6fd46dc6c0e8463.tar.gz candle-92f81d2fcb4a116fd30d5bd1b6fd46dc6c0e8463.tar.bz2 candle-92f81d2fcb4a116fd30d5bd1b6fd46dc6c0e8463.zip | |
Add Moondream transformer implementation and example (#1970)
* moondream implementation
* add moondream example
* change config default activation
* Add assets and integrate phi mixformer with example
* Make use of kv cache and fix seq_len bug; Clean up example code
* Add README link to example
* Remove pos_embed scaling; Remove assets; Add to README; Expand VisionConfig
* Delete image
* Use apply instead of forward
Diffstat (limited to 'candle-transformers/src/models/mod.rs')
| -rw-r--r-- | candle-transformers/src/models/mod.rs | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/candle-transformers/src/models/mod.rs b/candle-transformers/src/models/mod.rs index 980ba535..ed0e0de7 100644 --- a/candle-transformers/src/models/mod.rs +++ b/candle-transformers/src/models/mod.rs @@ -24,6 +24,7 @@ pub mod mistral; pub mod mixformer; pub mod mixtral; pub mod mobileone; +pub mod moondream; pub mod mpt; pub mod persimmon; pub mod phi; |