Add Moondream transformer implementation and example (#1970)

* moondream implementation

* add moondream example

* change config default activation

* Add assets and integrate phi mixformer with example

* Make use of kv cache and fix seq_len bug; Clean up example code

* Add README link to example

* Remove pos_embed scaling; Remove assets; Add to README; Expand VisionConfig

* Delete image

* Use apply instead of forward

1 files changed, 2 insertions, 0 deletions

diff --git a/README.md b/README.md
index 1208956c..0fdcedca 100644
--- a/README.md
+++ b/README.md
@@ -131,6 +131,8 @@ We also provide a some command line based examples using state of the art models
   dedicated submodels for hand-writing and printed recognition.
 - [Marian-MT](./candle-examples/examples/marian-mt/): neural machine translation
   model, generates the translated text from the input text.
+- [Moondream](./candle-examples/examples/moondream/): tiny computer-vision model 
+  that can answer real-world questions about images.
 
 Run them using commands like:
 ```