diff options
Diffstat (limited to 'candle-examples/examples/t5/README.md')
| -rw-r--r-- | candle-examples/examples/t5/README.md | 14 |
1 files changed, 13 insertions, 1 deletions
diff --git a/candle-examples/examples/t5/README.md b/candle-examples/examples/t5/README.md index 6a406467..d1a9186c 100644 --- a/candle-examples/examples/t5/README.md +++ b/candle-examples/examples/t5/README.md @@ -5,11 +5,23 @@ ```bash $ cargo run --example t5 --release -- --model-id "t5-small" --prompt "translate to German: A beautiful candle." --decode ... -Running on CPU, to run on GPU, build this example with `--features cuda` Eine schöne Kerze. 9 tokens generated (2.42 token/s) ``` +## Translation with [MADLAD-400](https://arxiv.org/abs/2309.04662) + +MADLAD-400 is a series of multilingual machine translation T5 models trained on 250 billion tokens covering over 450 languages using publicly available data. These models are competitive with significantly larger models. + +```bash +cargo run --example t5 --release -- \ + --model-id "jbochi/madlad400-3b-mt" \ + --prompt "<2de> How are you, my friend?" \ + --decode --temperature 0 +... + Wie geht es dir, mein Freund? +``` + ## Sentence embedding example: ```bash |