diff options
| author | Eric Buehler <65165915+EricLBuehler@users.noreply.github.com> | 2023-11-03 07:40:31 -0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-03 12:40:31 +0100 |
| commit | 1b5063f3ca223f387dd28ba3b69dadb88708905c (patch) | |
| tree | 335cb4efc6267d7fd9f757cd57a453157e8e2764 /README.md | |
| parent | 3b0d1e7d03469ed17d1eec931bd76c857b99ff3a (diff) | |
| download | candle-1b5063f3ca223f387dd28ba3b69dadb88708905c.tar.gz candle-1b5063f3ca223f387dd28ba3b69dadb88708905c.tar.bz2 candle-1b5063f3ca223f387dd28ba3b69dadb88708905c.zip | |
Add vllm external resource (#1253)
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 2 |
1 files changed, 2 insertions, 0 deletions
@@ -143,6 +143,8 @@ And then head over to including SGD with momentum, AdaGrad, AdaDelta, AdaMax, NAdam, RAdam, and RMSprop. - [`candle-lora`](https://github.com/EricLBuehler/candle-lora): a LoRA implementation that conforms to the official `peft` implementation. +- [`candle-vllm`](https://github.com/EricLBuehler/candle-vllm): Efficent platform for inference and + serving local LLMs including an OpenAI compatible API server. If you have an addition to this list, please submit a pull request. |