Add vllm external resource (huggingface#1253)

Jzice · Nov 3, 2023 · 1b5063f · 1b5063f
1 parent 3b0d1e7
commit 1b5063f
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -143,6 +143,8 @@ And then head over to
   including SGD with momentum, AdaGrad, AdaDelta, AdaMax, NAdam, RAdam, and RMSprop.
 - [`candle-lora`](https://github.com/EricLBuehler/candle-lora): a LoRA implementation
   that conforms to the official `peft` implementation.
+- [`candle-vllm`](https://github.com/EricLBuehler/candle-vllm): Efficent platform for inference and
+  serving local LLMs including an OpenAI compatible API server.
 
 If you have an addition to this list, please submit a pull request.