Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
williamFalcon authored Aug 29, 2024
1 parent 443dde8 commit cdd07f6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,7 +125,7 @@ response = requests.post(

### LLM serving
LitServe isn’t a vLLM or Ollama alternative, it's designed to serve ANY AI model (beyond LLMs).
LitServe offers full control over the inference internals so experts can build high-performance LLM servers ([learn more](https://lightning.ai/docs/litserve/features/serve-llms)).
LitServe offers full control over the inference internals so you can build custom LLM servers ([learn more](https://lightning.ai/docs/litserve/features/serve-llms)).

For easy LLM serving, use [LitGPT](https://github.com/Lightning-AI/litgpt?tab=readme-ov-file#deploy-an-llm) (built on LitServe).

Expand Down

0 comments on commit cdd07f6

Please sign in to comment.