Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
williamFalcon authored Aug 29, 2024
1 parent bb60919 commit d130e06
Showing 1 changed file with 5 additions and 14 deletions.
19 changes: 5 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -104,24 +104,15 @@ python server.py
```

### Test the server

Run this command on your terminal to test the server:

LitServe auto-generates a test client for the server:
```bash
curl -X POST http://127.0.0.1:8000/predict -H "Content-Type: application/json" -d '{"input": 4.0}'
python client.py
```

<details>
<summary>Example of a custom Python client</summary>

```python
import requests
response = requests.post(
"http://127.0.0.1:8000/predict",
json={"input": 4.0}
)
Or test the server with this terminal command:
```bash
curl -X POST http://127.0.0.1:8000/predict -H "Content-Type: application/json" -d '{"input": 4.0}'
```
</details>

### LLM serving
LitServe isn’t *just* for LLMs like vLLM or Ollama; it serves any AI model with full control over internals ([learn more](https://lightning.ai/docs/litserve/features/serve-llms)).
Expand Down

0 comments on commit d130e06

Please sign in to comment.