Skip to content

Commit

Permalink
language model services skeleton
Browse files Browse the repository at this point in the history
  • Loading branch information
MikeBirdTech committed Mar 13, 2024
1 parent 614e962 commit 01bc823
Showing 1 changed file with 22 additions and 4 deletions.
26 changes: 22 additions & 4 deletions docs/services/language-model.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,25 @@ title: "Language Model"
description: "The LLM that powers your 01"
---

- Llamafile (Local)
- Llamaedge (Local)
- Hosted Models (explains that we use litellm, you can pass in many different model flags to this)
- Add more (placeholder, we will add instructions soon)
## Llamafile

Llamafile is cool!

## Llamaedge

Llamaedge is also cool!

## Hosted Models

01OS leverages liteLLM which supports [many hosted models](https://docs.litellm.ai/docs/providers/).

To select your providers

```bash
# Set the LLM service
poetry run 01 --llm-service openai
```

## Other Models

More instructions coming soon!

0 comments on commit 01bc823

Please sign in to comment.