From 01bc8235c590e1ab315248d2f5906d2b3267f3f6 Mon Sep 17 00:00:00 2001 From: Mike Bird Date: Wed, 13 Mar 2024 12:49:29 -0400 Subject: [PATCH] language model services skeleton --- docs/services/language-model.mdx | 26 ++++++++++++++++++++++---- 1 file changed, 22 insertions(+), 4 deletions(-) diff --git a/docs/services/language-model.mdx b/docs/services/language-model.mdx index 1d199f95..7d2f1d80 100644 --- a/docs/services/language-model.mdx +++ b/docs/services/language-model.mdx @@ -3,7 +3,25 @@ title: "Language Model" description: "The LLM that powers your 01" --- -- Llamafile (Local) -- Llamaedge (Local) -- Hosted Models (explains that we use litellm, you can pass in many different model flags to this) -- Add more (placeholder, we will add instructions soon) +## Llamafile + +Llamafile is cool! + +## Llamaedge + +Llamaedge is also cool! + +## Hosted Models + +01OS leverages liteLLM which supports [many hosted models](https://docs.litellm.ai/docs/providers/). + +To select your providers + +```bash +# Set the LLM service +poetry run 01 --llm-service openai +``` + +## Other Models + +More instructions coming soon!