python3 -m venv langchain_ai
source langchain_ai/bin/activate
If you have a GPU:
docker compose -f docker-compose-with-gpu.yml up -d
If you don't have a GPU:
docker compose -f docker-compose-with-gpu.yml up -d
When clicking the links below you should see an output on the browser.
- Open the OpenWebUI.
- Click on the profile icon on the top right and select Admin Panel
- Select the settings tab from the top navigation bar
- Select Models
- In Pull a model from Ollama.com, enter model name and click on the submit button. You must download the following models:
- llama3.2
- nomic-embed-text