README.md

Ollama with Open WebUI on Intel® Discrete GPU

Requirements

Validated Hardware

• Asus NUC13RNGi9 + Intel® Arc™ A770 Graphics

Prerequisites

Graphics Driver

• Intel® Arc™ A-Series Graphics Driver

Software Architecture

Figure 1: Software Architecture

Quick Start

1. Install operating system

Install the latest Ubuntu* 22.04 LTS Desktop. Refer to Ubuntu Desktop installation tutorial if needed.

2. Download scripts

This step will download all reference scripts from the repository.

sudo apt install git
git clone https://github.com/intel/edge-developer-kit-reference-scripts

3. Go to specific setup directory

This step will redirect user to the current platform setup directory

cd edge-developer-kit-reference-scripts/usecases/ollama

4. Run setup script

This step will configure the basic setup of the installation. Make sure all of the requirements have been met before proceeding to the next step.

bash ./setup.sh

Installation is completed when you see this message:

✓ Setup Installed

5. Run serve script

This step will initialize and start the Ollama with Open WebUI Server.

bash ./serve.sh

Note: You may press CTRL+C to stop the service.

6. Launch Open WebUI Interface

• http://localhost:8080/