Skip to content

Latest commit

 

History

History
56 lines (36 loc) · 1.7 KB

README.md

File metadata and controls

56 lines (36 loc) · 1.7 KB

SecureAI Tools

Private and secure AI tools for everyone's productivity.

Discord

Install

Docker Compose [Recommended]

1. Create a directory

mkdir secure-ai-tools && cd secure-ai-tools

2. Run set-up script

The script downloads docker-compose.yml and generates a .env file with sensible defaults.

curl -sL https://github.com/SecureAI-Tools/SecureAI-Tools/releases/latest/download/set-up.sh | sh

3. [Optional] Edit .env file

Customize the .env file created in the above step to your liking.

4. [Optional] On Linux machine with Nvidia GPUs, enable GPU support

To accelerate inference on Linux machines, you will need to enable GPUs. This is not strictly required as the inference service will run on CPU-only mode as well, but it will be slow on CPU. So if your machine has Nvidia GPU then this step is recommended.

  1. Install Nvidia container toolkit if not already installed.
  2. Uncomment the deploy: block in docker-compose.yml file. It gives inference service access to Nvidia GPUs.

5. Run docker compose

docker compose up -d

6. Post-installation set-up

  1. Login at http://localhost:28669/log-in using the initial credentials below, and change the password.

  2. Set up the AI model by going to http://localhost:28669/-/settings?tab=ai

  3. Navigate to http://localhost:28669/- and start using AI tools