Skip to content

Latest commit

 

History

History
71 lines (51 loc) · 1.61 KB

README.md

File metadata and controls

71 lines (51 loc) · 1.61 KB

GenSuite!

Video Demo

  • ChatBot

    • ollama setup
    • chat api usage
    • DB implementation for Chat history (For each Chat Item)
    • Chat Item Deletion From DB
    • GitHub OAuth
    • User Based Chat Loading

  • UI (FastHTML)

    • Home Page (Basic)
    • Chat Page
      • Horizontal Flex
      • Chat Item
      • Create New Chat Item
      • Delete Existing Chat Item
      • Login page (Decent Page!)
      • SideBar toggle

Installation

Install Poetry

Clone the repo

git clone https://github.com/sam99dave/chat-app.git

Make sure to install ollama & redis-server. You can start both the services. Ollama mostly will be running by default. Make sure that persistant memory is enabled in redis for retaining the chat history.

# ollama for linux
curl -fsSL https://ollama.com/install.sh | sh

# start redis server
sudo systemctl start redis-sever

# stop redis server (after stopping the application)
sudo systemctl stop redis-sever

Run the application locally!

# Install the dependencies
cd chat-app
poetry install
poetry shell

# Start the application
cd chatBot
python3 test.py

By default its using llama3 but this can be changed over here:

# line 19, test.py
# If it works it might take some time as the model will be downloaded
MODEL_NAME = 'llama3'

If the above attempt fails then you can download the required model first and then update the MODEL_NAME and start the application.

The initial call to the model will take sometime as the model will be loaded in memory!