terminal-llm

Trying to create simple LLM interface to lower the entry barrier to this stuff.

TODO ELI5 LLMs and Local LLMs.

How to use?

• Step 1- Clone this repo.

• Step 2- Place GGUF file in your models folder.

• Step 3- Update llm_config.json to your personal liking.

• Step 4- Get the stuff in requirements.txt. You don't need openai if you won't use APIs.

• Step 5- Run a terminal/command window in the folder, type python main.py.

• Step 6- Have fun.