This is an example for running llama-index with local Alpaca-LoRA

Setup

Follow this guide to produce HF weights: https://github.com/oobabooga/text-generation-webui/wiki/LLaMA-model Fine tune the model with Alpaca-LoRA: https://github.com/tloen/alpaca-lora

Put the resulting models in ./models