NVIDIA NIM-powered RAG app which is optimized for high-performance inference using Llama3 70B and the NV-Embed-v1 embedding
- Add your Nvidia Nim API key in .env which you will get here: https://www.nvidia.com/en-us/ai/
- Run: conda create -p venv python==3.10 -y
- Run: conda activate venv/
- Run: pip install -r requirements.txt
After that you can run the app using streamlit: streamlit run rag_app.py
Have fun :)