Skip to content

NVIDIA NIM-powered RAG app which is optimized for high-performance inference using Llama3 70B and the NV-Embed-v1 embedding

License

Notifications You must be signed in to change notification settings

nossi99/Nvidia-NIM_RAG_app

Repository files navigation

NVIDIA NIM-powered RAG app which is optimized for high-performance inference using Llama3 70B and the NV-Embed-v1 embedding

Instruction

  1. Add your Nvidia Nim API key in .env which you will get here: https://www.nvidia.com/en-us/ai/
  2. Run: conda create -p venv python==3.10 -y
  3. Run: conda activate venv/
  4. Run: pip install -r requirements.txt

After that you can run the app using streamlit: streamlit run rag_app.py

Have fun :)

*** npm install semantic-release @semantic-release/git @semantic-release/github -D ***

About

NVIDIA NIM-powered RAG app which is optimized for high-performance inference using Llama3 70B and the NV-Embed-v1 embedding

Resources

License

Stars

Watchers

Forks

Packages

No packages published