Skip to content

NVIDIA NIM-powered RAG app which is optimized for high-performance inference using Llama3 70B and the NV-Embed-v1 embedding

License

Notifications You must be signed in to change notification settings

nossi99/Nvidia-NIM_RAG_app

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

NVIDIA NIM-powered RAG app which is optimized for high-performance inference using Llama3 70B and the NV-Embed-v1 embedding

Instruction

  1. Add your Nvidia Nim API key in .env which you will get here: https://www.nvidia.com/en-us/ai/
  2. Run: conda create -p venv python==3.10 -y
  3. Run: conda activate venv/
  4. Run: pip install -r requirements.txt

After that you can run the app using streamlit: streamlit run rag_app.py

Have fun :)

About

NVIDIA NIM-powered RAG app which is optimized for high-performance inference using Llama3 70B and the NV-Embed-v1 embedding

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages