Helm Chart for Hugging Face Generative AI Services (HUGS)

Warning

HUGS Helm Chart is subject to changes before the 0.1.0 release!

Installing the Chart

To add the chart from the current repository you need to run:

$ helm repo add hugs https://raw.githubusercontent.com/huggingface/hugs-helm-chart/main/charts/hugs
$ helm repo update hugs

Then to install the chart on a Kubernetes cluster you can run the following:

$ helm install hugs-demo hugs/hugs \
    --set image.repository="hfhugs" \
    --set image.name="nvidia-meta-llama-meta-llama-3.1-8b-instruct" \
    --set resources.requests.nvidia\\.com/gpu=1 \
    --set resources.limits.nvidia\\.com/gpu=1