Skip to content

Files

Latest commit

 Cannot retrieve latest commit at this time.

History

History
29 lines (21 loc) · 1.12 KB

README.md

File metadata and controls

29 lines (21 loc) · 1.12 KB

Helm Chart for Hugging Face Generative AI Services (HUGS)

HUGS Logo

Version: 0.0.4 Type: application AppVersion: 1.16.0

Warning

HUGS Helm Chart is subject to changes before the 0.1.0 release!

Installing the Chart

To add the chart from the current repository you need to run:

$ helm repo add hugs https://raw.githubusercontent.com/huggingface/hugs-helm-chart/main/charts/hugs
$ helm repo update hugs

Then to install the chart on a Kubernetes cluster you can run the following:

$ helm install hugs-demo hugs/hugs \
    --set image.repository="hfhugs" \
    --set image.name="nvidia-meta-llama-meta-llama-3.1-8b-instruct" \
    --set resources.requests.nvidia\\.com/gpu=1 \
    --set resources.limits.nvidia\\.com/gpu=1