quick-start.rst

Quick start with kind

This article will show you how to install Airflow using Helm Chart on Kind

Install kind, and create a cluster

We recommend testing with Kubernetes 1.16+, example:

kind create cluster --image kindest/node:v1.18.15

Confirm it’s up:

kubectl cluster-info --context kind-kind

Add Airflow Stable Repo

helm repo add apache-airflow https://airflow.apache.org
helm repo update

Create namespace and Install the chart

export RELEASE_NAME=example-release
export NAMESPACE=example-namespace

kubectl create namespace $NAMESPACE
helm install $RELEASE_NAME apache-airflow/airflow --namespace $NAMESPACE

It may take a few minutes. Confirm the pods are up:

kubectl get pods --namespace $NAMESPACE
helm list --namespace $NAMESPACE

Run kubectl port-forward svc/airflow-webserver 8080:8080 -n airflow to port-forward the Airflow UI to http://localhost:8080/ to confirm Airflow is working.

Build a Docker image from your DAGs

1. Create a project

   mkdir my-airflow-project && cd my-airflow-project
   mkdir dags  # put dags here
   cat <<EOM > Dockerfile
   FROM apache/airflow
   COPY . .
   EOM

2. Then build the image:

   docker build -t my-dags:0.0.1 .

3. Load the image into kind:

   kind load docker-image my-dags:0.0.1

4. Upgrade Helm deployment:

   # from airflow chart directory
   helm upgrade $RELEASE_NAME --namespace $NAMESPACE \
       --set images.airflow.repository=my-dags \
       --set images.airflow.tag=0.0.1