_images/helm-logo.svg

Helm Chart for Apache Airflow

This chart will bootstrap an Airflow deployment on a Kubernetes cluster using the Helm package manager.

Requirements

  • Kubernetes 1.14+ cluster

  • Helm 2.11+ or Helm 3.0+

  • PV provisioner support in the underlying infrastructure (optionally)

Features

  • Supported executors: LocalExecutor, CeleryExecutor, CeleryKubernetesExecutor, KubernetesExecutor.

  • Supported Airflow version: 1.10+, 2.0+

  • Supported database backend: PostgresSQL, MySQL

  • Autoscaling for CeleryExecutor provided by KEDA

  • PostgresSQL and PgBouncer with a battle-tested configuration

  • Monitoring:

    • StatsD/Prometheus metrics for Airflow

    • Prometheus metrics for PgBouncer

    • Flower

  • Automatic database migration after a new deployment

  • Administrator account creation during deployment

  • Kerberos secure configuration

  • One-command deployment for any type of executor. You don’t need to provide other services e.g. Redis/Database to test the Airflow.

Installing the Chart

To install this repository from source (using helm 3)

kubectl create namespace airflow
helm dep update
helm install airflow . --namespace airflow

The command deploys Airflow on the Kubernetes cluster in the default configuration. The Parameters reference section lists the parameters that can be configured during installation.

Tip

List all releases using helm list.

Upgrading the Chart

To upgrade the chart with the release name airflow:

helm upgrade airflow . --namespace airflow

Uninstalling the Chart

To uninstall/delete the airflow deployment:

helm delete airflow --namespace airflow

The command removes all the Kubernetes components associated with the chart and deletes the release.

Was this entry helpful?