Bundles¶

Dag bundles allow Airflow to load Dags from external sources. For a general overview see Dag Bundles.

GCSDagBundle¶

Use the GCSDagBundle to configure a GCS bundle in your Airflow’s [dag_processor] dag_bundle_config_list.

Example of using the GCSDagBundle:

JSON format example:

export AIRFLOW__DAG_PROCESSOR__DAG_BUNDLE_CONFIG_LIST='[
  {
    "name": "my-gcs-dags",
    "classpath": "airflow.providers.google.cloud.bundles.gcs.GCSDagBundle",
    "kwargs": {
      "gcp_conn_id": "google_cloud_default",
      "bucket_name": "my-airflow-bucket",
      "prefix": "dags/",
      "refresh_interval": 60
    }
  }
]'