tests.system.apache.spark.example_spark_dag

Example Airflow DAG to submit Apache Spark applications using SparkSubmitOperator, SparkJDBCOperator and SparkSqlOperator.

Module Contents

tests.system.apache.spark.example_spark_dag.ENV_ID[source]
tests.system.apache.spark.example_spark_dag.DAG_ID = 'example_spark_operator'[source]
tests.system.apache.spark.example_spark_dag.submit_job[source]
tests.system.apache.spark.example_spark_dag.test_run[source]

Was this entry helpful?