tests.system.apache.spark.example_spark_dag¶

Example Airflow DAG to submit Apache Spark applications using SparkSubmitOperator, SparkJDBCOperator and SparkSqlOperator.

Attributes¶

`ENV_ID`
`DAG_ID`
`submit_job`
`test_run`

Module Contents¶

tests.system.apache.spark.example_spark_dag.ENV_ID[source]¶

tests.system.apache.spark.example_spark_dag.DAG_ID = 'example_spark_operator'[source]¶

tests.system.apache.spark.example_spark_dag.submit_job[source]¶

tests.system.apache.spark.example_spark_dag.test_run[source]¶

Was this entry helpful?