tests.system.apache.livy.example_livy

This is an example DAG which uses the LivyOperator. The tasks below trigger the computation of pi on the Spark instance using the Java and Python executables provided in the example library.

Attributes

ENV_ID

DAG_ID

livy_java_task

test_run

Module Contents

tests.system.apache.livy.example_livy.ENV_ID[source]
tests.system.apache.livy.example_livy.DAG_ID = 'example_livy_operator'[source]
tests.system.apache.livy.example_livy.livy_java_task[source]
tests.system.apache.livy.example_livy.test_run[source]

Was this entry helpful?