airflow.providers.amazon.aws.sensors.athena_spark

Classes

AthenaSparkSensor

Waits for an Amazon Athena Spark calculation to reach a terminal state.

Module Contents

class airflow.providers.amazon.aws.sensors.athena_spark.AthenaSparkSensor(*, calculation_execution_id, aws_conn_id='aws_default', region_name=None, **kwargs)[source]

Bases: airflow.providers.amazon.aws.sensors.base_aws.AwsBaseSensor[airflow.providers.amazon.aws.hooks.athena.AthenaHook]

Waits for an Amazon Athena Spark calculation to reach a terminal state.

Parameters:

  • calculation_execution_id (str) – Athena Spark calculation execution ID. (templated)

  • aws_conn_id (str) – The Airflow connection used for AWS credentials. If this is None or empty then the default boto3 behaviour is used. If running Airflow in a distributed manner and aws_conn_id is None or empty, then default boto3 configuration would be used (and must be maintained on each worker node). (templated)

  • region_name (str | None) – AWS region_name. If not specified then the default boto3 behaviour is used. (templated)

aws_hook_class[source]
template_fields: collections.abc.Sequence[str][source]
calculation_execution_id[source]
poke(context)[source]

Override when deriving this class.

Was this entry helpful?