airflow.providers.amazon.aws.triggers.dms

Classes

DmsReplicationTerminalStatusTrigger

Trigger when an AWS DMS Serverless replication is in a terminal state.

DmsReplicationConfigDeletedTrigger

Trigger when an AWS DMS Serverless replication config is deleted.

DmsReplicationCompleteTrigger

Trigger when an AWS DMS Serverless replication completes.

DmsReplicationStoppedTrigger

Trigger when an AWS DMS Serverless replication is stopped.

DmsReplicationDeprovisionedTrigger

Trigger when an AWS DMS Serverless replication is de-provisioned.

DmsTaskModifyCompleteTrigger

Trigger when a DMS classic replication task modification completes.

DmsTableReloadCompleteTrigger

Trigger when AWS DMS finishes reloading or validating a set of tables.

Module Contents

class airflow.providers.amazon.aws.triggers.dms.DmsReplicationTerminalStatusTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', region_name=None, verify=None, botocore_config=None)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication is in a terminal state.

Parameters:
aws_hook_class[source]
class airflow.providers.amazon.aws.triggers.dms.DmsReplicationConfigDeletedTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', region_name=None, verify=None, botocore_config=None)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication config is deleted.

Parameters:
aws_hook_class[source]
class airflow.providers.amazon.aws.triggers.dms.DmsReplicationCompleteTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', region_name=None, verify=None, botocore_config=None)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication completes.

Parameters:
aws_hook_class[source]
class airflow.providers.amazon.aws.triggers.dms.DmsReplicationStoppedTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', region_name=None, verify=None, botocore_config=None)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication is stopped.

Parameters:
aws_hook_class[source]
class airflow.providers.amazon.aws.triggers.dms.DmsReplicationDeprovisionedTrigger(replication_config_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', region_name=None, verify=None, botocore_config=None)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when an AWS DMS Serverless replication is de-provisioned.

Parameters:
aws_hook_class[source]
class airflow.providers.amazon.aws.triggers.dms.DmsTaskModifyCompleteTrigger(replication_task_arn, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', verify=None, botocore_config=None, region_name=None)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger when a DMS classic replication task modification completes.

Parameters:
  • replication_task_arn (str) – The ARN of the replication task.

  • waiter_delay (int) – The amount of time in seconds to wait between attempts.

  • waiter_max_attempts (int) – The maximum number of attempts to be made.

  • aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

  • verify (bool | str | None) – Whether or not to verify SSL certificates.

  • botocore_config (dict | None) – Configuration dictionary (key-values) for botocore client.

  • region_name (str | None) – The AWS region where the resources to watch are.

aws_hook_class[source]
class airflow.providers.amazon.aws.triggers.dms.DmsTableReloadCompleteTrigger(*, replication_task_arn, tables_to_reload, reload_option='data-reload', waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', region_name=None, verify=None, botocore_config=None)[source]

Bases: airflow.triggers.base.BaseTrigger

Trigger when AWS DMS finishes reloading or validating a set of tables.

Parameters:
  • replication_task_arn (str) – The ARN of the replication task.

  • tables_to_reload (list[dict[str, str]]) – Tables being reloaded, including schema and table names.

  • reload_option (str) – The reload operation whose completion state should be monitored.

  • waiter_delay (int) – The amount of time in seconds to wait between attempts.

  • waiter_max_attempts (int) – The maximum number of attempts to be made.

  • aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

  • region_name (str | None) – AWS region name.

  • verify (bool | str | None) – Whether or not to verify SSL certificates.

  • botocore_config (dict | None) – Configuration dictionary (key-values) for botocore client.

replication_task_arn[source]
tables_to_reload[source]
reload_option = 'data-reload'[source]
waiter_delay = 30[source]
waiter_max_attempts = 60[source]
aws_conn_id = 'aws_default'[source]
region_name = None[source]
verify = None[source]
botocore_config = None[source]
serialize()[source]

Serialize trigger arguments and classpath.

async run()[source]

Poll table statistics until all requested operations finish.

Was this entry helpful?