tests.system.amazon.aws.example_glue_data_quality¶

Attributes¶

`ROLE_ARN_KEY`
`sys_test_context_task`
`DAG_ID`
`SAMPLE_DATA`
`SAMPLE_FILENAME`
`RULE_SET`
`test_context`
`test_run`

Functions¶

`glue_data_quality_workflow`()
`delete_ruleset`(ruleset_name)

Module Contents¶

tests.system.amazon.aws.example_glue_data_quality.ROLE_ARN_KEY = 'ROLE_ARN'[source]¶

tests.system.amazon.aws.example_glue_data_quality.sys_test_context_task[source]¶

tests.system.amazon.aws.example_glue_data_quality.DAG_ID = 'example_glue_data_quality'[source]¶

tests.system.amazon.aws.example_glue_data_quality.SAMPLE_DATA = Multiline-String[source]¶

Show Value

""""Alice",20
    "Bob",25
    "Charlie",30"""

tests.system.amazon.aws.example_glue_data_quality.SAMPLE_FILENAME = 'airflow_sample.csv'[source]¶

tests.system.amazon.aws.example_glue_data_quality.RULE_SET = Multiline-String[source]¶

Show Value

"""
Rules = [
    RowCount between 2 and 8,
    IsComplete "name",
    Uniqueness "name" > 0.95,
    ColumnLength "name" between 3 and 14,
    ColumnValues "age" between 19 and 31
]
"""

tests.system.amazon.aws.example_glue_data_quality.glue_data_quality_workflow()[source]¶

tests.system.amazon.aws.example_glue_data_quality.delete_ruleset(ruleset_name)[source]¶

tests.system.amazon.aws.example_glue_data_quality.test_context = None[source]¶

tests.system.amazon.aws.example_glue_data_quality.test_run[source]¶