apache-airflow-providers-dbt-cloud

Changelog¶

4.0.0¶

Note

This release of provider is only available for Airflow 2.9+ as explained in the Apache Airflow providers support policy.

Breaking changes¶

Warning

All deprecated classes, parameters and features have been removed from the DBT provider package. The following breaking changes were introduced:

Sensors
- Remove airflow.providers.dbt.cloud.sensors.dbt.DbtCloudJobRunAsyncSensor. Use airflow.providers.dbt.cloud.sensors.dbt.DbtCloudJobRunSensor with deferrable set to True instead.
- Removed polling_interval parameter from DbtCloudJobRunSensor. Use poke_interval instead.

Remove Provider Deprecations in DBT (#44638)

Misc¶

Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)
Fix yoda-conditions (#44466)
utilize more information to deterministically generate OpenLineage run_id (#43936)
Remove commented breakpoint in dbt provider (#44163)
Rename execution_date to logical_date across codebase (#43902)

3.11.2¶

Bug Fixes¶

Added condition to check if it is a scheduled save or rerun (#43453)

3.11.1¶

Misc¶

Set lower bound to asgiref>=2.3.0 (#43001)

3.11.0¶

Features¶

Add ability to provide proxy for dbt Cloud connection (#42737)

Misc¶

Simplify code for recent dbt provider change (#42840)

3.10.1¶

Misc¶

remove deprecated soft_fail from providers (#41710)

3.10.0¶

Note

This release of provider is only available for Airflow 2.8+ as explained in the Apache Airflow providers support policy.

Misc¶

Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)

3.9.0¶

Features¶

Add 'retry_from_failure' parameter to DbtCloudRunJobOperator (#38868)

Bug Fixes¶

Fix 'DbtCloudRunJobOperator' to Use Correct Status Parameters for 'reuse_existing_run' (#40048)

3.8.1¶

Warning

You need to take action on this note only if you are running Airflow>=2.10.0 In Airflow 2.10.0, we fix the way try_number works, so that it no longer returns different values depending on task instance state. Importantly, after the task is done, it no longer shows current_try + 1. Thus we patch this provider to fix try_number references so they no longer adjust for the old, bad behavior.

Bug Fixes¶

Scheduler to handle incrementing of try_number (#39336)
Validate dbt 'cause' field to be less than 255 characters (#38896)

Misc¶

Faster 'airflow_version' imports (#39552)
Simplify 'airflow_version' imports (#39497)
Add (optional) dependency between dbt-cloud and openlineage providers (#39366)

3.8.0¶

Note

This release of provider is only available for Airflow 2.7+ as explained in the Apache Airflow providers support policy.

Bug Fixes¶

fix(dbt): fix wrong payload set when reuse_existing_run set to True in DbtCloudRunJobOperator (#39271)

Misc¶

Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)
migrate to dbt v3 api for project endpoints (#39214)

3.7.1¶

Bug Fixes¶

fix: disabled_for_operators now stops whole event emission (#38033)
fix(dbt): add return statement to yield within a while loop in triggers (#38395)

3.7.0¶

Features¶

feat(providers/dbt): add reuse_existing_run for allowing DbtCloudRunJobOperator to reuse existing run (#37474)

3.6.1¶

Misc¶

Bump aiohttp min version to avoid CVE-2024-23829 and CVE-2024-23334 (#37110)
feat: Switch all class, functions, methods deprecations to decorators (#36876)

3.6.0¶

Features¶

feat: Add dag_id when generating OpenLineage run_id for task instance. (#36659)

Bug Fixes¶

Fix stacklevel in warnings.warn into the providers (#36831)

3.5.1¶

Bug Fixes¶

Follow BaseHook connection fields method signature in child classes (#36086)

3.5.0¶

Note

This release of provider is only available for Airflow 2.6+ as explained in the Apache Airflow providers support policy.

Misc¶

Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)

3.4.1¶

Bug Fixes¶

added cancelled handling in DbtCloudRunJobOperator deferred (#35597)

3.4.0¶

Note

This release of provider is only available for Airflow 2.5+ as explained in the Apache Airflow providers support policy.

Misc¶

Bump min airflow version of providers (#34728)
Remove useless print from dbt operator (#34322)

3.3.0¶

Features¶

Add OpenLineage support for DBT Cloud. (#33959)

Bug Fixes¶

fix(providers/redis): respect soft_fail argument when exception is raised (#34164)
dbt, openlineage: set run_id after defer, do not log error if operator has no run_id set (#34270)

Misc¶

Remove some useless try/except from providers code (#33967)
Use a single statement with multiple contexts instead of nested statements in providers (#33768)

3.2.3¶

Misc¶

Refactor: Remove useless str() calls (#33629)
Refactor: Simplify code in smaller providers (#33234)

3.2.2¶

Misc¶

Add default_deferrable config (#31712)

3.2.1¶

Note

This release dropped support for Python 3.7

Misc¶

Remove Python 3.7 support (#30963)

3.2.0¶

Note

This release of provider is only available for Airflow 2.4+ as explained in the Apache Airflow providers support policy.

Misc¶

Bump minimum Airflow version in providers (#30917)
Optimize deferred execution mode in DbtCloudJobRunSensor (#30968)
Optimize deferred execution mode for DbtCloudRunJobOperator (#31188)

3.1.1¶

Misc¶

Merge DbtCloudJobRunAsyncSensor logic to DbtCloudJobRunSensor (#30227)
Move typing imports behind TYPE_CHECKING in DbtCloudHook (#29989)

3.1.0¶

Features¶

Add 'DbtCloudJobRunAsyncSensor' (#29695)

3.0.0¶

Breaking changes¶

Beginning with version 2.0.0, users could specify single-tenant dbt Cloud domains via the schema parameter in an Airflow connection. Subsequently in version 2.3.1, users could also connect to the dbt Cloud instances outside of the US region as well as private instances by using the host parameter of their Airflow connection to specify the entire tenant domain. Backwards compatibility for using schema was left in place. Version 3.0.0 removes support for using schema to specify the tenant domain of a dbt Cloud instance. If you wish to connect to a single-tenant, instance outside of the US, or a private instance, you must use the host parameter to specify the _entire_ tenant domain name in your Airflow connection.

Drop Connection.schema use in DbtCloudHook (#29166)

Features¶

Allow downloading of dbt Cloud artifacts to non-existent paths (#29048)
Add deferrable mode to 'DbtCloudRunJobOperator' (#29014)

Misc¶

Provide more context for 'trigger_reason' in DbtCloudRunJobOperator (#28994)

2.3.1¶

Bug Fixes¶

Use entire tenant domain name in dbt Cloud connection (#28890)

2.3.0¶

Note

This release of provider is only available for Airflow 2.3+ as explained in the Apache Airflow providers support policy.

Misc¶

Move min airflow version to 2.3.0 for all providers (#27196)

2.2.0¶

Features¶

Add 'DbtCloudListJobsOperator' (#26475)

2.1.0¶

Features¶

Improve taskflow type hints with ParamSpec (#25173)

2.0.1¶

Bug Fixes¶

Update providers to use functools compat for ''cached_property'' (#24582)

2.0.0¶

Breaking changes¶

Note

This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy.

Features¶

Enable dbt Cloud provider to interact with single tenant instances (#24264)

Bug Fixes¶

Fix typo in dbt Cloud provider description (#23179)
Fix new MyPy errors in main (#22884)

1.0.2¶

Bug Fixes¶

Fix mistakenly added install_requires for all providers (#22382)

1.0.1¶

Initial version of the provider.