airflow.providers.openlineage.plugins.macros

Module Contents

Functions

lineage_job_namespace()

Macro function which returns Airflow OpenLineage namespace.

lineage_job_name(task_instance)

Macro function which returns Airflow task name in OpenLineage format (<dag_id>.<task_id>).

lineage_run_id(task_instance)

Macro function which returns the generated run id (UUID) for a given task.

lineage_parent_id(task_instance)

Macro function which returns a unique identifier of given task that can be used to create ParentRunFacet.

airflow.providers.openlineage.plugins.macros.lineage_job_namespace()[source]

Macro function which returns Airflow OpenLineage namespace.

See also

For more information take a look at the guide: OpenLineage Macros

airflow.providers.openlineage.plugins.macros.lineage_job_name(task_instance)[source]

Macro function which returns Airflow task name in OpenLineage format (<dag_id>.<task_id>).

See also

For more information take a look at the guide: OpenLineage Macros

airflow.providers.openlineage.plugins.macros.lineage_run_id(task_instance)[source]

Macro function which returns the generated run id (UUID) for a given task.

This can be used to forward the run id from a task to a child run so the job hierarchy is preserved.

See also

For more information take a look at the guide: OpenLineage Macros

airflow.providers.openlineage.plugins.macros.lineage_parent_id(task_instance)[source]

Macro function which returns a unique identifier of given task that can be used to create ParentRunFacet.

This identifier is composed of the namespace, job name, and generated run id for given task, structured as ‘{namespace}/{job_name}/{run_id}’. This can be used to forward task information from a task to a child run so the job hierarchy is preserved. Child run can easily create ParentRunFacet from these information.

See also

For more information take a look at the guide: OpenLineage Macros

Was this entry helpful?