airflow.example_dags.example_asset_store

Example Dag that demonstrates using AIP-103 asset store to track a watermark across DAG runs. The producer reads the last watermark, processes only new records, then advances the watermark. The consumer is triggered by the asset event and reads asset store to understand what the producer just loaded.

Asset store persists on the asset across runs — unlike task store which is scoped to a single task instance. This replaces the common pattern of storing watermarks in Airflow Variables, which have no asset-level scoping.

Attributes

ORDERS

Functions

load([asset_store])

consume([asset_store])

Module Contents

airflow.example_dags.example_asset_store.ORDERS[source]
airflow.example_dags.example_asset_store.load(asset_store=None)[source]
airflow.example_dags.example_asset_store.consume(asset_store=None)[source]

Was this entry helpful?