Reference for Database Migrations¶
Here’s the list of all the Database Migrations that are executed via when you run airflow db migrate
.
Warning
Those migration details are mostly used here to make the users aware when and what kind of migrations will be executed during migrations between specific Airflow versions. The intention here is that the “DB conscious” users might perform an analysis on the migrations and draw conclusions about the impact of the migrations on their Airflow database. Those users might also want to take a look at the ERD Schema of the Database document to understand how the internal DB of Airflow structure looks like. However, you should be aware that the structure is internal and you should not access the DB directly to retrieve or modify any data - you should use the REST API to do that instead.
Revision ID |
Revises ID |
Airflow Version |
Description |
---|---|---|---|
|
|
|
remove pickled data from dagrun table. |
|
|
|
Add asset reference models. |
|
|
|
Remove processor_subdir. |
|
|
|
Add deadline alerts table. |
|
|
|
update trigger_timeout column in task_instance table to UTC. |
|
|
|
Add DagBundleModel. |
|
|
|
Remove pickled data from xcom table. |
|
|
|
Add references between assets and triggers. |
|
|
|
add dag versioning. |
|
|
|
Drop DAG pickling. |
|
|
|
Add last_heartbeat_at directly to TI. |
|
|
|
Drop task_fail table. |
|
|
|
remove scheduler_lock column. |
|
|
|
Add UUID primary key to |
|
|
|
Rename dataset as asset. |
|
|
|
Add exception_reason and logical_date to BackfillDagRun. |
|
|
|
Tweak AssetAliasModel to match AssetModel after AIP-76. |
|
|
|
Add AssetActive to track orphaning instead of a flag. |
|
|
|
Add backfill to dag run model. |
|
|
|
Add name and group fields to DatasetModel. |
|
|
|
Update dag_run_note.user_id and task_instance_note.user_id columns to String. |
|
|
|
Remove redundant index. |
|
|
|
Add tables for backfill. |
|
|
|
Drop |
|
|
|
Add triggered_by field to DagRun. |
|
|
|
Rename DagModel schedule_interval to timetable_summary. |
|
|
|
Remove SubDAGs: |
|
|
|
Drop ab_user.id foreign key. |
|
|
|
Rename dag_schedule_dataset_alias_reference constraint names. |
|
|
|
Add dag_schedule_dataset_alias_reference table. |
|
|
|
Add dataset_alias_dataset association table. |
|
|
|
Add try_number to audit log. |
|
|
|
Add dataset_alias_dataset_event. |
|
|
|
Add dataset_alias. |
|
|
|
Add task_instance_history. |
|
|
|
Added DagPriorityParsingRequest table. |
|
|
|
add new executor field to db. |
|
|
|
Add indexes on dag_id column in referencing tables. |
|
|
|
Fix inconsistency between ORM and migration files. |
|
|
|
Remove |
|
|
|
update trigger kwargs type and encrypt. |
|
|
|
add display name for dag and task instance. |
|
|
|
Change value column type to longblob in xcom table for mysql. |
|
|
|
Adding max_consecutive_failed_dag_runs column to dag_model table. |
|
|
|
add dataset_expression in DagModel. |
|
|
|
Add run_id to (Audit) log table and increase event name length. |
|
|
|
Add rendered_map_index to TaskInstance. |
|
|
|
Drop unused TI index. |
|
|
|
Add processor_subdir to ImportError. |
|
|
|
Make connection login/password TEXT. |
|
|
|
Add owner_display_name to (Audit) Log table. |
|
|
|
add new field ‘clear_number’ to dagrun. |
|
|
|
add include_deferred column to pool. |
|
|
|
Add custom_operator_name column. |
|
|
|
Add index to task_instance table. |