Azure: Microsoft Azure

Airflow has limited support for Microsoft Azure.

Some hooks are based on airflow.providers.microsoft.azure.hooks.base_azure which authenticate Azure’s Python SDK Clients.

Services

These integrations allow you to perform various operations within the Microsoft Azure.

Microsoft Azure

Hooks:

airflow.providers.microsoft.azure.hooks.base_azure.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure

Microsoft Azure Batch

Operators:

airflow.providers.microsoft.azure.operators.batch.

Hooks:

airflow.providers.microsoft.azure.hooks.batch.

Guides:

Azure Batch Operator.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Batch

Microsoft Azure Blob Storage

Operators:

airflow.providers.microsoft.azure.operators.wasb_delete_blob.

Hooks:

airflow.providers.microsoft.azure.hooks.wasb.

Sensors:

airflow.providers.microsoft.azure.sensors.wasb.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Blob Storage

Microsoft Azure Container Instances

Operators:

airflow.providers.microsoft.azure.operators.container_instances.

Hooks:

airflow.providers.microsoft.azure.hooks.container_volume, airflow.providers.microsoft.azure.hooks.container_registry, airflow.providers.microsoft.azure.hooks.container_instance.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Container Instances

Microsoft Azure Cosmos DB

Operators:

airflow.providers.microsoft.azure.operators.cosmos.

Hooks:

airflow.providers.microsoft.azure.hooks.cosmos.

Sensors:

airflow.providers.microsoft.azure.sensors.cosmos.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Cosmos DB

Microsoft Azure Data Explorer

Operators:

airflow.providers.microsoft.azure.operators.adx.

Hooks:

airflow.providers.microsoft.azure.hooks.adx.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Data Explorer

Microsoft Azure Data Factory

Operators:

airflow.providers.microsoft.azure.operators.data_factory.

Hooks:

airflow.providers.microsoft.azure.hooks.data_factory.

Sensors:

airflow.providers.microsoft.azure.sensors.data_factory.

Guides:

Azure Data Factory Operators.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Data Factory

Microsoft Azure Data Lake Storage

Operators:

airflow.providers.microsoft.azure.operators.adls.

Hooks:

airflow.providers.microsoft.azure.hooks.data_lake.

Guides:

Azure DataLake Storage Operators.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Data Lake Storage

Microsoft Azure Data Lake Storage Client Gen2

Hooks:

airflow.providers.microsoft.azure.hooks.data_lake.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Data Lake Storage Client Gen2

Microsoft Azure FileShare

Hooks:

airflow.providers.microsoft.azure.hooks.fileshare.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure FileShare

Microsoft Azure Service Bus

Operators:

airflow.providers.microsoft.azure.operators.asb.

Hooks:

airflow.providers.microsoft.azure.hooks.asb.

Guides:

Azure Service Bus Operators.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Service Bus

Microsoft Azure Synapse

Operators:

airflow.providers.microsoft.azure.operators.synapse.

Hooks:

airflow.providers.microsoft.azure.hooks.synapse.

Guides:

Azure Synapse Operators.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Azure Synapse

Microsoft Graph API

Operators:

airflow.providers.microsoft.azure.operators.msgraph.

Hooks:

airflow.providers.microsoft.azure.hooks.msgraph.

Sensors:

airflow.providers.microsoft.azure.sensors.msgraph.

Guides:

Microsoft Graph API Operators.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Graph API

Microsoft Power BI

Operators:

airflow.providers.microsoft.azure.operators.powerbi.

Hooks:

airflow.providers.microsoft.azure.hooks.powerbi.

Guides:

Microsoft Power BI Operators.

Provider:

apache-airflow-providers-microsoft-azure

Product documentation:

Microsoft Power BI

Transfers

These integrations allow you to copy data from/to Microsoft Azure.

Microsoft Azure FileShare to Google Cloud Storage (GCS)

Source product documentation:

Microsoft Azure FileShare

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

Transfers data from Azure FileShare Storage to Google Cloud Storage

Python API:

airflow.providers.google.cloud.transfers.azure_fileshare_to_gcs

Provider:

apache-airflow-providers-google

Microsoft Azure Data Lake Storage to Google Cloud Storage (GCS)

Source product documentation:

Microsoft Azure Data Lake Storage

Target product documentation:

Google Cloud Storage (GCS)

Python API:

airflow.providers.google.cloud.transfers.adls_to_gcs

Provider:

apache-airflow-providers-google

Microsoft Azure Blob Storage to Google Cloud Storage (GCS)

Source product documentation:

Microsoft Azure Blob Storage

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

Azure Blob Storage to Google Cloud Storage (GCS) Transfer Operator

Python API:

airflow.providers.google.cloud.transfers.azure_blob_to_gcs

Provider:

apache-airflow-providers-google

Microsoft Azure Blob Storage to Snowflake

Source product documentation:

Microsoft Azure Blob Storage

Target product documentation:

Snowflake

Python API:

airflow.providers.snowflake.transfers.copy_into_snowflake

Provider:

apache-airflow-providers-snowflake

Microsoft Azure Blob Storage to Teradata

Source product documentation:

Microsoft Azure Blob Storage

Target product documentation:

Teradata

Operator guide:

AzureBlobStorageToTeradataOperator

Python API:

airflow.providers.teradata.transfers.azure_blob_to_teradata

Provider:

apache-airflow-providers-teradata

Microsoft Azure Blob Storage to Amazon Simple Storage Service (S3)

Source product documentation:

Microsoft Azure Blob Storage

Target product documentation:

Amazon Simple Storage Service (S3)

Operator guide:

Azure Blob Storage to Amazon S3 transfer operator

Python API:

airflow.providers.amazon.aws.transfers.azure_blob_to_s3

Provider:

apache-airflow-providers-amazon

Local to Microsoft Azure Data Lake Storage

Target product documentation:

Microsoft Azure Data Lake Storage

Operator guide:

Upload data from Local Filesystem to Azure Data Lake

Python API:

airflow.providers.microsoft.azure.transfers.local_to_adls

Provider:

apache-airflow-providers-microsoft-azure

Oracle to Microsoft Azure Data Lake Storage

Source product documentation:

Oracle

Target product documentation:

Microsoft Azure Data Lake Storage

Python API:

airflow.providers.microsoft.azure.transfers.oracle_to_azure_data_lake

Provider:

apache-airflow-providers-microsoft-azure

Local to Microsoft Azure Blob Storage

Target product documentation:

Microsoft Azure Blob Storage

Operator guide:

Upload data from Local Filesystem to Azure Blob Storage

Python API:

airflow.providers.microsoft.azure.transfers.local_to_wasb

Provider:

apache-airflow-providers-microsoft-azure

SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage

Source product documentation:

SSH File Transfer Protocol (SFTP)

Target product documentation:

Microsoft Azure Blob Storage

Operator guide:

SFTP to Azure Blob Storage Transfer Operator

Python API:

airflow.providers.microsoft.azure.transfers.sftp_to_wasb

Provider:

apache-airflow-providers-microsoft-azure

Amazon Simple Storage Service (S3) to Microsoft Azure Blob Storage

Source product documentation:

Amazon Simple Storage Service (S3)

Target product documentation:

Microsoft Azure Blob Storage

Operator guide:

Amazon S3 to Azure Blob Storage Transfer Operator

Python API:

airflow.providers.microsoft.azure.transfers.s3_to_wasb

Provider:

apache-airflow-providers-microsoft-azure

Was this entry helpful?