Software integrations

Software

These integrations allow you to perform various operations using various software.

Apprise

Hooks:

airflow.providers.apprise.hooks.apprise.

Provider:

apache-airflow-providers-apprise

Product documentation:

Apprise

ArangoDB

Operators:

airflow.providers.arangodb.operators.arangodb.

Hooks:

airflow.providers.arangodb.hooks.arangodb.

Sensors:

airflow.providers.arangodb.sensors.arangodb.

Provider:

apache-airflow-providers-arangodb

Product documentation:

ArangoDB

Asana

Operators:

airflow.providers.asana.operators.asana_tasks.

Hooks:

airflow.providers.asana.hooks.asana.

Guides:

AsanaCreateTaskOperator.

Provider:

apache-airflow-providers-asana

Product documentation:

Asana

Atlassian Jira

Operators:

airflow.providers.atlassian.jira.operators.jira.

Hooks:

airflow.providers.atlassian.jira.hooks.jira.

Sensors:

airflow.providers.atlassian.jira.sensors.jira.

Provider:

apache-airflow-providers-atlassian-jira

Product documentation:

Atlassian Jira

Celery

Sensors:

airflow.providers.celery.sensors.celery_queue.

Provider:

apache-airflow-providers-celery

Product documentation:

Celery

Cohere

Operators:

airflow.providers.cohere.operators.embedding.

Hooks:

airflow.providers.cohere.hooks.cohere.

Guides:

CohereEmbeddingOperator.

Provider:

apache-airflow-providers-cohere

Product documentation:

Cohere

Common IO

Operators:

airflow.providers.common.io.operators.file_transfer.

Guides:

IO Operators.

Provider:

apache-airflow-providers-common-io

Product documentation:

Common IO

Common SQL

Operators:

airflow.providers.common.sql.operators.sql.

Hooks:

airflow.providers.common.sql.hooks.handlers, airflow.providers.common.sql.hooks.sql.

Sensors:

airflow.providers.common.sql.sensors.sql.

Guides:

SQL Operators.

Provider:

apache-airflow-providers-common-sql

Product documentation:

Common SQL

Docker

Operators:

airflow.providers.docker.operators.docker.

Hooks:

airflow.providers.docker.hooks.docker.

Provider:

apache-airflow-providers-docker

Product documentation:

Docker

Docker Swarm

Operators:

airflow.providers.docker.operators.docker_swarm.

Provider:

apache-airflow-providers-docker

Product documentation:

Docker Swarm

Elasticsearch

Hooks:

airflow.providers.elasticsearch.hooks.elasticsearch.

Provider:

apache-airflow-providers-elasticsearch

Product documentation:

Elasticsearch

Exasol

Operators:

airflow.providers.exasol.operators.exasol.

Hooks:

airflow.providers.exasol.hooks.exasol.

Provider:

apache-airflow-providers-exasol

Product documentation:

Exasol

Github

Operators:

airflow.providers.github.operators.github.

Hooks:

airflow.providers.github.hooks.github.

Sensors:

airflow.providers.github.sensors.github.

Provider:

apache-airflow-providers-github

Product documentation:

Github

Hashicorp Vault

Hooks:

airflow.providers.hashicorp.hooks.vault.

Provider:

apache-airflow-providers-hashicorp

Product documentation:

Hashicorp Vault

Iceberg

Hooks:

airflow.providers.apache.iceberg.hooks.iceberg.

Provider:

apache-airflow-providers-apache-iceberg

Product documentation:

Iceberg

Influxdb

Operators:

airflow.providers.influxdb.operators.influxdb.

Hooks:

airflow.providers.influxdb.hooks.influxdb.

Provider:

apache-airflow-providers-influxdb

Product documentation:

Influxdb

Jenkins

Operators:

airflow.providers.jenkins.operators.jenkins_job_trigger.

Hooks:

airflow.providers.jenkins.hooks.jenkins.

Sensors:

airflow.providers.jenkins.sensors.jenkins.

Provider:

apache-airflow-providers-jenkins

Product documentation:

Jenkins

Kubernetes

Operators:

airflow.providers.cncf.kubernetes.operators.custom_object_launcher, airflow.providers.cncf.kubernetes.operators.kueue, airflow.providers.cncf.kubernetes.operators.pod, airflow.providers.cncf.kubernetes.operators.spark_kubernetes, airflow.providers.cncf.kubernetes.operators.resource, airflow.providers.cncf.kubernetes.operators.job.

Hooks:

airflow.providers.cncf.kubernetes.hooks.kubernetes.

Sensors:

airflow.providers.cncf.kubernetes.sensors.spark_kubernetes.

Guides:

KubernetesPodOperator.

Provider:

apache-airflow-providers-cncf-kubernetes

Product documentation:

Kubernetes

Microsoft SQL Server (MSSQL)

Hooks:

airflow.providers.microsoft.mssql.hooks.mssql.

Guides:

Connect to MSSQL using SQLExecuteQueryOperator.

Provider:

apache-airflow-providers-microsoft-mssql

Product documentation:

Microsoft SQL Server (MSSQL)

MongoDB

Hooks:

airflow.providers.mongo.hooks.mongo.

Sensors:

airflow.providers.mongo.sensors.mongo.

Provider:

apache-airflow-providers-mongo

Product documentation:

MongoDB

MySQL

Hooks:

airflow.providers.mysql.hooks.mysql.

Guides:

How-to Guide for Mysql using SQLExecuteQueryOperator.

Provider:

apache-airflow-providers-mysql

Product documentation:

MySQL

Neo4j

Operators:

airflow.providers.neo4j.operators.neo4j.

Hooks:

airflow.providers.neo4j.hooks.neo4j.

Guides:

Neo4jOperator.

Provider:

apache-airflow-providers-neo4j

Product documentation:

Neo4j

OpenAI

Operators:

airflow.providers.openai.operators.openai.

Hooks:

airflow.providers.openai.hooks.openai.

Guides:

OpenAIEmbeddingOperator.

Provider:

apache-airflow-providers-openai

Product documentation:

OpenAI

OpenFaaS

Hooks:

airflow.providers.openfaas.hooks.openfaas.

Provider:

apache-airflow-providers-openfaas

Product documentation:

OpenFaaS

OpenSearch

Operators:

airflow.providers.opensearch.operators.opensearch.

Hooks:

airflow.providers.opensearch.hooks.opensearch.

Guides:

OpenSearch.

Provider:

apache-airflow-providers-opensearch

Product documentation:

OpenSearch

Oracle

Operators:

airflow.providers.oracle.operators.oracle.

Hooks:

airflow.providers.oracle.hooks.oracle.

Provider:

apache-airflow-providers-oracle

Product documentation:

Oracle

Papermill

Operators:

airflow.providers.papermill.operators.papermill.

Hooks:

airflow.providers.papermill.hooks.kernel.

Guides:

Papermill.

Provider:

apache-airflow-providers-papermill

Product documentation:

Papermill

pgvector

Operators:

airflow.providers.pgvector.operators.pgvector.

Hooks:

airflow.providers.pgvector.hooks.pgvector.

Guides:

PgVectorIngestOperator.

Provider:

apache-airflow-providers-pgvector

Product documentation:

pgvector

Pinecone

Operators:

airflow.providers.pinecone.operators.pinecone.

Hooks:

airflow.providers.pinecone.hooks.pinecone.

Guides:

Operators.

Provider:

apache-airflow-providers-pinecone

Product documentation:

Pinecone

PostgreSQL

Hooks:

airflow.providers.postgres.hooks.postgres.

Guides:

How-to Guide for Postgres using SQLExecuteQueryOperator.

Provider:

apache-airflow-providers-postgres

Product documentation:

PostgreSQL

Presto

Hooks:

airflow.providers.presto.hooks.presto.

Provider:

apache-airflow-providers-presto

Product documentation:

Presto

Qdrant

Operators:

airflow.providers.qdrant.operators.qdrant.

Hooks:

airflow.providers.qdrant.hooks.qdrant.

Guides:

QdrantIngestOperator.

Provider:

apache-airflow-providers-qdrant

Product documentation:

Qdrant

Redis

Operators:

airflow.providers.redis.operators.redis_publish.

Hooks:

airflow.providers.redis.hooks.redis.

Sensors:

airflow.providers.redis.sensors.redis_key, airflow.providers.redis.sensors.redis_pub_sub.

Provider:

apache-airflow-providers-redis

Product documentation:

Redis

Singularity

Operators:

airflow.providers.singularity.operators.singularity.

Provider:

apache-airflow-providers-singularity

Product documentation:

Singularity

SQLite

Hooks:

airflow.providers.sqlite.hooks.sqlite.

Guides:

SQLExecuteQueryOperator to connect to Sqlite.

Provider:

apache-airflow-providers-sqlite

Product documentation:

SQLite

Teradata

Operators:

airflow.providers.teradata.operators.teradata, airflow.providers.teradata.operators.teradata_compute_cluster.

Hooks:

airflow.providers.teradata.hooks.teradata.

Guides:

TeradataOperator, TeradataComputeClusterProvisionOperator.

Provider:

apache-airflow-providers-teradata

Product documentation:

Teradata

Trino

Hooks:

airflow.providers.trino.hooks.trino.

Guides:

Connect to Trino using SQLExecuteQueryOperator.

Provider:

apache-airflow-providers-trino

Product documentation:

Trino

Vertica

Hooks:

airflow.providers.vertica.hooks.vertica.

Provider:

apache-airflow-providers-vertica

Product documentation:

Vertica

Weaviate

Operators:

airflow.providers.weaviate.operators.weaviate.

Hooks:

airflow.providers.weaviate.hooks.weaviate.

Guides:

WeaviateIngestOperator.

Provider:

apache-airflow-providers-weaviate

Product documentation:

Weaviate

YDB

Operators:

airflow.providers.ydb.operators.ydb.

Hooks:

airflow.providers.ydb.hooks.ydb.

Guides:

How-to Guide for using YDB Operators.

Provider:

apache-airflow-providers-ydb

Product documentation:

YDB

Zendesk

Hooks:

airflow.providers.zendesk.hooks.zendesk.

Provider:

apache-airflow-providers-zendesk

Product documentation:

Zendesk

Transfers

These integrations allow you to copy data.

Vertica to Apache Hive

Source product documentation:

Vertica

Target product documentation:

Apache Hive

Python API:

airflow.providers.apache.hive.transfers.vertica_to_hive

Provider:

apache-airflow-providers-apache-hive

Apache Hive to MySQL

Source product documentation:

Apache Hive

Target product documentation:

MySQL

Python API:

airflow.providers.apache.hive.transfers.hive_to_mysql

Provider:

apache-airflow-providers-apache-hive

MySQL to Apache Hive

Source product documentation:

MySQL

Target product documentation:

Apache Hive

Python API:

airflow.providers.apache.hive.transfers.mysql_to_hive

Provider:

apache-airflow-providers-apache-hive

Microsoft SQL Server (MSSQL) to Apache Hive

Source product documentation:

Microsoft SQL Server (MSSQL)

Target product documentation:

Apache Hive

Python API:

airflow.providers.apache.hive.transfers.mssql_to_hive

Provider:

apache-airflow-providers-apache-hive

Presto to Google Cloud Storage (GCS)

Source product documentation:

Presto

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

Presto to Google Cloud Storage Transfer Operator

Python API:

airflow.providers.google.cloud.transfers.presto_to_gcs

Provider:

apache-airflow-providers-google

Trino to Google Cloud Storage (GCS)

Source product documentation:

Trino

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

Trino to Google Cloud Storage Transfer Operator

Python API:

airflow.providers.google.cloud.transfers.trino_to_gcs

Provider:

apache-airflow-providers-google

Common SQL to Google Cloud Storage (GCS)

Source product documentation:

Common SQL

Target product documentation:

Google Cloud Storage (GCS)

Python API:

airflow.providers.google.cloud.transfers.sql_to_gcs

Provider:

apache-airflow-providers-google

PostgreSQL to Google Cloud Storage (GCS)

Source product documentation:

PostgreSQL

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

Postgres To Google Cloud Storage Operator

Python API:

airflow.providers.google.cloud.transfers.postgres_to_gcs

Provider:

apache-airflow-providers-google

Google BigQuery to Common SQL

Source product documentation:

Google BigQuery

Target product documentation:

Common SQL

Python API:

airflow.providers.google.cloud.transfers.bigquery_to_sql

Provider:

apache-airflow-providers-google

Google BigQuery to MySQL

Source product documentation:

Google BigQuery

Target product documentation:

MySQL

Operator guide:

Google Cloud BigQuery Transfer Operator to MySQL

Python API:

airflow.providers.google.cloud.transfers.bigquery_to_mysql

Provider:

apache-airflow-providers-google

Google BigQuery to Microsoft SQL Server (MSSQL)

Source product documentation:

Google BigQuery

Target product documentation:

Microsoft SQL Server (MSSQL)

Operator guide:

Google Cloud BigQuery Transfer Operator to Microsoft SQL Server

Python API:

airflow.providers.google.cloud.transfers.bigquery_to_mssql

Provider:

apache-airflow-providers-google

Google BigQuery to PostgreSQL

Source product documentation:

Google BigQuery

Target product documentation:

PostgreSQL

Operator guide:

Google Cloud BigQuery Transfer Operator to Postgres

Python API:

airflow.providers.google.cloud.transfers.bigquery_to_postgres

Provider:

apache-airflow-providers-google

MySQL to Google Cloud Storage (GCS)

Source product documentation:

MySQL

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

MySQL To Google Cloud Storage Operator

Python API:

airflow.providers.google.cloud.transfers.mysql_to_gcs

Provider:

apache-airflow-providers-google

Oracle to Google Cloud Storage (GCS)

Source product documentation:

Oracle

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

Oracle To Google Cloud Storage Operator

Python API:

airflow.providers.google.cloud.transfers.oracle_to_gcs

Provider:

apache-airflow-providers-google

Common SQL to Google Spreadsheet

Source product documentation:

Common SQL

Target product documentation:

Google Spreadsheet

Operator guide:

SQL to Google Sheets Transfer Operators

Python API:

airflow.providers.google.suite.transfers.sql_to_sheets

Provider:

apache-airflow-providers-google

Microsoft SQL Server (MSSQL) to Google Cloud Storage (GCS)

Source product documentation:

Microsoft SQL Server (MSSQL)

Target product documentation:

Google Cloud Storage (GCS)

Operator guide:

Microsoft SQL Server To Google Cloud Storage Operator

Python API:

airflow.providers.google.cloud.transfers.mssql_to_gcs

Provider:

apache-airflow-providers-google

Vertica to MySQL

Source product documentation:

Vertica

Target product documentation:

MySQL

Python API:

airflow.providers.mysql.transfers.vertica_to_mysql

Provider:

apache-airflow-providers-mysql

Amazon Simple Storage Service (S3) to MySQL

Source product documentation:

Amazon Simple Storage Service (S3)

Target product documentation:

MySQL

Python API:

airflow.providers.mysql.transfers.s3_to_mysql

Provider:

apache-airflow-providers-mysql

Presto to MySQL

Source product documentation:

Presto

Target product documentation:

MySQL

Python API:

airflow.providers.mysql.transfers.presto_to_mysql

Provider:

apache-airflow-providers-mysql

Trino to MySQL

Source product documentation:

Trino

Target product documentation:

MySQL

Python API:

airflow.providers.mysql.transfers.trino_to_mysql

Provider:

apache-airflow-providers-mysql

Oracle to Oracle

Source product documentation:

Oracle

Target product documentation:

Oracle

Python API:

airflow.providers.oracle.transfers.oracle_to_oracle

Provider:

apache-airflow-providers-oracle

Google Cloud Storage (GCS) to Presto

Source product documentation:

Google Cloud Storage (GCS)

Target product documentation:

Presto

Operator guide:

Google Cloud Storage to Presto Transfer Operator

Python API:

airflow.providers.presto.transfers.gcs_to_presto

Provider:

apache-airflow-providers-presto

Common SQL to Slack

Source product documentation:

Common SQL

Target product documentation:

Slack

Python API:

airflow.providers.slack.transfers.base_sql_to_slack

Provider:

apache-airflow-providers-slack

Common SQL to Slack API

Source product documentation:

Common SQL

Target product documentation:

Slack API

Operator guide:

SqlToSlackApiFileOperator

Python API:

airflow.providers.slack.transfers.sql_to_slack

Provider:

apache-airflow-providers-slack

Common SQL to Slack Incoming Webhook

Source product documentation:

Common SQL

Target product documentation:

Slack Incoming Webhook

Operator guide:

SqlToSlackWebhookOperator

Python API:

airflow.providers.slack.transfers.sql_to_slack_webhook

Provider:

apache-airflow-providers-slack

Teradata to Teradata

Source product documentation:

Teradata

Target product documentation:

Teradata

Operator guide:

TeradataToTeradataOperator

Python API:

airflow.providers.teradata.transfers.teradata_to_teradata

Provider:

apache-airflow-providers-teradata

Microsoft Azure Blob Storage to Teradata

Source product documentation:

Microsoft Azure Blob Storage

Target product documentation:

Teradata

Operator guide:

AzureBlobStorageToTeradataOperator

Python API:

airflow.providers.teradata.transfers.azure_blob_to_teradata

Provider:

apache-airflow-providers-teradata

Amazon Simple Storage Service (S3) to Teradata

Source product documentation:

Amazon Simple Storage Service (S3)

Target product documentation:

Teradata

Operator guide:

S3ToTeradataOperator

Python API:

airflow.providers.teradata.transfers.s3_to_teradata

Provider:

apache-airflow-providers-teradata

Google Cloud Storage (GCS) to Trino

Source product documentation:

Google Cloud Storage (GCS)

Target product documentation:

Trino

Operator guide:

Google Cloud Storage to Trino Transfer Operator

Python API:

airflow.providers.trino.transfers.gcs_to_trino

Provider:

apache-airflow-providers-trino

MongoDB to Amazon Simple Storage Service (S3)

Source product documentation:

MongoDB

Target product documentation:

Amazon Simple Storage Service (S3)

Operator guide:

MongoDB to Amazon S3

Python API:

airflow.providers.amazon.aws.transfers.mongo_to_s3

Provider:

apache-airflow-providers-amazon

Exasol to Amazon Simple Storage Service (S3)

Source product documentation:

Exasol

Target product documentation:

Amazon Simple Storage Service (S3)

Python API:

airflow.providers.amazon.aws.transfers.exasol_to_s3

Provider:

apache-airflow-providers-amazon

Common SQL to Amazon Simple Storage Service (S3)

Source product documentation:

Common SQL

Target product documentation:

Amazon Simple Storage Service (S3)

Operator guide:

SQL to Amazon S3

Python API:

airflow.providers.amazon.aws.transfers.sql_to_s3

Provider:

apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) to Common SQL

Source product documentation:

Amazon Simple Storage Service (S3)

Target product documentation:

Common SQL

Operator guide:

Amazon S3 to SQL

Python API:

airflow.providers.amazon.aws.transfers.s3_to_sql

Provider:

apache-airflow-providers-amazon

Oracle to Microsoft Azure Data Lake Storage

Source product documentation:

Oracle

Target product documentation:

Microsoft Azure Data Lake Storage

Python API:

airflow.providers.microsoft.azure.transfers.oracle_to_azure_data_lake

Provider:

apache-airflow-providers-microsoft-azure

Was this entry helpful?