apache-airflow
Apache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation.
Providers packages include integrations with third party integrations. They are updated independently of the Apache Airflow core.
Airbyte
Alibaba
Amazon
Apache Beam
Apache Cassandra
Apache Drill
Apache Druid
Apache Flink
Apache HDFS
Apache Hive
Apache Impala
Apache Kafka
Apache Kylin
Apache Livy
Apache Pig
Apache Pinot
Apache Spark
Apache Sqoop
ArangoDB
Asana
Atlassian Jira
Celery
IBM Cloudant
Kubernetes
Common SQL
Databricks
Datadog
dbt Cloud
Dingding
Discord
Docker
Elasticsearch
Exasol
Facebook
File Transfer Protocol (FTP)
Github
Google
gRPC
Hashicorp
Hypertext Transfer Protocol (HTTP)
Internet Message Access Protocol (IMAP)
Influxdb
Java Database Connectivity (JDBC)
Jenkins
Microsoft Azure
Microsoft SQL Server (MSSQL)
PowerShell Remoting Protocol (PSRP)
Windows Remote Management (WinRM)
MongoDB
MySQL
Neo4j
ODBC
OpenFaaS
OpenLineage Airflow
Opsgenie
Oracle
Pagerduty
Papermill
Plexus
PostgreSQL
Presto
Qubole
Redis
Salesforce
Samba
Segment
Sendgrid
SFTP
Singularity
Slack
Simple Mail Transfer Protocol (SMTP)
Snowflake
SQLite
SSH
Tableau
Tabular
Telegram
Trino
Vertica
Zendesk
It makes efficient, lightweight, self-contained environment and guarantees that software will always run the same no matter of where it's deployed.
It will help you set up your own Airflow on a cloud/on-prem k8s environment and leverage its scalable nature to support a large group of users. Thanks to Kubernetes, we are not tied to a specific cloud provider.