apache-airflowApache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation.
Task-SDK interface that is used to communicate with airflow core from other components.
It makes efficient, lightweight, self-contained environment and guarantees that software will always run the same no matter of where it's deployed.
It will help you set up your own Airflow on a cloud/on-prem k8s environment and leverage its scalable nature to support a large group of users. Thanks to Kubernetes, we are not tied to a specific cloud provider.
Providers packages include integrations with third party integrations. They are updated independently of the Apache Airflow core.
AirbyteAlibabaAmazonApache BeamApache CassandraApache DrillApache DruidApache FlinkApache HDFSApache HiveApache IcebergApache ImpalaApache KafkaApache KylinApache LivyApache PigApache PinotApache SparkApache TinkerPopAppriseArangoDBAsanaAtlassian JiraCeleryIBM CloudantKubernetesCohereCommon CompatCommon IOCommon MessagingCommon SQLDatabricksDatadogdbt CloudDingdingDiscordDockerEdge ExecutorElasticsearchExasolFabFacebookFile Transfer Protocol (FTP)GITGithubGooglegRPCHashicorpHypertext Transfer Protocol (HTTP)Internet Message Access Protocol (IMAP)InfluxdbJava Database Connectivity (JDBC)JenkinsKeycloakMicrosoft AzureMicrosoft SQL Server (MSSQL)PowerShell Remoting Protocol (PSRP)Windows Remote Management (WinRM)MongoDBMySQLNeo4jODBCOpenAIOpenFaaSOpenLineage AirflowOpenSearchOpsgenieOraclePagerdutyPapermillpgvectorPineconePostgreSQLPrestoQdrantRedisSalesforceSambaSegmentSendgridSFTPSingularitySlackSimple Mail Transfer Protocol (SMTP)SnowflakeSQLiteSSHStandardTableauTelegramTeradataTrinoVerticaWeaviateYandexYDBZendesk