`apache-airflow-providers-apache-arrow`¶

apache-airflow-providers-apache-arrow package¶

Apache Arrow provider for Airflow. Offers AdbcHook, a general-purpose hook that connects to any database supported by an Arrow Database Connectivity (ADBC) driver (PostgreSQL, SQLite, DuckDB, Snowflake, BigQuery, Flight SQL, and more) and transfers data as columnar Arrow RecordBatch objects for efficient, zero-copy bulk loads.

Release: 0.1.0

Provider package¶

This package is for the apache.arrow provider. All classes for this package are included in the airflow.providers.apache.arrow python package.

Installation¶

You can install this package on top of an existing Airflow installation via pip install apache-airflow-providers-apache-arrow. For the minimum Airflow version supported, see Requirements below.

Requirements¶

The minimum Apache Airflow version supported by this provider distribution is 2.11.0.

PIP package	Version required
`apache-airflow`	`>=2.11.0`
`apache-airflow-providers-common-sql`	`>=1.28.2`
`adbc-driver-manager`	`>=1.7.0`
`more-itertools`	`>=9.0.0`
`pyarrow`	`>=16.1.0; python_version < "3.13"`
`pyarrow`	`>=18.0.0; python_version >= "3.13"`

Optional dependencies¶

These extras install optional third-party libraries that enable additional features of the provider. Install them when installing from PyPI. For example:

pip install apache-airflow-providers-apache-arrow[sqlite]

Extra	Dependencies
`sqlite`	`adbc-driver-sqlite>=1.7.0`
`snowflake`	`adbc-driver-snowflake>=1.7.0`
`bigquery`	`adbc-driver-bigquery>=1.7.0`
`flightsql`	`adbc-driver-flightsql>=1.7.0`
`postgresql`	`adbc-driver-postgresql>=1.7.0`
`all`	`adbc-driver-sqlite>=1.7.0`, `adbc-driver-snowflake>=1.7.0`, `adbc-driver-bigquery>=1.7.0`, `adbc-driver-flightsql>=1.7.0`, `adbc-driver-postgresql>=1.7.0`

Downloading official packages¶

You can download officially released packages and verify their checksums and signatures from the Official Apache Download site

apache-airflow-providers-apache-arrow¶