airflow.providers.common.sql.datafusion.format_handlers¶

Classes¶

`ParquetFormatHandler`	Parquet format handler.
`CsvFormatHandler`	CSV format handler.
`AvroFormatHandler`	Avro format handler.
`IcebergFormatHandler`	Iceberg format handler for DataFusion.

Get a format handler based on the format type.

class airflow.providers.common.sql.datafusion.format_handlers.ParquetFormatHandler(datasource_config)[source]¶

Parquet format handler.

Return the format type.

register_data_source_format(ctx)[source]¶

Register a data source format.

class airflow.providers.common.sql.datafusion.format_handlers.CsvFormatHandler(datasource_config)[source]¶

CSV format handler.

Return the format type.

register_data_source_format(ctx)[source]¶

Register a data source format.

class airflow.providers.common.sql.datafusion.format_handlers.AvroFormatHandler(datasource_config)[source]¶

Avro format handler.

Return the format type.

register_data_source_format(ctx)[source]¶

Register a data source format.

class airflow.providers.common.sql.datafusion.format_handlers.IcebergFormatHandler(datasource_config)[source]¶

Iceberg format handler for DataFusion.

Loads an Iceberg table from a catalog using IcebergHook and registers it with a DataFusion SessionContext via register_table_provider.

Return the format type.

register_data_source_format(ctx)[source]¶

Register an Iceberg table with the DataFusion session context.

airflow.providers.common.sql.datafusion.format_handlers.get_format_handler(datasource_config)[source]¶

Get a format handler based on the format type.