airflow.providers.common.sql.datafusion.engine

Classes

DataFusionEngine

Apache DataFusion engine.

Module Contents

class airflow.providers.common.sql.datafusion.engine.DataFusionEngine[source]

Bases: airflow.utils.log.logging_mixin.LoggingMixin

Apache DataFusion engine.

df_ctx[source]
registered_tables: dict[str, str][source]
property session_context: datafusion.SessionContext[source]

Return the session context.

register_datasource(datasource_config)[source]

Register a datasource with the datafusion engine.

execute_query(query)[source]

Execute a query and return the result as a dictionary.

get_schema(table_name)[source]

Get the schema of a table.

Was this entry helpful?