airflow.providers.google.cloud.transfers.presto_to_gcs

Classes

PrestoToGCSOperator

Copy data from PrestoDB to Google Cloud Storage in JSON, CSV or Parquet format.

Module Contents

class airflow.providers.google.cloud.transfers.presto_to_gcs.PrestoToGCSOperator(*, presto_conn_id='presto_default', **kwargs)[source]

Bases: airflow.providers.google.cloud.transfers.sql_to_gcs.BaseSQLToGCSOperator

Copy data from PrestoDB to Google Cloud Storage in JSON, CSV or Parquet format.

Parameters:

presto_conn_id (str) – Reference to a specific Presto hook.

template_fields: collections.abc.Sequence[str] = ('sql', 'bucket', 'filename', 'schema_filename', 'schema', 'parameters', 'impersonation_chain',...[source]
ui_color = '#a0e08c'[source]
type_map[source]
presto_conn_id = 'presto_default'[source]
query()[source]

Query presto and returns a cursor to the results.

field_to_bigquery(field)[source]

Convert presto field type to BigQuery field type.

convert_type(value, schema_type, **kwargs)[source]

Do nothing. Presto uses JSON on the transport layer, so types are simple.

Parameters:

  • value – Presto column value

  • schema_type – BigQuery data type

Was this entry helpful?