Example Airflow DAG showing export of database from Google Cloud Firestore to Cloud Storage.
This example creates collections in the default namespaces in Firestore, adds some data to the collection
and exports this database from Cloud Firestore to Cloud Storage.
It then creates a table from the exported data in Bigquery and checks that the data is in it.
Module Contents
-
tests.system.google.cloud.gcs.example_firestore.ENV_ID[source]
-
tests.system.google.cloud.gcs.example_firestore.PROJECT_ID[source]
-
tests.system.google.cloud.gcs.example_firestore.DAG_ID = 'firestore_to_gcp'[source]
-
tests.system.google.cloud.gcs.example_firestore.BUCKET_NAME[source]
-
tests.system.google.cloud.gcs.example_firestore.DATASET_NAME[source]
-
tests.system.google.cloud.gcs.example_firestore.EXPORT_DESTINATION_URL[source]
-
tests.system.google.cloud.gcs.example_firestore.EXPORT_COLLECTION_ID[source]
-
tests.system.google.cloud.gcs.example_firestore.EXTERNAL_TABLE_SOURCE_URI[source]
-
tests.system.google.cloud.gcs.example_firestore.DATASET_LOCATION = 'EU'[source]
-
tests.system.google.cloud.gcs.example_firestore.KEYS[source]
-
tests.system.google.cloud.gcs.example_firestore.create_bucket[source]
-
tests.system.google.cloud.gcs.example_firestore.test_run[source]