Anything to go the other way? I’d like to use BQ to warehouse and be able to examine but PG to do heavy analytics due to the cost once you really start doing many repeated queries.
I guess I could just dump directly to CSVs and download but BQ is a nice convenient bottomless data bucket.
do you already have an ETL pipeline to BQ? You could use Airbyte[0] for pg to bq. It's pretty heavy if this is your only source, but should work well if you need to query the pg data in bq frequently.
Comments
Anything to go the other way? I’d like to use BQ to warehouse and be able to examine but PG to do heavy analytics due to the cost once you really start doing many repeated queries.
I guess I could just dump directly to CSVs and download but BQ is a nice convenient bottomless data bucket.
do you already have an ETL pipeline to BQ? You could use Airbyte[0] for pg to bq. It's pretty heavy if this is your only source, but should work well if you need to query the pg data in bq frequently.
0 - https://airbyte.com/connections/PostgreSQL-to-BigQuery
They said "the other way" so BQ to Postgres.
BigQuery and Postgres are both sources and destinations in Airbyte, the data can flow either way.
Airbyte looks nice! thanks.
You can utilize BI engine for this exact purpose: https://cloud.google.com/bigquery/docs/bi-engine-query