Hi team, I'm using Datastream and BigQuery. The ta...
# all-things-deployment
f
Hi team, I'm using Datastream and BigQuery. The table on BigQuery is a upsert table. So, it will get a error when it execute query on https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/bigquery_v2/queries.py#L72 My question: Seem likes this query only collect the size of table, number of partition, etc. We can skip this metric. Do we have any suggestion to deal with it? We also can check exception and default a value in this case
Copy code
`{{project_id}}`.`{{dataset_name}}`.INFORMATION_SCHEMA.PARTITIONS
d
@future-controller-3884 what is the exception you get?
f
Sorry, I replied you late. On my use-case, I'm using Datastream to stream data to BigQuery. The current query generated on codebase will be get the error when it's executed.
Copy code
unapplied upsert data cannot be queried through prefix