Hi team, I'm using Datastream and BigQuery. The ta...
# contribute-code
f
Hi team, I'm using Datastream and BigQuery. The table on BigQuery is a upsert table. So, it will get a error when it execute query on https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/bigquery_v2/queries.py#L72 My question: Seem likes this query only collect the size of table, number of partition, etc. We can skip this metric. Do we have any suggestion to deal with it? We also can check exception and default a value in this case.
r
Hi Duong! If you're still hitting this issue, I highly suggest joining us at the Community Marathon tomorrow! We have a variety of troubleshooting & support sessions scheduled throughout the day where we can give live help :) https://datahubspace.slack.com/archives/CUMV92XRQ/p1705433341623299
👍 1