https://linen.dev logo
Channels
Powered by
m

Micah

01/29/2021, 5:30 AM
Can one of you guys point me in the right direction? All connection tests are successful, and I am able to use this setup to interact through Python.
u

user

01/29/2021, 5:31 AM
Hi Micah
u

user

01/29/2021, 5:32 AM
What makes you think it is failing?
u

user

01/29/2021, 5:32 AM
The error logs?
u

user

01/29/2021, 5:32 AM
The dataset in BigQuery has nothing but empty tables.
u

user

01/29/2021, 5:33 AM
But the job is still running right?
u

user

01/29/2021, 5:33 AM
Yep.
u

user

01/29/2021, 5:33 AM
It didn’t fail or did it
u

user

01/29/2021, 5:33 AM
Ok
u

user

01/29/2021, 5:34 AM
It is possible that nothing is is BQ yet
u

user

01/29/2021, 5:34 AM
Ah!
u

user

01/29/2021, 5:34 AM
Because we buffer before writing
u

user

01/29/2021, 5:34 AM
Would something like this take a long time for the first sync? The site has ~3,000 users/day
u

user

01/29/2021, 5:35 AM
How long has it been running?
u

user

01/29/2021, 5:35 AM
Google has some really tight rate limit policies in place
u

user

01/29/2021, 5:35 AM
I just deleted an old connection that was running for 30 mins.
u

user

01/29/2021, 5:36 AM
🤦‍♂️
u

user

01/29/2021, 5:37 AM
I thought it was broken since then, so I deleted it and have been trying to figure this out.
u

user

01/29/2021, 5:37 AM
Can you let it run until it finishes (or fails)
u

user

01/29/2021, 5:37 AM
Yep! Thank you! This particular site has a lot of data.
u

user

01/29/2021, 5:37 AM
If it’s buffering the results, that makes a lot of sense.
u

user

01/29/2021, 5:38 AM
Yep subsequent runs should go faster (I think GA has incremental)
u

user

01/29/2021, 5:38 AM
What does that ERROR message mean in that log?
u

user

01/29/2021, 5:38 AM
After I got impatient, I saw those.
u

user

01/29/2021, 5:39 AM
Mis-labeled logs
u

user

01/29/2021, 5:40 AM
Gotcha. Thank you very much for your help!
u

user

01/29/2021, 5:40 AM
I’ve been fussing with this for 3 hours thinking something was broken now. I consider that a “Stupid Tax”.
u

user

01/29/2021, 5:40 AM
You’re welcome!
u

user

01/29/2021, 5:44 AM
If it doesn’t work in the end, let us know we can help fix it!!
u

user

01/29/2021, 5:46 AM
Will do. Thank you very much!
u

user

01/29/2021, 6:57 AM
AirByte worked great!
u

user

01/29/2021, 6:57 AM
It was impatience.
2 Views
Powered by