Is this your first time deploying Airbyte: Yes  OS...
# ask-community-for-troubleshooting
d
Is this your first time deploying Airbyte: Yes  OS Version / Instance: MacOS  Memory / Disk: 8GB, 64GB Deployment: Docker  Airbyte Version: 0.29.21-alpha  Source name/version: Salesforce 0.1.1 File 0.24 Destination name/version: BigQuery (denormalized typed struct) 0.1.5 Step: On sync  Description: I'm trying to sync for the first time and the process doesn't finish. I’m very much a beginner so I expect everything to be my fault. I’ll provide the log of the first attempt in a thread.
1
👀 1
logs-6-0.txt
Every attempt seems to do a bit better for every time
u
Every attempt seems to do a bit better for every time
So the errors are not the same? Could you share another log? Maybe select a few stream from Saleforce to ensure the connection!
d
First of all I had all streams (that means tables right?) selected. Some data came over to BigQuery. I then selected a few other streams, that made other data come over. When looking in airbyte I got 3 failed attempts, however the last one did result in data being transfered into BigQuery. I'll share the last attempt which resulted in data being transfered to BQ (but also failed attempt)
logs-6-2.txt
h
Hey David can you also share for the other 2. I can see there is a 400 bad URL just want to get more info to understand it
d
Ok! This is the 2:nd
The first one is in top of this thread
@Harshith (Airbyte) ☝️
h
Hey David as you said it's failing with different for me it looks more like issue on Salesforce side is it possible to check with them once ?
Or is there something you can think off which helps us?
c
@Yevhenii Kurochkin have you maybe seen these kinds of errors from salesforce API before?
y
Hi, Have not seen a similar error. At first it seemed that the request limit might have expired, but for BULK API the daily limit for records is 150,000,000. @David Beck Could you please select only the problematic streams:
et4ae5__JB_CDC_Event__e
,
et4ae5__IndividualEmailResult__c
,
et4ae5__IndividualEmailResult__c
, and start reading only these streams, and tell us what happened?
d
I'm running it now! Fresh instance, on GCP instead of local, and to a new dataset. I'm trying the streams that where problematic. I'll let you know when its done.
👍🏻 1
@Yevhenii Kurochkin Unfortunatelly it didn't work this time either ... It ran for quite a time without problems it seemed (+5h), but then failed. Corrupt data? Should i use the normalized BigQuery destination instead?
Saw two upgrades for both connector and source, trying that ...
"Invalid datetime string "2021-10-01T143631.000Z" Field: LastModifiedDate; Value: 2021-10-01T143631.000Z" I guess that the Z is throwing this error
But I don't get it. Its defined as a string in Airbyte
h
@David Beck where did you find the invalid datetime string error ?
d
@Harshith (Airbyte) In BigQuerys job-report 🙂 I did some additional testing this weekend, and I switched the destination type to the regular Big Query. That seems to work a lot better!
h
Awesome 👍 thanks for sharing that. So things are good on your side now ?
d
Yes! Perhaps its a bug in the BigQuery (denormalized typed struct) that you could look into, if you want. But for me I can go on with the other connector. Thanks for you support!