Hi all, we have we’re using the hubspot connector ...
# replication-troubleshooting
k
Hi all, we have we’re using the hubspot connector and specifically the email_events table as a source and are retrieving negating
created
dates. Anyone else experience this / know why it’s occurring? I can confirm that retrieving the same data using the api key directly using postman works and retrieves the correct epoch date.
IMG_1899.jpg
n
Hey King! Could you include the full logs? I need more info to understand what's happening here.
k
Logs from Airbyte are fairly generic and don’t show any problems. But when the rows from that table to to bigquery they show up sometimes as negative numbers. I can still provide logs but I doubt they will help. Needless to say we don’t have records that should give a created date from before 1970
u
Yes, they would still be helpful!
k
n
Thanks! Could you please update everything? I see both Airbyte and the connectors are a few versions behind. Then we will look further into what's going on 🙂
k
I have updated everything now but we have also found that there are more issues with the hubspot data once pushed into bigquery.
this is the latest log that i stopped because it endlessly gave json schema errors
n
Honestly I've never seen a connector get stuck like this! What environment are you running in and do you care about the data you currently have in Airbyte? Resetting the whole instance might be a radical solution here but I'm sure it would work.
k
We have rebuilt the environment a few times. It used to be on a k8s cluster, now it’s a vm in gcp. We may have found that it was not to do with the hubspot connector but rather the denormalised struct bigquery destination connector messing up the time stamps / larger integers. I saw a few issues where this was happening for other users.
We noticed that the latest release was not necessarily behaving as expected so decided to go with a lower versions but honestly any advice from you guys on this would be great.
@tanuj soni
t
Thanks King.
I also kept getting the json schema invalid error while feting the data from source(hubpsot). This error is something which I had faced earlier but this seems to be a persistant error could you please help me understand why this error is still present. I am attaching the logs for reference