Hi everyone!
*Airbyte Version*: 0.35.53-alpha
*Sou...
# troubleshootingf
Filipe Araújo
03/14/2022, 5:43 PMHi everyone!
Airbyte Version: 0.35.53-alpha
Source name/version: Hubspot 0.1.45
Destination name/version: Postgres 0.3.15
Step: Running Full Refresh Hubspot
Description: By accessing the Hubspot dashboard I can see that I have around 362k engagement (activities), I run my connection on Saturday afternoon and till now its still importing with 32 Million (and counting) rows for the engagements. Can you help me try to understand what is happening? Since version 0.1.43 I can’t seem to get this running probably, with that version I got the 362k engagement. Thanks!
Filipe Araújo
03/15/2022, 9:26 AMhi @[DEPRECATED] Marcos Marx, unfortunately we still getting a weird behavior, since yesterday we have more then 5M rows
Filipe Araújo
03/15/2022, 9:27 AMthe thing is, by looking into the data I’m getting duplicates
Filipe Araújo
03/15/2022, 9:27 AMcheck the id inside
_airbyte_dataFilipe Araújo
03/15/2022, 9:28 AMthe
_airbyte_emitted_atFilipe Araújo
03/15/2022, 12:59 PM@[DEPRECATED] Marcos Marx can you help me with this ? how can I debug this issue ? thanks
Filipe Araújo
03/15/2022, 9:01 PM@[DEPRECATED] Marcos Marx one of the reasons I updated to the new version was the new deals structure which I need to import
Filipe Araújo
03/15/2022, 9:06 PMconcerning the data, I’m assuming the id that is inside the json element
"id": 8391227241Filipe Araújo
03/15/2022, 9:07 PMits unique, I will check the content
Filipe Araújo
03/15/2022, 11:24 PMits unique, the only different fields are the airbyte ones
Filipe Araújo
03/15/2022, 11:26 PM@[DEPRECATED] Marcos Marx ˆ
m
Marcos Marx (Airbyte)
03/15/2022, 11:28 PMThe content is the same or is unique inside the json object, is not clear.
f
Filipe Araújo
03/16/2022, 9:14 AM@[DEPRECATED] Marcos Marx I think it's unique, later I will compare one by one, however should I spend time doing that instead of trying to debug ?
m
Marcos Marx (Airbyte)
03/17/2022, 1:24 AM@Filipe Araújo the best would return to a version that was working to you and open a Github issue to team take a look.
f
Filipe Araújo
03/17/2022, 7:23 PMhi @[DEPRECATED] Marcos Marx thanks for the tip, fyi, I notice there are a lot of
Copy code
2022-03-16 23:56:55 [44msource[0m > Backing off get(...) for 0.0s (source_hubspot.errors.HubspotRateLimited: 429 Rate Limit Exceeded: API rate-limit has been reached until None seconds. See <https://developers.hubspot.com/docs/api/usage-details>)` Copy code
2022-03-17 02:16:06 [44msource[0m > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
2022-03-17 02:16:11 [44msource[0m > Caught retryable error '' after 1 tries. Waiting 5 seconds then retrying...Filipe Araújo
03/17/2022, 7:23 PMI don’t know if this can request again and replicate the data
Filipe Araújo
03/17/2022, 7:23 PMI will a different approach like, export everything except the
engagementsFilipe Araújo
03/21/2022, 11:06 AM@[DEPRECATED] Marcos Marx https://github.com/airbytehq/airbyte/issues/11252
Filipe Araújo
03/21/2022, 11:06 AMit seems its really an issue
Filipe Araújo
03/21/2022, 11:07 AMI think there are already a fix to it, https://github.com/airbytehq/airbyte/pull/11266
Filipe Araújo
03/21/2022, 11:07 AMhope it can be deployed as quick as possible, thanks!
m
Marcos Marx (Airbyte)
03/23/2022, 2:18 AMIt was merged, can you update to latest version?
f
Filipe Araújo
03/23/2022, 4:03 PM@[DEPRECATED] Marcos Marx yes, already tested and it worked! thanks! ✅
4 Views