Hi guys! Beginner's question: I configured the hub...
# replication-troubleshooting
g
Hi guys! Beginner's question: I configured the hubspot source and put "2022-09-26T000000Z" as the starting date, but after the sync was over, I went to look at the files and found records whose created_at field was from 2021! As I understand it, only records created from the start date would be synced, right?
m
The cursor field is not updated_at?
u
Hey Giovani, that does sound odd! Could you please attach the logs you got from the sync?
g
@Marcos Marx (Airbyte) yes, it is! In this case all data is sync? Is the start date field valid only when we choose full refresh? @Nataly Merezhuk (Airbyte) I attached the logs here
just following up on this ticket, am I doing something wrong with sync?
u
Hi Giovani, thanks for your patience on this! I don't see anything wrong that I can pinpoint in the logs. Could you tell me which streams you are syncing and what is the destination connector? https://docs.airbyte.com/integrations/sources/hubspot/#supported-streams
g
Sure! I'm syncing companies (incremental), contacts (incremental), deal_pipelines (full refresh | overwrite), deals (incremental), engagements (incremental), engagements_emails (incremental) and owners (full refresh | overwrite). is it not because I have synced incrementally? Or even in this case should the start date be respected?
u
The start date should be respected either way. Which stream had the
created_at
from 2021?
g
Companies, Deals and Contacts. Companies: airbyte sent 27193 records, but are 342 records when i filter on hubspot with create date after 2022-09-26. And without filters we had 44258 records on hubspot at that time Deals: airbyte sent 19253 records, but are 225 records when i filter on hubspot with create date after 2022-09-26. And without filters we had 19253 records on hubspot at that time Contacts: airbyte sent 105791 records, but are 1264 records when i filter on hubspot with create date after 2022-09-26. And without filters we had 150949 records on hubspot at that time I would like to better understand the reason for the numbers of records sent. In the case of contacts and companies, the number was not the total or what it should be if it respected the start date. In the case of deal, airbyte sent all the records. Why did this happen?
u
I think this is a bug with the connector! Could you please create an issue on Github and include all this information and the logs? Feel free to tag me there as @natalyjazzviolin , I'll help triage and we can continue there!
g
ok, i'll create! Thanks for the support Nataly!
u
No problem!