Hi Team, I need an advice regarding Source-hubspot...
# advice-data-ingestion
m
Hi Team, I need an advice regarding Source-hubspot data extraction nearly ~7M. I posted my question here can someone please guide me? https://discuss.airbyte.io/t/source-hubspot-contact-list-membership-contacts-extraction-performance-optimization/2219 Many Thanks
r
Ehy, my advice is to test the connector setting as starting day few days ago, to see data you need are there
then if it works, you might set the starting data as you need
unfortunately connectors are not always fully reliable (you might consider to build a connector specifically for this task)
m
I already test start date for last month that was successful but now I change back to required date. Here i have an issue
r
what if you apply filters to your source? so you set up multiple connections using different filters in each of them
m
how can I filter the source? I am thinking to create multiple connector/connections of hubspot and split it by month wise But for Source we only have Start Date filter there is no end date. Otherwise i could start the connector for extraction for each month proper start and end month. Otherwise it will overlap to each other.
r
Not sure how you can handle filtering, but maybe does the source allow you to pass initial parameters?
or...you can tweak the code of the connector to accept an additional parameter