A general question about good practices in airbyte, I am replicating multiple tables from a psql db to another, however one of the tables is extremely large and takes around 12 hours to sync after a reset, would it be a good practice to make different connectors for different tables if it works ?

@Prateek Gupta yeah you can do that!

any method to shorten the time needed for the large table, 12hourrs for setting something up on production is too long foor a usecase like mine

this question comes up a bit. atm it seems like it’s a personal preference / balance. your suggestion is a common approach. regarding speeding up, using staging S3 bucket to leverage bulk COPY. but would be curious of other tips and tricks

@gunu is there documentation on setting up the S3 staging bucket?

Thank you!

but this can't work for me since my destination is a postgres database