Hi friends, I have 100 GB data in Postgres which I...
# replication-troubleshooting
s
Hi friends, I have 100 GB data in Postgres which I want to dump in redshift, I tried using airbyte and it took 7 hours. Is there any way I can do this data load very faster? Please help.
@Marcos Marx (Airbyte) Could you please help?
u
You can increase the memory of your server. Connectors you dynamic batch sizes, increasing the memory of source connector will make it consume more records each batch. Also using the S3 staging method in destination can improve the loading time!
s
I am using s3 staging method already. How to increase the batch size?
m
How to increase the batch size?
you can increase the memory of your airbyte server