Hi Folks, I have a connection with s3 destination taking 90% of time of the execution cleaning the s3 folders.
Is this your first time deploying Airbyte: No
Memory / Disk: 8Gb / 16GB
Deployment: EKS
Airbyte Version: 0.41.0
Source name/version: Postgres 1.0.42
Destination name/version: S3 0.4.0
Step: Running the connection
Description: The connection extracts data from 32 tables, 25 using full method. The connection is taking 6 hours and 20 mins to get done... It took 6h and 10m cleaning the S3 folders... and 9 minutes to extract data.
*C*ould you folks suggest any tip or approach to have a better performance on this case?