Hello, Is this your first time deploying Airbyte: ...
# troubleshooting
d
Hello, Is this your first time deploying Airbyte: Yes OS Version / Instance: Digital Ocean Droplet - Ubuntu Memory / Disk: 8Gb / 80Gb Airbyte Version: 0.35.23 Source name/version: MongoDB Destination name/version: Redshift Step: sync failed without error Description: after some successful sync tests using a few data, we tried to sync all our source data (~400 millions rows) but the synchronization failed without any error message. The sync attempt is marked as failed but the log file doesn't show any error message.
c
Hey Mathieu can you try loading less data
a
We already try with smaller datasets and it worked well. But in the end, we need all data. On the second attempt, a "Disk full" error was raised. So basically our Redshift destination database was still too small (even after the space upgrades). We realized that Redshift is too costly for our needs so we're switching to BigQuery. Thanks for your help @Harshith (Airbyte) 🙏