Hi Everyone, Anyone can tell how much data volume ...
# ask-community-for-troubleshooting
r
Hi Everyone, Anyone can tell how much data volume airbyte handel easily ?
u
@Riya Tyagi there is no limit because you can deploy Airbyte with your infrastructure and manage the resources needed for your case. I have knowledge from some users sync individual tables with +100Gb and databases with +17Tb.
airbyte heart 1
r
okay I can consider this ....actually my concern related to my testing 1-I have tested on 2Gb of data in source->mysql and destination->mysql After processing through airbyte i get this result: • Time: 2h 13m 38s • Size: 5.1GB • Columns: 23 • Rows: 96,727,86(in Airbyte records-9785340) So can you suggest what infrastructure should we need for fastest processing of data? CPU and RAM?
u
It's complicated to estimate this. Do you have urgency to bring the first load? With this first test you can estimate the time that took to bring all data. What you can do is change the batchSize but for that you need to compile the source connector.