Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

If I configure airbyte-worker with the resources
```limits:
  cpu: 2
  memory: 1Gi```
does this mean any sync in Airbyte can pull at max &lt;1G-(some memory for processing) = ~500MB data?
So if I want to sync 5000MB records, do I need to configure memory: 8GB
If each records is 100MB how much memory do I need?
What is the processing overhead? How much additional memory do I need to configure in addition to the volume of data?