https://linen.dev logo
s

Sai

12/14/2021, 3:09 PM
Hi, Could someone point me to the source or a quick brief about how the data is transferred between Source and Destination and once the pipeline is triggered, i.e If I use
Salesforce
as the source and
GCP GCS
as a destination, do airbyte pull all the data from the source first then stage it on temporary storage and then start streaming the temporarily stored data to the destination i.e
GCP GCS
?? I see
streams
usage but would like to understand how this is handled with large datasets like 20 GB or 30 GB data. Disclaimer : Just started using Airbyte.
u

user

12/15/2021, 8:02 PM
Think you are looking for these docs https://docs.airbyte.io/understanding-airbyte/jobs
2 Views