Jiyuan Zheng
09/03/2021, 9:35 PMDavin Chia (Airbyte)
Jiyuan Zheng
09/04/2021, 2:39 PMJobs-wise, we are mainly concerned with Sync jobs when thinking about scale. Sync jobs sync data from sources to destinations and are the majority of jobs run. Sync jobs use two workers. One worker reads from the source; the other worker writes to the destination.
It sounds like for a sync job (in a connection), only 1 worker reads from the source db (so 1 table a time?) and as a result I don’t need to worry about the performance impact to the source. Can you confirm my understanding is correct?Davin Chia (Airbyte)
Jiyuan Zheng
09/05/2021, 3:45 PM