Amit Gelber10/25/2021, 10:02 AM
Chris (deprecated profile)
How does it split the load? by table? or each worker grab apart from a table?But in general, workers are taking care of all streams from the same source as part of a sync Unfortunately the load from a big 3TB source is not automatically split between multiple workers at the moment
what is the retry policy?
Can we retry failed parts of a table?There will be work around better handling partial checkpointing in the short/medium term too.
Was the k8s tested in production?yes. airbyte cloud is also managed on k8s
Amit Gelber10/25/2021, 2:21 PM
Davin Chia (Airbyte)