Hi, I had question about Running ELT in Kubernetes as pod
If ELT is running in a POD, for a large dataset, The Source fetches data in batches, Does it need to persist those batch in FileSystem / PVC Or does it all happen in memory ?
Can a job fill up the PVC or Memory if the load is too huge ? (edited)
05/06/2022, 2:05 PM
In memory. PVCs are not used for anything, nor is local storage afaik