Hi, I had question about Running ELT in Kubernetes as pod
If ELT is running in a POD, for a large dataset, The Source fetches data in batches, Does it need to persist those batch in FileSystem / PVC Or does it all happen in memory ?
Can a job fill up the PVC or Memory if the load is too huge ? (edited)