For kafka ingestion tasks, during the publishing s...
# general
d
For kafka ingestion tasks, during the publishing stage to deep storage, ingestion task merge the data from intermediate persists. When the merge happens, which memory is being used? Is it direct memory or heap? In either case, how do we go about calculating the amount of memory to allocate (if we know the avg row size)?