java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Direct buffer memory
Renato Santos
03/17/2023, 2:27 PM
for now,I'm alrering maxNumConcurrentSubTasks=>1 to see if that fixes
g
Gian Merlino
03/21/2023, 5:46 AM
I'm not sure but I would suggest trying SQL-based ingest with MSQ (https://druid.apache.org/docs/latest/multi-stage-query/concepts.html) if you are having issues with memory management in native batch ingest
We revamped the memory management system and it's generally much less prone to OOME