in that case they will be stored off heap but the lookups will still take up memory in the page cache (so ultimately the available RAM will be a hard limit).
d
D K
02/02/2023, 1:26 PM
got it thanks
D K
02/02/2023, 1:27 PM
One other question related to druid.processing.buffer.sizeBytes. currently we have this configured as 1Gb. Will there be a query performance improvement if we keep the value higher at say 3 GB?
v
Vijay Narayanan
02/02/2023, 2:00 PM
max buffer size is 2GB. Setting buffer to max 2GB could help but there is a trade off as it will reduce available memory for memory mapping segments and hence segments will be paged from disk