is there a way i can check how much memory is bein...
# general
a
is there a way i can check how much memory is being used during a query
j
Hi Aryna, Query processing is broken up into so many places I think it would be hard to estimate memory usage in a meaningful manner. And I don't know of any metrics that try to track it. Are you looking for anything specific, or any specific issues you are thinking to try to detect or avoid through monitoring? Thanks. John
a
hey john, so i’m processing a large amount of data and have a safe window where the query doesn’t crash. i’m trying to find the amount of memory it takes to prcoess that size of data.
j
It really depends on the query, how Druid will process it, and therefore where there might be limitations. Some queries scale extremely well, others are not in Druid's sweet spot. Can you provide an example query that we can comment on?