This message was deleted.
# troubleshooting
s
This message was deleted.
u
d
Not sure @추호관 which one can be used? The end goal is to use this port allocated to each task check the memory cosumption it is doing while it's running.
jvm/pool/used
Can the above metric be used for that?
u
I'm using it with jvmmonitor to see gc, mem/used
d
do you think it will solve my problem?
I think you asked same question already. Have you even try for collect metrics jvm/... categories?
d
We are already using these metrics for monitoring
u
I think your point is that you want to monitoring memory usage per task
d
Exactly I want that
each task how much memory it is consuming (whether it's index, compact)
Because I want to analyse these consumption and then come up with scalable approach
u
I agree for that cuz tasks have bunches of step or category as you said indexing or compacting ...
d
https://apachedruidworkspace.slack.com/archives/C0309C9L90D/p1684923698475239 This question is for that only. so if the port that is allocated to that particular task I can use the port get replaced in any of these metric which gives us the memory consumption can get the utilisation
u
Ahh than we can troubleshooting memory consumption more directly and determine scaling
d
One more amazing thing we can do actually with that. as we know for which data source this task would be running so for that particular data source we can also change ingestion Spec when I say spec we can allocate the required memory and other required resource based on our analysis
I am also interested to implement this actually https://github.com/apache/druid/issues/14253 but need some guidance actually for this. In terms of understanding required src and files.
u
I will look into that too. And in here, other guys can give more opinions too
d
Hopefully hear you soon @추호관 on this Thanks !