This message was deleted.

This would be something very useful for our usage cases.

If you want to give it a try Kai, I will be happy to help with review or design. We can rope in @Vadim for any web-console changes

Sure, let me have a look.

This would be awesome

Guys, let me revive this thread a little bit. For the past two month, I worked on some query performance tuning in our system, mainly to reduce the query latency and specifically in the real time path. In the mean time, I find that a query insight tool like proposed above would be very valuable. More specifically, the following would be useful and some of them are missing: 1/ per segment query processing time 2/ per segment waiting time for the processing queue and current queue size 3/ per hydrant query processing time -- missing 4/ per hydrant waiting time thread time -- if paralleled, missing 5/ per query merge buffer acquisition time and current waiting queue size -- missing 6/ post segment processing grouper potentially spilling to disk time -- missing These information should not be limited to only brokers, but also data node (peons and historicals).

Yes indeed such a tool would be very useful.

This kind of instrumentation, and a nice interface (eg SQL) would be amazing, thank you. (If not SQL, emitting metrics.)