Hey Druid folks, I want to enable Druid query request logs in my cluster. I tried enabling https://druid.apache.org/docs/latest/operations/request-logging/ logs with

filtered

type. However, these only log the response of the queries and not the request workflow. The first log line which I get is when the data node has returned the response and sending it to broker. Is there a way to enable more verbose logging which would let me know the time spent in each phase of a query, including the time spent at broker before forwarding the request to data nodes and more visibility into time spent inside a data node?

You should check if your request logging is active only for the broker? When enabling for all services, you should get request logs from broker and historicals, in which case you might need to map queries and sub queries from the logs.

Hey @Utkarsh Chaturvedi, Thanks for the reply ! I have verified that the request logging is active on all brokers. I do get logs from historicals but they are emitted when the request is being returned from historical to the broker. There is no log emitted for when the query reaches (starts processing) on the historical.

I don't think it's possible to get the logs when the request is reaching the historicals

Thanks !