Hello, Need help regarding query laning. How histo...
# general
r
Hello, Need help regarding query laning. How historical resources(threads) are used in case of query laning. Let's suppose we have two lane, fast and slow lane. fast lane have 70% threads of borker and slow lane 30%. 1. If only one query running at that time in either of the lane. how historical threads will be used? will all historical thread will be used ? 2. If one only query running in slow lane(take around 10 sec to complete) . while running this query, one query comes in fast lane. how it will impact to slow lane query. will slow lane query get slow down ?
j
To my knowledge -- The Historicals do not participate in query laning or priority -- that is only done at the Broker level and to determine which query is run next. Any query can access and or all Historicals that have the data that the query needs. Separately you can tier the Historicals in a couple of different ways, but not tied to the Broker query laning or priority.
m
@John Kowtko is thought it matters for historicals too. See: https://medium.com/@kyle.hoondert/query-prioritization-in-apache-druid-79f2023fc1f2
“Query priorities are then passed on to the Historical and Indexer services (data nodes). In the data nodes, subqueries are executed on a per-segment basis according to priority, this way higher priority queries can move up the queue and be executed earlier.”
I guess that is not related to query laning directly but one of the laning strategies can adjust query priority
j
My bad ... I should have said query laning only. I am not that familiar with query priority ... although Kyle's blog explains he concept nicely 🙂