Slackbot
05/10/2023, 4:50 PMHagen Rother
05/10/2023, 4:52 PMGian Merlino
05/10/2023, 7:26 PMdruid.server.tier
is more for segment assignment so I wouldn't expect that to stick hereGian Merlino
05/10/2023, 7:26 PMdruid.worker.category
OTOH I would expect to be honored… I see the same code in Indexer and MM for setting it from the props fileGian Merlino
05/10/2023, 7:28 PMworkerCategorySpec
are at https://druid.apache.org/docs/latest/configuration/index.html#equal-distribution-with-category-specGian Merlino
05/10/2023, 7:28 PMequalDistributionWithCategorySpec
Gian Merlino
05/10/2023, 7:28 PMworkerCategorySpec
is ignored)Hagen Rother
05/10/2023, 8:18 PM_default_tier
. which is ok, as long as I could pin all index_kafka
to it and everything else to a default tier with a different name. Is there a comprehensive list of tasks, if I have to spell it out?Gian Merlino
05/10/2023, 10:57 PMGian Merlino
05/10/2023, 10:57 PMGian Merlino
05/10/2023, 10:57 PMGian Merlino
05/10/2023, 10:58 PMtype
. IIRC it'll list out all the valid types in the error messageHagen Rother
05/11/2023, 9:48 PM{% if item.tier is defined %}
druid_server_tier={{ item.tier }}
druid_worker_category={{ item.tier }}
{% endif %}
I feed that into apache/druid:25.0.0
docker image. middleManger
and historical
respect it, indexer doesn't.Hagen Rother
05/11/2023, 10:30 PM$ curl -s -X POST druid-router.service.dw2.consul:8888/druid/indexer/v1/task -d'{"type":"reflection"' -H "Content-Type: application/json"|grep -o -E "\[.*?\]"|head -1|grep -o -E '\w+'|sort|jq --raw-input . | jq --slurp .
[
"archive",
"compact",
"index",
"index_hadoop",
"index_kafka",
"index_parallel",
"index_realtime",
"index_realtime_appenderator",
"index_sub",
"kill",
"move",
"noop",
"partial_dimension_cardinality",
"partial_dimension_distribution",
"partial_index_generate",
"partial_index_generic_merge",
"partial_range_index_generate",
"query_controller",
"query_worker",
"restore",
"single_phase_sub_task"
]
maybe it's late, but you don't make it simple. How about an api call that just gives me this output?Hagen Rother
05/16/2023, 11:35 AMindexer
is observing category, but not showing in router overview.Gian Merlino
06/07/2023, 12:05 PMmaybe it's late, but you don't make it simple. How about an api call that just gives me this output?ouch, I guess we deserve that 🙂 yeah, that'd be nice, as opposed to relying on an error message!
Gian Merlino
06/07/2023, 12:06 PMfollow up: looks like indexer is observing category, but not showing in router overview.ah, good to know! that probably means it isn't in
sys.servers
(or it is but the UI isn't showing it)