Slackbot
05/10/2023, 4:50 PMHagen Rother
05/10/2023, 4:52 PMGian Merlino
05/10/2023, 7:26 PMdruid.server.tier is more for segment assignment so I wouldn't expect that to stick hereGian Merlino
05/10/2023, 7:26 PMdruid.worker.category OTOH I would expect to be honored… I see the same code in Indexer and MM for setting it from the props fileGian Merlino
05/10/2023, 7:28 PMworkerCategorySpec are at https://druid.apache.org/docs/latest/configuration/index.html#equal-distribution-with-category-specGian Merlino
05/10/2023, 7:28 PMequalDistributionWithCategorySpecGian Merlino
05/10/2023, 7:28 PMworkerCategorySpec is ignored)Hagen Rother
05/10/2023, 8:18 PM_default_tier. which is ok, as long as I could pin all index_kafka to it and everything else to a default tier with a different name. Is there a comprehensive list of tasks, if I have to spell it out?Gian Merlino
05/10/2023, 10:57 PMGian Merlino
05/10/2023, 10:57 PMGian Merlino
05/10/2023, 10:57 PMGian Merlino
05/10/2023, 10:58 PMtype. IIRC it'll list out all the valid types in the error messageHagen Rother
05/11/2023, 9:48 PM{% if item.tier is defined %}
druid_server_tier={{ item.tier }}
druid_worker_category={{ item.tier }}
{% endif %}
I feed that into apache/druid:25.0.0 docker image. middleManger and historical respect it, indexer doesn't.Hagen Rother
05/11/2023, 10:30 PM$ curl -s -X POST druid-router.service.dw2.consul:8888/druid/indexer/v1/task -d'{"type":"reflection"' -H "Content-Type: application/json"|grep -o -E "\[.*?\]"|head -1|grep -o -E '\w+'|sort|jq --raw-input . | jq --slurp .
[
"archive",
"compact",
"index",
"index_hadoop",
"index_kafka",
"index_parallel",
"index_realtime",
"index_realtime_appenderator",
"index_sub",
"kill",
"move",
"noop",
"partial_dimension_cardinality",
"partial_dimension_distribution",
"partial_index_generate",
"partial_index_generic_merge",
"partial_range_index_generate",
"query_controller",
"query_worker",
"restore",
"single_phase_sub_task"
]
maybe it's late, but you don't make it simple. How about an api call that just gives me this output?Hagen Rother
05/16/2023, 11:35 AMindexer is observing category, but not showing in router overview.Gian Merlino
06/07/2023, 12:05 PMmaybe it's late, but you don't make it simple. How about an api call that just gives me this output?ouch, I guess we deserve that 🙂 yeah, that'd be nice, as opposed to relying on an error message!
Gian Merlino
06/07/2023, 12:06 PMfollow up: looks like indexer is observing category, but not showing in router overview.ah, good to know! that probably means it isn't in
sys.servers (or it is but the UI isn't showing it)