This message was deleted.
# general
s
This message was deleted.
j
Do you mean to ingest from multiple brokers+topics in the same ingestion spec?
I don't think the Kafka protocol works that way. You're better off creating two separate ingestions. You could potentially combine the two datasources into one as a 3rd ingestion.
s
Something like this - https://druid.apache.org/docs/latest/development/extensions-core/kafka-supervisor-reference#consumer-properties <broker1>&lt;port1&gt;,&lt;broker2&gt;<port2> the topic name is the same, but broker1 is colocated and broker2 is remote
j
The Kafka protocol is going to pick the first server in the list to bootstrap. If it can't access that server for some reason it will move onto the second server. If you have a cluster that is shared across two (or more) brokers then this will work as is. If you're asking to read from two separate clusters simultaneously; the Kafka protocol does not support this. You would need two separate Kafka Consumers for this. It's essentially the same as reading from two separate topics.
s
Understood, thank you for confirming @JRob