Hi guys,
Hope you're doing well,
Is there any way to ingest data from 3 kafka servers into 1 datasource, docs says that we can only have 1 kafka per datasource and submitting another spec file would just replace the previous one, but is there any other way?
Any help would be really appreciated (beginner on druid),
Thank you
Thank you so much,
Yes we're already using ingestion from multiple topics,
But we need something like each company has their own kafka server (security reasons) and then we ingest all that data into a single data source,
We'll need to use multiple data sources then :( , until we find a solution
Thanks again
a
Abhishek Balaji Radhakrishnan
06/25/2025, 4:02 PM
Hi Abdul, I believe what you're looking for is the ability to have multiple supervisors ingesting into a single datasource. This feature was recently added in https://github.com/apache/druid/pull/18082. It should be available as an experimental feature in the upcoming Druid release 34.0.0
a
Abdul Ahad Munaf
06/26/2025, 4:27 AM
Yes, exactly what we were looking for,
Thanks Alott