Hi team, I have a quick question. Is there a way to send query results from pinot to a kafka topic, maybe using plugins? Could minions be used for this?

Not at the moment. But you can do it at application side. What’s the use case?

We want to create kafka topics from query results so that various tools can easily consume and use the data.

Who issues the query? And how does the tool consuming the data know what the query was? In other words, what’s the business problem you are solving with this approach?

Query issues by Grafana to monitor, the result could be used for analytics so we also want to ingest dataware house, and other BI tools

Is this for something like anomaly detection?

yeah something like that

Probably better to use an anomaly detection engine that directly talks to Pinot. Thr above arch seems a bit complicated

Thank you very much!