hello, is there any tutorial connecting pinot with...
# troubleshooting
a
hello, is there any tutorial connecting pinot with mongodb ?
k
there isn't one but the right way to do that would be MongoDB -> Kafka -> Pinot https://www.mongodb.com/docs/kafka-connector/current/source-connector/fundamentals/change-streams/
👍 1
a
thank you will look into that.
m
a
so i was thinking to just use MongoDB Kafka Connector and send mongo data to kafka topics and get those in pinot.. do i need Debezium ?
k
No.. but we might need a decoder to parse the mongo db change log event in kafka.. if you can share sample events, we can write a decoder quickly or you can contribute it to Pinot
a
in kafka connector i’m using
Copy code
key.converter: org.apache.kafka.connect.json.JsonConverter