<!here> good morning guys. We setup a pinot cluste...
# troubleshooting
a
<!here> good morning guys. We setup a pinot cluster a while ago, while it was 0.6.0 the latest version and recently spawned a new cluster with version 0.8.0 to test it before using it in production. Before we start streaming data into this new cluster I’d like to know first if having two clusters with low level kafka consumers streaming data from the same topic would represent an issue? I ask this because I see the current cluster doesn’t rely on kafka consumer groups to keep track of the offsets, on the other hand in our kafka provider I see there is an empty named consumer group consuming data from the topics and it seems that one belongs to pinot
x
I assume these two clusters are separated(on a new zk cluster or same zk but different helix cluster name). Then you are fine, you can create multiple tables consuming same kafka topic as well. Pinot internally track zk offsets per table basis.
a
Yep, different zk clusters as well
Great! Thanks