Apache Pinot

The expectation is to have the partition function used by producer with the one defined in Pinot

Right - the default producer partitioner in Kafka is murmur3, I think, which is why I asked

<https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/data/partition/MurmurPartitionFunction.java|https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/data/partition/MurmurPartitionFunction.java>

You can set the Kafka producer partitioner to a custom function that matches ^^.  Alternatively, you can also file and issue to have Pinot support murmur3 impl as used by Kafka

Thanks - also, I'm on mobile, and was wrong - looks like Kafka also uses murmur2

Yeah, iirc we had matched the implementation from Kafka. But it is always possible Kafka moves on to new partitioner or tweaks existing one. I’d still recommend comparing the two implementations, and filing an issue in case of mismatch