Personally, I think the Kafka API are too flexible...
# general
f
Personally, I think the Kafka API are too flexible and easy to misuse. Letting the producer decide what the partitioner implementation is, for example, a big design flaw, IMHO. That is why in Venice, even though we do support custom partitioning, it needs to be configured centrally, and the Venice producer lib abides by it (or fails fast if it cannot, rather than blindly polluting the topics and wrecking downstream consumers).