Hi. Regarding the number of partitions of the kafk...
# ingestion
w
Hi. Regarding the number of partitions of the kafka topics, are there any requirements documented somewhere? If global message ordering is required then a topic can only have a single partition (with the drawback of reduced throughput ofc). The normal metadata topics are probably low throughput enough so 1 partition is enough but what about this new timeseries topic for example?
m
@wonderful-quill-11255 we use key-based routing with the key being the "entity-urn" .. and typically per entity ordering is all that is needed.
So I don't think you really need global message ordering for the metadata update stream
w
Nice. Thanks!