Does pinot support partitioning realtime table ove...
# troubleshooting
a
Does pinot support partitioning realtime table over a column while ingesting from Kinesis? From docs it seems realtime partitioning is supported only with Kafka
m
The partitioning should apply to all stream plugins.
c
I think Kinesis doesn't offer partitioning on the consumption side IIRC (only meant for scaling up writes). That's a pre-req for Pinot real-time partitioning.
a
Is there any plan to support partition creation inside pinot for completed segments? Some kind of background task. I think it would be essentially recreating segments and again partitioning would not work on consuming segments while ingesting from kinesis, unless realtime servers shuffle data among themselves.
c
@Aditya Unfortunately no - we don't have any such functionality right now - feel free to open an issue though.