Join Slack
Powered by
Hi, is there any approach to view the contents st...
# general
k
KISHORE B R
02/22/2022, 12:52 PM
Hi, is there any approach to view the contents stored on segment ?
m
Mayank
02/23/2022, 3:00 AM
Other than some metadata, the segments are in binary format. What specifically are you looking for ?
k
KISHORE B R
02/23/2022, 5:42 AM
I was exploring on how data is sharded to form segments. Is there any information that can help me with this ?
m
Mark Needham
02/23/2022, 11:29 AM
If you do a batch ingestion you'll end up with one segment per file that you're ingesting from. If you're doing a real-time ingestion, you'll end up with segment files per partition of the stream that you're ingesting from. Those segments will be flushed based on number of messages/time/size. (
https://docs.pinot.apache.org/operators/operating-pinot/tuning/realtime#tuning-realtime-performance
)
👍 1
Open in Slack
Previous
Next