Hi team, I’ve a question about segment flush thres...
# troubleshootinga
Alice
11/01/2022, 9:04 AMHi team, I’ve a question about segment flush threshold. If there’s only 20MB data in 6 hours coming from streaming data, it’s better to have the following config.
But does it really cost extra jvm if “realtime.segment.flush.threshold.segment.size” is set 200MB?
Copy code
"realtime.segment.flush.threshold.time": "6h",
"realtime.segment.flush.threshold.rows": "0",
"realtime.segment.flush.threshold.segment.size": "20M",m
Mark Needham
11/01/2022, 9:39 AMI don’t think it’ll make a difference if you set it to 200M - whichever one it reaches first will be used
Mark Needham
11/01/2022, 9:39 AMWe have a guide that explains the combination of parameters and how they work - https://dev.startree.ai/docs/pinot/recipes/configuring-segment-threshold
a
Alice
11/01/2022, 10:03 AMThat’s what I thought. Thanks.