I added a new table yesterday to my pinot cluster ...
# troubleshootingl
Luis Fernandez
09/21/2021, 3:01 PMI added a new table yesterday to my pinot cluster I wonder what could have caused this metrics to go up a lot
Luis Fernandez
09/21/2021, 3:02 PMidk if i made the segment size for this particular table too big, since it’s still consuming from yesterday and it hasn’t created new segments
m
Mayank
09/21/2021, 3:04 PM
The off heap usage is from consuming segments
Mayank
09/21/2021, 3:04 PM
What’s your setting for the segment size thresholds
l
Luis Fernandez
09/21/2021, 3:05 PM Copy code
"realtime.segment.flush.threshold.rows": "500000000",
"realtime.segment.flush.threshold.time": "24h",
"realtime.segment.flush.segment.size": "250M"Luis Fernandez
09/21/2021, 3:05 PMmay have gone too crazy with that first
n
Neha Pawar
09/21/2021, 3:21 PM
You should set the rows threshold to 0, only then will the size threshold kick in
Neha Pawar
09/21/2021, 3:21 PM
Other than that the config looks fine
l
Luis Fernandez
09/21/2021, 3:21 PM🙏 thank you
Luis Fernandez
09/21/2021, 3:21 PMcan I do that while my segment is already going? what would happen to it
n
Neha Pawar
09/21/2021, 3:26 PM
You can, it should apply from the next segment onwards. But if this consuming segment is looking like it might create problems, it might even be a good idea to restart the servers so that this segment also picks up the config
🙌 1