Hey there community, I have a question about conf...
# troubleshooting
c
Hey there community, I have a question about configurations that can increase or reduce segment creation. I have two tables: • Table 1: 150 GB - 880 segments • Table 2: 3 GB - 700 segments (supports upsert) Both tables share the following configurations: •
"realtime.segment.flush.threshold.rows": "0"
•
"realtime.segment.flush.threshold.time": "172800000"
•
"realtime.segment.flush.threshold.segment.size": "200M"
Additional Information: • Indexing: Both tables use the same indexing strategy. • Data Cardinality: Both tables have high cardinality data. I'm trying to match configurations to understand the disparity in segment creation. Does anyone have any tips?
m
May be one of them is triggered based on size (Table1) and the other one based on time (because size is not reached)