Strange problem: "successful" segment uploads are ...
# troubleshooting
t
Strange problem: "successful" segment uploads are no longer being reflected in Pinot query results:
select count(*)
is not changing, even though in our own logs we see
Copy code
Successfully uploaded segment: simple_0_443 of table: simple_OFFLINE
and logging that shows us >0 record count values for each segment . It was working before (that is, before I turned on pinot controller auth), as is stuck at
757051
count and
7653
segments. How is this even possible? I've tried reloading all segments for the table. Help?
Hmmmm... I bet we're re-using segment IDs. Seeing in Pinot controller logs:
Copy code
Segment simple_0_469 from table simple_OFFLINE already exists, refreshing if necessary
New segment crc 607916830 is different than the existing segment crc 4153489810. Updating ZK metadata and refreshing segment simple_0_469
m
Yeah, seems like you are using a segment naming convention that is overwriting segments.