Hey <@UDQU92KBK> <@UGRJA9TEH> <@UDT7GFEG6> We are ...
# troubleshooting
b
Hey @Mayank @Xiang Fu @Jackie We are facing a weird issue with a pinot table. It is not consuming from 3 segments out of 10 partitions. I created a new table with same schema and table config. New table is able to create 10 consuming segments one for each partition but old table is still missing data. Please help here, I will provide context
Copy code
Pinot version: 1.2.0
Number of partition in kafka topic: 10
Table type: realtime, upsert
Table health: Good for both the tables.
Ideal state for old table where 0.3.5 partitions are not present
Untitled
Ideal state of new table where all the partitions are present
Screenshot 2025-03-19 at 6.02.24 PM.png
partition 0 is missing from the ideal state itself
with segments missing for these 3 partitions table showing good.... it is a big issue please help in debugging this
k
Did you try running the validation manager?
b
Yes I did that, also restarted the complete cluster but still no trace was found for segments 0,3,5.
the main problem is this: with missing segments how come table was in good state and ideal + extrnal views also were not reporting these partitions.
I had to re-create the table at the end which started consuming data from all the partitions
is there any known reason for this kind of issues.. has anyone reported such issues in past
j
From what I can tell, most likely controller was running into issues when trying to pull metadata from Kafka. Can you check the controller log and see if you can find any error/warnings?