Hi :wave: We've been hitting a bug where a `ZkInte...
# troubleshooting
a
Hi 👋 We've been hitting a bug where a
ZkInterruptedException
from the helix zk client popping up during segment uploads can leave segments stuck in the IdealState, but missing metadata in the propertystore in zk, causing an ERROR state and query errors for us because the segments are ultimately not queryable. We've patched it locally by forcibly deleting affected segments when this occurs. It looks like in this scenario, the cleanup that happens only deletes the segment metadata from the PROPERTYSTORE, but if it is still in the IdealState, we end up in a weird scenario and we have had to go in and manually delete segments and re-ingest data. Curious if others have seen this issue at all. I have written up an issue for it here and plan to post our patch in a PR as well for review https://github.com/apache/pinot/issues/16866
m
@Jackie ^^
Also @Sonam Mandal ^^
s
Thanks for this fix! Will take a look 👍
👍 1