Hi team, I’m testing dedup feature for Pinot realt...
# troubleshooting
a
Hi team, I’m testing dedup feature for Pinot realtime table. When I upload a table config successfully, I found the table status is bad. Server logs show the following error: 2022/07/04 050648.156 WARN [TableStateUtils] [HelixTaskExecutor-message_handle_thread] Failed to find current state for instance: Server_pinot-server-20.pinot-server-headless.pinot-trial.svc.cluster.local_8098, sessionId: 2000280dc650274, table: table_name_REALTIME. Test is based on Pinot 0.11.
s
Dedup / partial upsert tries to make sure all segments are loaded succesfully before it can begin ingestion. Could you check you zookeeper directory structure to ensure there is a CURRENSTATES ZNode with an entry for each of your servers?
a
I checked and there is a such a znode for each of the servers.
Copy code
/pinot-trial/INSTANCES/Server_pinot-server-20.pinot-server-headless.pinot-trial.svc.cluster.local_8098
s
Seem like, https://github.com/apache/pinot/pull/8923 has caused an issue with the check leading to this issue. Are you building from source @Alice?
a
yes
s
Could you try cherry-picking this PR and rebuilding server? https://github.com/apache/pinot/pull/9010/files
a
ok
s
This fix has been merged into master.
a
👍
Hi, @saurabh dubey Could you help confirm does this version has the following error with partial upsert feature? ‘Failed to find ideal state for table: table_02_REALTIME.’ Based on the pinot version before your mentioned fix,I created a table with partial upsert config and the table is always bad status. Server log shows above error. Could you help confirm if its this pinot version issue? Because with the same table config, it works well without any error in Pinot 0.10.
s
My fix was merged fairly recently. If you build the current master branch (specifically pinot-server), it should work @Alice
a
Ok, thanks.