Hi :wink: Still using an old Pinot version and get...
# troubleshooting
f
Hi šŸ˜‰ Still using an old Pinot version and getting reload tasks kinda locked
Copy code
{
  "metadata": {
    "jobId": "d51ad5fb-e720-4356-bd49-49de439f1c13",
    "messageCount": "2",
    "submissionTimeMs": "1771840917900",
    "jobType": "RELOAD_SEGMENT",
    "segmentName": "myStuff_1_173__20260223T0207Z",
    "tableName": "myStuff_REALTIME"
  },
  "successCount": 0,
  "totalSegmentCount": 2,
  "totalServersQueried": 2,
  "totalServerCallsFailed": 0,
  "timeElapsedInMinutes": 1716.5874833333332,
  "estimatedTimeRemainingInMinutes": -1
}
Is there a way to kick them off ?
āœ… 1
s
Any clues in server logs for the reload message?
f
Nothing even by searching with the jobId šŸ˜ž
s
no trace in helix logs as well?
f
good point šŸ˜‰ I will check
Tried to grep the task id on the logs server / broker / controller nothing
s
Any trace of
Reloading segment: myStuff_1_173__20260223T0207Z in table: myStuff_REALTIME
on server? If its not there then the message is not reaching the server
also check for
Reloading single segment: myStuff_1_173__20260223T0207Z in table: myStuff_REALTIME
(older log as you mentioned you are on older version)
f
Tried to grep ā€œ`Reloading`ā€ noting
s
Is there a helix message queue pile-up on the server?
f
still running a 0.12 (I know) I will check šŸ˜‰
s
it should be under the zk path
/<clusterName>/INSTANCES/<instanceId>/MESSAGES
f
perfectly clean and empty
s
šŸ’€
f
seems like a dead task ... I will try to relaunch a reload šŸ˜‡
s
do you see either of •
Sending reload message for segment: myStuff_1_173__20260223T0207Z in table: myStuff_REALTIME
•
Sent 2 reload messages for segment: myStuff_1_173__20260223T0207Z in table: myStuff_REALTIME
•
No reload message sent for segment: myStuff_1_173__20260223T0207Z in table: myStuff_REALTIME
on controller atleastšŸ˜…
I will try to relaunch a reload
yeah
f
empty grep on all side on
myStuff_1_173__20260223T0207Z
or
reload
s
that's not possible, I give upšŸ˜†
f
find out 😜 Finally got a message on controller I could handle and fix
thx for you help šŸ™ I appreciate
s
No problem! what was the issue?
f
getting message about unable to acess folder to store temp segments on server side
šŸ‘ 1
m
Thanks @Shounak Kulkarni
šŸ™‡ 1