Hi, I am ingesting files from azure blob storage u...
# general
s
Hi, I am ingesting files from azure blob storage using SegmentGenerationAndPushTask, the number of files in input directory are 17170 and pinot minions did create 17170 subtasks. The job completes in 40min and the task status shows subtasks 16 errored out and the rest completed. However in the pinot query console, it shows Error Code: 305 null: 11300 segments unavailable any leads on how to debug this issue.
m
Can you check debug api? Likely servers were not able to load segments
s
Copy code
{
  "idealState": "ONLINE",
  "externalView": "ERROR",
  "segmentSize": "0 bytes",
  "consumerInfo": null,
  "errorInfo": null
}
used this api /debug/segments/{tableName}/{segmentName}
I could not get more error info
why the segments are unavailable
what does segments unavailable mean? is something wrong with segment or is it means its not ready yet for querying?
@Mayank ^
m
"externalView":"ERROR",
-> This means server couldn't load. Typically, the debug api should also bubble up the exception. If you are not seeing that, pick one segment name and grep for it in the server (that it would have been hosted on). That should tell you what happened.
Let's continue in the #troubleshooting thread.
s
sure thanks