Hi Team, What is API that we can use to get all ta...
# general
r
Hi Team, What is API that we can use to get all tasks running associated to OFFLINE Table configured with minion job tasks. I am able to get the task list and able to get config details for task name but how can we do it with OFFLINE TABLE Name how to get task name list ? Also even after deleting the OFFLINE Table from UI pinot controller task segments are running in background and also not even able to stop and delete them , facing these errors Method Not Allowed and Server error '500 Internal Server Error' for url 'http://pinot-controller:9000/tasks/task/Task_SegmentGenerationAndPushTask_199db571-e077-4d74-86e6-f380de37ea51_1760096118944' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/500 respectively.
m
@Shounak Kulkarni
s
you can use
<http://pinot-controller:9000/tasks/<taskType>/<offlineTableName>/state>
to get a list of task names with their states. From this result you can look for the required states and further use
<http://pinot-controller:9000//tasks/task/<taskName>/debug?verbosity=1>
to get the details of its subtasks to identify which all subtasks are actually running.
Also even after deleting the OFFLINE Table from UI pinot controller task segments are running in background and also not even able to stop and delete them
There was a recent change (PR) made to check for active tasks during table deletion, if your cluster has older code it will go ahead and delete the table without any warning on active tasks. To stop a running task killing the minion is the only way as of now (or wait for its completion)
👍 1
r
Thanks for this info It is helpful. 1.When we are creating offline table I see if we have n number of file then its creating n number of task segments as well. But in which few are successful and few are failed, in debug it shows very generic error like Failed to execute SegmentGenerationAndPushTask . Many a times even after creating table config and schema data won't flow into table because of schema miss configuration but not able to get that error directly from debug. How can we get into right errors ? 2. When we want to schedule tasks we get this error some time saying "schedulingErrors": "Unable to start scheduling for task type SegmentGenerationAndPushTask as task queue may be stopped. Please check the task queue status." But when we try to resume the tasks it says - Method Not Allowed why this happens ?
s
please check for the pinot controller logs on the failed "resume" request, I suspect the proxy is messing up something. Also try using swagger UI as that will also help you explore other available endpoints.
r
This recent change (PR) is in which version of pinot ?