https://pinot.apache.org/ logo
#general
Title
# general
d

Dan DC

09/28/2021, 9:13 AM
Hello, it looks like minion doesn't seem to expose any pinot metric at the moment - release 0.8.0. I'm interested in monitoring task failures, is there an easy way to do this other than monitoring logs?
m

Mayank

09/28/2021, 1:27 PM
We have added some debug apis in 0.8. @User are the minion debug apis 0.8?
r

Rama Baratam

09/28/2021, 6:06 PM
Yes.
Copy code
/tasks/{taskType}/taskcounts
Fetch count of sub-tasks for each of the tasks for the given task type
/tasks/{taskType}/debug
Fetch information for all the tasks for the given task type
/tasks/task/{taskName}/debug
Fetch information for the given task name
d

Dan DC

09/28/2021, 6:50 PM
The problem is I need to integrate with existing monitoring tools, not sure if this API will help me anyhow. Cheers
r

Rama Baratam

09/28/2021, 7:33 PM
i see these MinionMeter metrics - which will translate to Prometheus pinot_minion_numberTasksExecuted etc. with label "id" as taskType .
Copy code
NUMBER_TASKS_EXECUTED("tasks", false),
  NUMBER_TASKS_COMPLETED("tasks", false),
  NUMBER_TASKS_CANCELLED("tasks", false),
  NUMBER_TASKS_FAILED("tasks", false),
  NUMBER_TASKS_FATAL_FAILED("tasks", false);
r

Rama Baratam

09/28/2021, 9:01 PM
You might want to look at MinionQueryPhase::
Copy code
TASK_EXECUTION
for total execution time for tasktype. will translate to Prometheus timer metric as pinot_minion_taskExecution...
m

Mayank

09/28/2021, 9:18 PM
@User ^^ seems like we might have some metrics that you can already use currently.
d

Dan DC

09/29/2021, 1:28 PM
Thank you both, now I need to find out why they aren't getting exposed in my deployment
Actually I've just found out. I'll raise an issue and a PR in github
m

Mayank

09/29/2021, 2:28 PM
Thanks
👍 1