Hello, it looks like minion doesn't seem to expose any pinot metric at the moment - release 0.8.0. I'm interested in monitoring task failures, is there an easy way to do this other than monitoring logs?

We have added some debug apis in 0.8. @User are the minion debug apis 0.8?

Yes.

/tasks/{taskType}/taskcounts
Fetch count of sub-tasks for each of the tasks for the given task type
/tasks/{taskType}/debug
Fetch information for all the tasks for the given task type
/tasks/task/{taskName}/debug
Fetch information for the given task name

The problem is I need to integrate with existing monitoring tools, not sure if this API will help me anyhow. Cheers

i see these MinionMeter metrics - which will translate to Prometheus pinot_minion_numberTasksExecuted etc. with label "id" as taskType .

NUMBER_TASKS_EXECUTED("tasks", false),
  NUMBER_TASKS_COMPLETED("tasks", false),
  NUMBER_TASKS_CANCELLED("tasks", false),
  NUMBER_TASKS_FAILED("tasks", false),
  NUMBER_TASKS_FATAL_FAILED("tasks", false);

You might want to look at MinionQueryPhase::

TASK_EXECUTION

for total execution time for tasktype. will translate to Prometheus timer metric as pinot_minion_taskExecution...

@User ^^ seems like we might have some metrics that you can already use currently.

Thank you both, now I need to find out why they aren't getting exposed in my deployment

Thanks