is it possible to check the status of a standalone...
# troubleshooting
p
is it possible to check the status of a standalone batch ingestion task? wondering if i should use standalone or spark for batch ingestion. i am planning to have 2 tables with data being loaded to one table once daily, and another table once every hour. query rps is low and is mostly for powering dashboards. i want to track ingestion after triggering it so i don't trigger ingestion for the next hour right away in my poc and overwhelm controller.
decided to use spark based batch ingestion. i see only mention of yarn / emr on https://docs.pinot.apache.org/manage-data/data-import/batch-ingestion/spark. any caveats for using spark on k8s?
x
For Standalone you can only see if from the query log
You could also try out minion for ingestion