This message was deleted.
# general
s
This message was deleted.
k
Hi John - Druid is an API based system. For example to delete all Kafka supervisors you could use https://druid.apache.org/docs/latest/api-reference/supervisor-api#terminate-all-supervisors To delete their data, it’s a 2 step process https://druid.apache.org/docs/latest/tutorials/tutorial-delete-data
You can do all these activities in the web console as well (which conveniently executes the API calls for you)
j
In the web console Tasks view there is no delete action to remove tasks with "success" started for completed segments
k
The Tasks view is a form of logging, while you can’t delete the things there directly you can set a retention policy https://druid.apache.org/docs/latest/configuration/#log-retention-policy
j
I now have a kafka indexing tasks shown as running in the TASK VIEW but its data is not showing in the Datasources and Query view thus I cannot query the task.
And I have NO clue why that's happening. I have checked the Kafka topic "stocks_intervals" using a kafka console consumer and it is definitely receiving data.
k
You should be able to query it immediately while it is ingesting - are you showing any processed data in the Supervisor Statistics view?
j
The Supervisor Statistics shows all zeros for some reason
At some point I deleted the topic from the Datasources view could that be the cause?
k
if there’s data on the Kafka topic but it’s old, Druid will have recorded the offset already and will not ingest that data again without clearing it. You can now reset the offset:
j
That worked thanks a lot.
👍 1