Hi there! Could anyone suggest if datahub has some notification options for cases when the ingestion process is not successful ? I was thinking about using alerts based on prometheus metrics (but did not find any useful metric for that). Mb smth like slack | email callback are possible ?
m
microscopic-twilight-7661
05/30/2023, 6:40 AM
Hi,
Did you check out the actions framework.
You could set up an action for failed ingestion and then send a message to Slack channel.
I am yet to test it out, but I think it could be done with this.
s
silly-ambulance-51171
05/30/2023, 8:17 PM
@microscopic-twilight-7661 thanks for the idea, it looks like approximately what I’m looking for and I’ll try it. It is interesting how is it possible to get prometheus metrics about ingestion process with some lables like source, source_type etc.