Hi team, We were facing some issues where datahub UI was not able to render entities even though they were present in our DB. We figured out this was because elastic search indices were corrupted due to some reason. We fixed it by running

restoreIndices

job under datahub-upgrade image. but we wanted to make sure that this issue gets detected earlier with the help of some metrics. Do datahub release any metric for such issue? I know datahub releases prometheus metrics, I read about it here. but do we have any wiki where description of useful metrics and how they can help is available ?

I’m not sure if we have any metrics that can detect index corruption. The closest thing might be kafka lag Do you have a sense of what the elasticsearch index corruption was? And also, what version of DataHub was this with?