In terms of observability, is DataHub exposing metrics such us number of entities?

@witty-butcher-82399: yes. https://demo.datahubproject.io/dataset/urn:li:dataset:(urn:li:dataPlatform:snowflake,demo_pipeline.public.all_entities,PROD)/stats is an example

@witty-butcher-82399 Is row count what you mean? Or something else?

Sorry, probably my question was not very precise. I meant operational real-time metrics to measure the health of the whole system. I’m talking here as an admin for the whole infra. Elasticsearch, RDS, Kafka, Kubernetes itself can be monitored in different ways and eg integrated with Prometheus, Datadog, etc. What about GMS or the connectors? I guess they are exposing JMX metrics, however I was thinking of “business” metrics such as number of API calls, number of entities processed, maybe number of aspects too, …

Ah that makes sense now 🙂 Some of this stuff is available under the

Analytics (Beta)

link ... while other kinds of operational monitoring instrumentation is under development. /cc @early-lamp-41924