A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

@here
I am trying build this grafana dashboard
<https://github.com/datahub-project/datahub/tree/master/docker/monitoring/grafana/dashboards>
I am not finding some of the metrics. (for example metrics_com_linkedin_metadata_resources_entity_EntityResource_search_Mean)
Where I can find list of datahub metrics emitted by each service?

So, instead of metrics_com_linkedin_metadata_resources_entity_EntityResource_search_Mean, I am now using metrics_com_linkedin_metadata_search_aggregator_AllEntitiesSearchAggregator_searchEntities_Mean. I am not sure if I using right metrics

I am also not able to find metrics_com_linkedin_metadata_resources_lineage_Relationships_getLineage_Count
Can you please suggest if this metrics is till emitted? And is it emitted by gms service or any other service?

&gt; Where I can find list of datahub metrics emitted by each service?
if monitoring is enabled for your running cluster `/metrics` endpoint shows all of the metrics for the given service.

Depending where are you running datahub (quickstart, k8s somethingelse)
you can find metrics in Prometheus as well.

Could you give some context how is datahub deployed?

It is deployed on EKS
And yes, I found the endpoint. I am able to get all the list.

But some metrics are missing from this list. Maybe <https://github.com/datahub-project/datahub/tree/master/docker/monitoring/grafana/dashboards> is not up-to-date

Yes, it's something we should update. If you can update and contribute back, happy to review and adopt.

Thank you <@U03TT6R08G2>
I am able to build most of the graphs now except "Graph QPS"
Can you please tell if metrics `metrics_com_linkedin_metadata_resources_lineage_Relationships_getLineage_Count` is still relevant? or I should use some other?

Is it because now GraphQLController is being used so this event is not emitted anymore?

<@UV5UEC3LN> might have more context on that

I think I should be using `metrics_com_datahub_graphql_GraphQLController_searchAcrossLineage_Count`  instead for `metrics_com_linkedin_metadata_resources_lineage_Relationships_getLineage_Count` . Please correct me if I am wrong

Yeah that makes sense as a change I think, <@U01JUBAPZPS> are there other GraphQL queries we should be looking at for determining graph QPS? I think searchAcrossLineage is the main one, but we also have some subresolvers pointing at relationships which might be relevant to track.

That endpoint is a good starting point though Atul :slightly_smiling_face:

`getEntity` is used for powering the lineage viz