Hi Team, I’m trying the ingest metadata for MLFeatureProperties, it seems like the source urn supports only dataset as an entity type and not any other entity such as mlFeature, is it possible to add the sources of MLFeatureProperties other than of type dataset.

@loud-island-88694 @little-megabyte-1074 for visibility

Hey Tejas, looking at the current model, I believe MLFeatureProperties only supports dataset entity as source. https://github.com/datahub-project/datahub/blob/master/metadata-models/src/main/pegasus/com/linkedin/ml/metadata/MLFeatureProperties.pdl#L40 Can you help understand what kind of relationship are you trying to capture here ?

actually in our organisation there are certain MLFeature which are derived from another MLFeature and not directly from the dataset, so in terms of lineage we are unable to show the complete information wrt those MLFeature

cc: @big-carpet-38439 can likely speak to this!

Hiya. I think it should not be a problem to swap this to an generic URN field. That being said, we'll need to audit how that will impact the rest of the stack (frontend - rendering) since it could balloon into multiple changes

@gray-cpu-75769 while we look at this, please feel free to send a PR for the backend (and frontend too if possible)!

Sure @loud-island-88694 will work upon this and let you know

Hi @loud-island-88694/@little-megabyte-1074 - We looked into our roadmap, we are planning to launch DataHub for Paytm by Feb-24th, doesn't seems like we would be able to contribute by then given other items on our deliverables. . Any tentative timeline from your end on when you would be look into it based on which i would plan for a workaround.