Hello, I've couple of questions regarding data modelling and ingestion: How can I register a custom entity to Datahub instance ? I'm running an instance locally via docker, Is there a way to register new entity via APIs ? In my use case, I want to store following attributes related to topic metadata: a. topicName b. clusterType c. dtoName d. packageName One way to solve this is to define custom entity / aspect but this needs rebuilding and redeployment afaik. Is there a way to dynamically load new entities without re-deployment ? I would like to know recommended way to solve such use-case.

Unfortunately extending the metadata model requires a rebuild. Depending on your exact use case, you might be able to get away with putting those fields under “custom properties” to avoid modifying the model. If not, extending the metadata model is pretty easy https://datahubproject.io/docs/metadata-modeling/extending-the-metadata-model/

This is the currently supported model. We will support dynamic registration via APIs in the future

Hey @loud-island-88694,

dynamic registration via APIs

is it part of the No Code Metadata Modeling initiative? Any timeline we can expect this?

yes it is part of the no-code initiative. We still have some work to do for code-gen on the graphql side and how to represent pluggability in the UI for new concepts. We are going to focus on that first

Great! Looking forward to it! We have use case on metric management as well that I believe this initiative could be helpful.

what I understood, NoCode deployment bridges the gap between GMS and backend auto Generated Code (e.q. search indexes). not sure If this is going to address

adding new entity without deployment in PDL / <http://rest.li|rest.li>

. Can you please elaborate following :

e.g. Register new entity / extensions at runtime. (Unlikely due to code generation)

https://datahubproject.io/docs/advanced/no-code-modeling#nice-to-haves