Is there is a way to differentiate the aspects getting creat DataHub #all-things-deployment

Is there is a way to differentiate the aspects get...

creamy-van-28626

09/19/2023, 7:48 PM

Is there is a way to differentiate the aspects getting created via ingestion or openapi Like in ingestion we are creating entities and it’s aspects And with openapi we are updating properties for these aspects Is there is way to differentiate between aspects those that are created via ingestion or updated via api call?

rich-barista-93413

09/20/2023, 5:28 AM

Hmmm as far as i knowwe don't support this - @bulky-soccer-26729 could you confirm on this?

bulky-soccer-26729

09/20/2023, 1:39 PM

hey there! I think there should be a way for you to check this. in mysql, the column

systemmetadata

contains a field called

runId

- this field will be set when you ingest an aspect, and when you create an aspect via an API call (or from the UI etc.) it should be

no-run-id-provided

- I would double check this yourself but that would be one way to differentiate

creamy-van-28626

09/21/2023, 1:19 PM

This runid will be the part of MCP and MCL Does it get changing when an MCL getting generated for this MCP? And how this runid get assigned ?

creamy-van-28626

09/21/2023, 8:59 PM

@bulky-soccer-26729 can u refer the code where in case of batch ingestion run id is getting generated. That would be really helpful

creamy-van-28626

09/22/2023, 1:19 PM

And who is assigning this run id as per my understanding in case of batch ingestion plug-in is assigning this runid but who is assigning this default id in other cases ?

aloof-gpu-11378

09/22/2023, 1:41 PM

yeah you can see here where our own system is default setting the run ID if there isn't one provided. Our ingestion connectors will set a run ID if it's coming through there but i'm not entirely sure where that gets set

2 Views

Open in Slack

Previous Next