A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Image from iOS.jpg

Hi team 
When I am clicking on ingestion tab I am getting this error . I have pinged the error logs from gms pod as well

Hi! Looks like there is an error on the backend happening, can you please post the GMS logs? Also it makes it much easier to read if you just copy it into a snippet on Slack rather than posting a screenshot of notepad, thanks!

There should be a stack trace of the 500 happening rather than just the GraphQL error

gms_logs.txt

<@U01GCJKA8P9> Looks like it's hitting a NullPointerException due to an ingestion source getting in that is not properly configured (doesn't have an Info aspect). Any ideas on how it could get into this state?

Karishma, do you know if any Ingestion Sources were manually inserted/modified?

I am ingesting meta data by running ingestion cron jobs

UI does not allow me to do that I am getting unknown error 500

I believe that some ingestion source must have been manually created. Do you mind trying to delete the URN that is causing problems via datahub delete --urn &lt;ingestion-source-urn&gt;

But how can I identify which urn is creating error

got it. i'll send a query for this:

```curl -X POST '<http://localhost:8080/entities?action=search>' \
--data '{
    "input": "*",
    "entity": "dataHubIngestionSource",
    "start": 0,
    "count": 100
}'```

Can I run this in acryl datahub action image shell ?

These matches entities needs to get deleted?

Can you paste the json response into a Slack snippet?

There will be some of those sources which come back with no Info object, those urns are the ones to be deleted

Karishma - if you're okay doing it, we can delete each URN listed here

bash logs.txt

These logs should be delete from gms shell itself or from acryl datahub actions ?

And when I am trying to delete them I am getting error as unknown aspect status for entity 
Status 500