https://datahubproject.io logo
Join Slack
Powered by
To reiterate the problem, after a succesful sink w...
# ingestion
f
To reiterate the problem, after a succesful sink with the following output: 
Sink (datahub-rest) report:
 
{'failures': [], 'records_written': 1, 'warnings': []}
Pipeline finished successfully
 On the json file attached, I go to the GUI and it crashes, giving me the following error once you dig through the logs: 
Caused by: java.net.URISyntaxException: Urn doesn't start with 'urn:'. Urn: at index 0:
  
at com.linkedin.common.urn.Urn.<init>(Urn.java:80)
at com.linkedin.common.urn.Urn.createFromString(Urn.java:231)
at com.linkedin.common.urn.DataPlatformUrn.createFromString(DataPlatformUrn.java:26)
at com.linkedin.common.urn.DataPlatformUrn$1.coerceOutput(DataPlatformUrn.java:60)
test.json
m
@future-waitress-970: what time zone are you in? would probably be good to get on a call and debug quickly.
g
Hey Enes- I tried to ingest that snapshot and noticed SchemaMetadata is missing a few required fields
it is missing 
platformSchema
also 
hash
AH
it also includes these fields ^
so it needs a platform and a version
that's probably the issue- try filling out the 
platform
field
As a note, if you upgrade to the most recent Datahub release, you will see that we added write-side validation!
So this would have been caught on the latest Datahub
f
Hey Gabe, i think i upgraded it, but ill add those
g
ok, this release came out a few days ago
actually- its possible this is on the head branch
but unreleased- I am running on latest
make sure the platform field matches the 
urn:li:dataPlatform:snowflake
f
Thank you, adding those two worked
@green-football-43791
g
nice!!!
Open in Slack
PreviousNext
Powered by