Hello, I'm trying to ingest some links for documen...
# getting-started
h
Hello, I'm trying to ingest some links for documentation and trying to add them into the "InstitutionalMemory" aspect. Unfortunately, i'm getting this error: "Message serialization failed no value and no default for url". Does anyone have an example of how to ingest documentation links using python to show them under the "Docs" tab in a Dataset Entity?
b
Could you provide an example MCE you're sending?
h
Copy code
{'auditHeader': None, 'proposedSnapshot': ('com.linkedin.pegasus2avro.metadata.snapshot.DatasetSnapshot', {'urn': u'urn:li:dataset:(urn:li:dataPlatform:bigquery,sample-dataset,PROD)', 'aspects': [{'lastModified': {'actor': 'urn:li:corpuser:datahub', 'time': 0}, 'owners': [{'owner': 'urn:li:corpuser:user', 'type': 'DATAOWNER'}]}, {'upstreams': []}, {'platform': 'urn:li:dataPlatform:bigquery', 'version': 0, 'hash': '', 'fields': [{'fieldPath': u'Geohash', 'type': {'type': {'com.linkedin.pegasus2avro.schema.StringType': {}}}, 'description': u'7-character geohash', 'nativeDataType': u'STRING'}, {'fieldPath': u'VehicleCount', 'type': {'type': {'com.linkedin.pegasus2avro.schema.StringType': {}}}, 'description': u'sameple', 'nativeDataType': u'INTEGER'}, {'fieldPath': u'AverageLocation', 'type': {'type': {'com.linkedin.pegasus2avro.schema.StringType': {}}}, 'description': u'sample', 'nativeDataType': u'GEOGRAPHY'}], 'created': {'actor': '', 'time': 1564499979000}, 'lastModified': {'actor': '', 'time': 1602701516000}, 'schemaName': u'sample-schema', 'platformSchema': {'tableSchema': "[{'type': [u'STRING'], 'name': u'Geohash'}, {'type': [u'INTEGER'], 'name': u'VehicleCount'}, {'type': [u'GEOGRAPHY'], 'name': u'AverageLocation'}]"}}, {'description': u'Sample Desc', 'customProperties': {'frequency': 'none'}}, ('com.linkedin.pegasus2avro.common.InstitutionalMemory', {'elements': "{'url': u'example link', 'description': u'Same Name'}"})]}), 'proposedDelta': None}
More or less this.. i've changed some company info to sample haha
but the last part is the new addition for the doc and basically errors out with "no value and no default value for url"
m
Did you try providing a url in the field
url
something like
<http://www.google.com/>
?
h
yes sorry there was a link instead of "example link" I just changed the link to example
m
Not sure if you are still stuck @hallowed-dinner-34937. I tried the ingest command mentioned here under "Create dataset" and was able to see the institutional memory.
Copy code
{
  "com.linkedin.common.InstitutionalMemory": {
    "elements": [
      {
        "url": "<https://www.linkedin.com>",
        "description": "Sample doc",
        "createStamp": {
          "time": 0,
          "actor": "urn:li:corpuser:fbar"
        }
      }
    ]
  }
}
specifically this was the json associated with Institutional memory
h
Hi! thank you for the update, i was missing the createStamp part of the json. I got it working now! Thank you.
👍 1