bumpy-daybreak-85714
09/28/2022, 1:58 PMDEBUG:datahub.emitter.rest_emitter:Attempting to emit to DataHub GMS; using curl equivalent to:
curl -X POST -H 'User-Agent: python-requests/2.27.1' -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'Connection: keep-alive' -H 'X-RestLi-Protocol-Version: 2.0.0' -H 'Content-Type: application/json' --data '{"proposal": {"entityType": "assertion", "entityUrn": "urn:li:assertion:40a3eff29425c75b6b631333dc2f6c7e", "changeType": "UPSERT", "aspectName": "assertionRunEvent", "aspect": {"value": "{\"timestampMillis\": 1664365729476, \"partitionSpec\": {\"type\": \"FULL_TABLE\", \"partition\": \"FULL_TABLE_SNAPSHOT\"}, \"runId\": \"57a18a92-a9f8-47e2-92b6-c3f2aae7c675\", \"assertionUrn\": \"urn:li:assertion:40a3eff29425c75b6b631333dc2f6c7e\", \"asserteeUrn\": \"urn:li:dataset:(urn:li:dataPlatform:snowflake,kafka_dev_db.shared_dimensions.dim_region,DEV)\", \"status\": \"COMPLETE\", \"result\": {\"type\": \"SUCCESS\", \"nativeResults\": {}}}", "contentType": "application/json"}, "systemMetadata": {"lastObserved": 1664372986001, "runId": "dbt-2022_09_28-15_49_43"}}}' 'http://****/aspects?action=ingestProposal'
DEBUG:urllib3.connectionpool:http://**** */:80 "POST /aspects?action=ingestProposal HTTP/1.1" 200 61
DEBUG:datahub.ingestion.run.pipeline: sink wrote workunit urn:li:assertion:40a3eff29425c75b6b631333dc2f6c7e-assertionRunEvent-urn:li:dataset:(urn:li:dataPlatform:snowflake,kafka_dev_db.shared_dimensions.dim_region,DEV)
However, if I look into the gms logs I can see the error:
13:56:15.814 [qtp1630521067-906] INFO c.l.m.r.entity.AspectResource:138 - INGEST PROPOSAL proposal: {aspectName=assertionRunEvent, systemMetadata={lastObserved=1664372986001, runId=dbt-2022_09_28-15_49_43}, entityUrn=urn:li:assertion:40a3eff29425c75b6b631333dc2f6c7e, entityType=assertion, aspect={contentType=application/json, value=ByteString(length=414,bytes=7b227469...7b7d7d7d)}, changeType=UPSERT}
13:56:15.861 [pool-12-thread-1] INFO c.l.m.filter.RestliLoggingFilter:55 - POST /aspects?action=ingestProposal - ingestProposal - 200 - 47ms
13:56:16.768 [I/O dispatcher 1] ERROR c.l.m.s.e.update.BulkListener:25 - Failed to feed bulk request. Number of events: 2 Took time ms: -1 Message: failure in bulk execution:
[0]: index [assertionindex_v2], type [_doc], id [urn%3Ali%3Aassertion%3A40a3eff29425c75b6b631333dc2f6c7e], message [[assertionindex_v2/rSUsoXQjSwCCAoTpK7f2gQ][[assertionindex_v2][0]] ElasticsearchException[Elasticsearch exception [type=document_missing_exception, reason=[_doc][urn%3Ali%3Aassertion%3A40a3eff29425c75b6b631333dc2f6c7e]: document missing]]]
And no assertions (test results) are shown in the UI. Any ideas?mammoth-bear-12532
bumpy-daybreak-85714
09/30/2022, 9:04 AM2022/09/30 08:11:51 Received 200 from <https://es>-*********.com:443
6
Going to use protocol: https
5
4
datahub_usage_event_policy exists
3
2
datahub_usage_event_index_template exists
1
2022/09/30 08:11:51 Command finished successfully.