brave-tomato-16287
08/05/2022, 10:04 AMdatahub_actions.pipeline.pipeline.PipelineException: Failed to log failed event to file! EventEnvelope(event_type='MetadataChangeLogEvent_v1', event=MetadataChangeLogEvent({'auditHeader': None, 'entityType': 'dataset', 'entityUrn': 'urn:li:dataset:(urn:li:dataPlatform:dbt,dev.analytics_dbt_test__audit.not_null_dim_customers_customer_id,PROD)', 'entityKeyAspect': None, 'changeType': 'RESTATE', 'aspectName': 'upstreamLineage', 'aspect': GenericAspectClass({'value': b'{"upstreams":[{"auditStamp":{"actor":"urn:li:corpuser:unknown","time":0},"type":"TRANSFORMED","dataset":"urn:li:dataset:(urn:li:dataPlatform:redshift,dev.analytics.dim_customers,PROD)"}]}', 'contentType': 'application/json'}), 'systemMetadata': None, 'previousAspectValue': None, 'previousSystemMetadata': None, 'created': AuditStampClass({'time': 1659685194401, 'actor': 'urn:li:corpuser:__datahub_system', 'impersonator': None})}), meta={'kafka': {'topic': 'MetadataChangeLog_Versioned_v1', 'offset': 162992, 'partition': 0}})
brave-tomato-16287
08/05/2022, 10:25 AMTraceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/datahub_actions/pipeline/pipeline.py", line 243, in _execute_transformer
return transformer.transform(enveloped_event)
File "/usr/local/lib/python3.9/site-packages/datahub_actions/plugin/transform/filter/filter_transformer.py", line 52, in transform
body_as_json_dict = json.loads(env_event.event.as_json())
File "/usr/local/lib/python3.9/site-packages/datahub_actions/event/event_registry.py", line 46, in as_json
return json.dumps(self.to_obj())
File "/usr/local/lib/python3.9/site-packages/avrogen/dict_wrapper.py", line 45, in to_obj
return conv.to_json_object(self, self.RECORD_SCHEMA)
File "/usr/local/lib/python3.9/site-packages/avrogen/avrojson.py", line 115, in to_json_object
raise AvroTypeException(writers_schema, data_obj)
avro.io.AvroTypeException: The datum MetadataChangeLogEvent({'auditHeader': None, 'entityType': 'dataset', 'entityUrn': 'urn:li:dataset:(urn:li:dataPlatform:dbt,dev.analytics_dbt_test__audit.not_null_dim_merchants_merchant_id,PROD)', 'entityKeyAspect': None, 'changeType': 'RESTATE', 'aspectName': 'upstreamLineage', 'aspect': GenericAspectClass({'value': b'{"upstreams":[{"auditStamp":{"actor":"urn:li:corpuser:unknown","time":0},"type":"TRANSFORMED","dataset":"urn:li:dataset:(urn:li:dataPlatform:redshift,dev.analytics.dim_merchants,PROD)"}]}', 'contentType': 'application/json'}), 'systemMetadata': None, 'previousAspectValue': None, 'previousSystemMetadata': None, 'created': AuditStampClass({'time': 1659685194401, 'actor': 'urn:li:corpuser:__datahub_system', 'impersonator': None})}) is not an example of the schema {