Hello Team,
How do I get the task name to show up ...
# troubleshootb
bored-microphone-25437
03/22/2023, 5:07 PMHello Team,
How do I get the task name to show up instead of urn ?
datajob_input_output_mcp = MetadataChangeProposalWrapper(entityUrn=builder.make_data_job_urn(orchestrator=job_platform, flow_id=job_name, job_id=task_name),aspect=datajob_input_output,)a
astonishing-answer-96712
03/23/2023, 7:11 PMHi, could you provide your version and recipe? As well as any logs. It may not have access to that field in databricks
b
bored-microphone-25437
03/27/2023, 8:01 AMI am using rest API in this case to post lineage to the datahub. relevant code snippet: _`# Convert input_datasets and output_datasets to list of dataset urns.`_
input_urns = [builder.make_dataset_urn(platform=d["platform"], name=d["dataset_name"])for d in input_datasets]output_urns = [builder.make_dataset_urn(platform=d["platform"], name=d["dataset_name"])for d in output_datasets]# Construct the DataJobInputOutput aspect.datajob_input_output = DataJobInputOutputClass(inputDatasets=input_urns, outputDatasets=output_urns)# Construct a MetadataChangeProposalWrapper object.# NOTE: This will overwrite all of the existing lineage information associated with this job.datajob_input_output_mcp = MetadataChangeProposalWrapper(entityUrn=builder.make_data_job_urn(orchestrator=job_platform, flow_id=job_name, job_id=task_name),aspect=datajob_input_output,)# Create an emitter to the DataHub REST API.emitter = DatahubRestEmitter(gms_server=server_url, extra_headers={"Authorization": f"Bearer {token}"})emitter.emit_mcp(datajob_input_output_mcp)a
astonishing-answer-96712
04/03/2023, 10:12 PMWhat datahub version are you on? This may be a ui bug with an older version
astonishing-answer-96712
04/18/2023, 8:56 PMHi @bored-microphone-25437, are you still experiencing this issue?
5 Views