Hi again everyone. Has anyone been able to visuali...
# ingestion
d
Hi again everyone. Has anyone been able to visualize the lineage between AWS Glue and AWS Redshift? I think my annotation for the DataSink in the job is the problem as it shows me the Redshift dataset as a Glue dataset as seen in the red circle in the first image and it should look like in the second image. I have generated the Glue annotation manually because when I try to generate it through Glue Studio I get an error in the DataSink:
[<http://gluestudio-service.us[MASK].amazonaws.com|gluestudio-service.us[MASK].amazonaws.com>] createScript: InvalidInputException: Invalid DataSink: DataSink(name=Amazon Redshift, classification=DataSink, type=Redshift, inputs=[node-2], isSinkInStreamingDAG=false)
Am I missing something? I attach the Glue annotation below. Thank you!
Copy code
## @type: DataSink
## @args: [database = "redshift_test", table_name = "dev_stg_stg_version_detail", transformation_ctx = "df3"]
## @return: df3
## @inputs: []
?
b
Hi, I am facing the same issue. @dazzling-cat-48477 Were you able to resolve it?
@astonishing-answer-96712 Can you help me here.
a
Hi @breezy-honey-91751, I believe this was a bug that has been fixed in more recent versions
b
Hi @astonishing-answer-96712, Any suggestions on how to fix this?