Folks, Any pointers for me to check this issue:
``...
# ingestionp
powerful-telephone-71997
09/06/2021, 7:45 AMFolks, Any pointers for me to check this issue:
Copy code
'stackTrace': 'com.linkedin.restli.server.RestLiServiceException [HTTP Status:422]: ERROR :: '
'/value/com.linkedin.metadata.snapshot.DatasetSnapshot/urn :: "Provided urn '
'urn:li:dataset:(urn:li:dataPlatform:redshift,<>.<>.<>.<>),PROD)" is invalid\n'l
loud-island-88694
09/06/2021, 9:51 PM
can you please post the ingestion source config? also, what are the versions of the ingestion and serving stack?
p
powerful-telephone-71997
09/07/2021, 6:45 AMIt is Redshift to the latest version of Datahub - one reason I can think of is that the tables were dropped while this script was running, not sure
e
early-lamp-41924
09/07/2021, 4:14 PMSeems like the parenthesis in the dataset name is causing the issue. <>.<>.<>.<>)
early-lamp-41924
09/07/2021, 4:15 PMIdeally it should be
Copy code
urn:li:dataset:(urn:li:dataPlatform:redshift,<>.<>.<>.<>,PROD)p
powerful-telephone-71997
09/08/2021, 3:43 AM@early-lamp-41924 must be able to check this with some query on Redshift side?
powerful-telephone-71997
09/08/2021, 3:45 AMthere was no parenthesis anywhere in the message..I used <> as placeholders to schema and table names etc
powerful-telephone-71997
09/08/2021, 3:45 AMtables had underscore in the names though
e
early-lamp-41924
09/08/2021, 3:59 AMahh got it
p
powerful-telephone-71997
09/08/2021, 4:01 AM“one reason I can think of is that the tables were dropped while this script was running, not sure” -> i can only think of this..
e
early-lamp-41924
09/08/2021, 4:01 AMcan you query for the table that caused the error?
early-lamp-41924
09/08/2021, 4:01 AMit’s just this one that is erroring out right?
p
powerful-telephone-71997
09/08/2021, 4:02 AMsure…I got this message for a few tables and I had to do something else and I missed it, can do this
powerful-telephone-71997
09/08/2021, 4:02 AMthanks
powerful-telephone-71997
09/08/2021, 4:12 AMbut you know what @early-lamp-41924 you were right
powerful-telephone-71997
09/08/2021, 4:12 AMselect * from pg_statio_all_tables where relname like ‘%)’
powerful-telephone-71997
09/08/2021, 4:12 AMreturned 3 tables that has parenthesis
e
early-lamp-41924
09/08/2021, 4:13 AMah
early-lamp-41924
09/08/2021, 4:13 AM@mammoth-bear-12532 any solutions to this? there are tables with parenthesis in them
p
powerful-telephone-71997
09/08/2021, 4:19 AMI am asking folks internally to rename it, makes no sense - don’t worry
e
early-lamp-41924
09/08/2021, 4:35 AMAwesome!
early-lamp-41924
09/08/2021, 4:35 AMLet us know if you run into any other issues!!
🙌 1
3 Views