curved-crayon-1929
04/13/2022, 5:05 PMsource:
type: glue
config:
aws_region: us-east-2
aws_access_key_id: AKIA226GV
aws_secret_access_key: j4EzEH12YEQLw0p4+K
aws_session_token: null
database_pattern:
allow:
- "billing"
table_pattern:
allow:
- "billingtable"
sink:
type: datahub-rest
config:
server: '<http://localhost:8080>'
early-lamp-41924
04/13/2022, 8:33 PMhundreds-photographer-13496
04/14/2022, 8:15 AMUnrecognized Glue data object type
just before this error ?
I suspect, the error is due to presence of connector that datahub glue source does not recognize.
I have created a small PR to fix this.
https://github.com/datahub-project/datahub/pull/4667curved-crayon-1929
04/14/2022, 8:41 AMhundreds-photographer-13496
04/14/2022, 8:55 AMcurved-crayon-1929
04/14/2022, 9:50 AMsource_node = nodes[edge["Source"]]
target_node = nodes[edge["Target"]]
with
source_node = nodes.get(edge["Source"])
target_node = nodes.get(edge["Target"])
if source_node is None or target_node is None:
continue