Hello, I am trying to setup datahub locally follow...
# ingestion
b
Hello, I am trying to setup datahub locally following the quickstart guide. I am able to navigate to http://localhost:9002 and setup the ingestions for snowflake, looker and lookml . However, I am getting errors for all three ingestions. For snowflake, I am seeing this error in the logs. version
acryl-datahub, version 0.10.2.2
Copy code
'failures': [{'error': 'Unable to emit metadata to DataHub GMS',
               'info': {'exceptionClass': 'com.linkedin.restli.server.RestLiServiceException',
                        'stackTrace': 'com.linkedin.restli.server.RestLiServiceException [HTTP Status:400]: Cannot parse request entity\n'
                                      '\tat com.linkedin.restli.server.RestLiServiceException.fromThrowable(RestLiServiceException.java:315)\n'
                                      '\tat com.linkedin.restli.server.BaseRestLiServer.buildPreRoutingError(BaseRestLiServer.java:202)',
                        'message': 'Cannot parse request entity',
                        'status': 400,
                        'id': 'urn:li:dataset:(urn:li:dataPlatform:snowflake,segment_prod.core_mobile_production.appointment_save,PROD)'}}]
l
Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: 1️⃣ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? Yes button 2️⃣ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? Yes button
b
For now, I added the problematic table in the deny pattern and the job succeded
a
Hi, this may have something to with the underlying data- @gray-shoe-75895 might be able to provide more insight here
g
This seems like a bug. Could you try using the file sink and pasting the relevant part of the output file (e.g. the elements with
urn:li:dataset:(urn:li:dataPlatform:snowflake,segment_prod.core_mobile_production.appointment_save,PROD)
) here