A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi DataHub team.  May I know if you support *AWS Glue ETL*?
If I follow the following documentation <https://datahubproject.io/docs/metadata-integration/java/spark-lineage/> should I be able to use it?
Thanks

if you can set the needed parameters to the spark-submit command then I think there is chance it will work

I was able to configure my _*Glue ETL*_ job but it takes forever to fail with a `Command Failed due to Out of Memory`

If I put the Rest URI in a browser I get
```{"exceptionClass":"com.linkedin.restli.server.RestLiServiceException","stackTrace":"com.linkedin.restli.server.RestLiServiceException [HTTP Status:404]\n\tat com.linkedin.restli.server.RestLiServiceException.fromThrowable(RestLiServiceException.java:315)\n\tat com.linkedin.restli.server.BaseRestLiServer.buildPreRoutingError(BaseRestLiServer.java:202)\n\tat com.linkedin.restli.server.RestRestLiServer.buildPreRoutingRestException(RestRestLiServer.java:254)\n\tat com.linkedin.restli.server.RestRestLiServer```
I dunno if that's how it should behave with a _*get*_ request.

Is it possible the url is not correct? 404 means it could connect to something (hopefull to gms) but the endpoint doesn’t exist

The DataHub UI on port 9002 seems to work fine. I just don't now if the Rest API is suppose to serve something on a GET request :confused:

Ah! I was able to find something more descriptive in the logs
```Unable to execute HTTP request: Remote host terminated the handshake```

what you can try is to first set it up for spark on your local computer if you can access datahub from there. I think it is easier to test connection issues first from there