Hi team, I’ve just deployed the app and ran the `d...
# ingestion
b
Hi team, I’ve just deployed the app and ran the
datahub ingest -c ./examples/recipes/example_to_datahub_rest.yml
; I don’t see the dataset in
<http://localhost:9001>
. I also loaded the data from bigQuery
Copy code
source:
  type: bigquery
  config:
    project_id: data-sandbox-123
    # options:
      # credentials_path: "/service_account_key.json"
sink:
  type: "datahub-rest"
  config:
    server: '<http://localhost:8080>'
Something I might be missing here?
e
Can you check whether datahub-mae-consumer container is running?
b
docker container ls | grep datahub-mae-consumer
Copy code
9f24e2ce6995   linkedin/datahub-mae-consumer:latest    "/bin/sh -c /datahub…"   About an hour ago   Up 47 minutes   9090/tcp, 0.0.0.0:9091->9091/tcp                           datahub-mae-consumer
e
can you check the logs?
I faced a similar issue lately and realized latest master for mae-consumer-job is broken 😞
b
Yeah looks like it:
Copy code
datahub-mae-consumer    | Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
datahub-mae-consumer    | 08:56:27.368 [main] ERROR o.s.b.d.LoggingFailureAnalysisReporter - 
datahub-mae-consumer    | 
datahub-mae-consumer    | ***************************
datahub-mae-consumer    | APPLICATION FAILED TO START
datahub-mae-consumer    | ***************************
datahub-mae-consumer    | 
datahub-mae-consumer    | Description:
datahub-mae-consumer    | 
datahub-mae-consumer    | Field sslContext in com.linkedin.gms.factory.common.RestHighLevelClientFactory required a bean of type 'javax.net.ssl.SSLContext' that could not be found.
datahub-mae-consumer    | 
datahub-mae-consumer    | The injection point has the following annotations:
datahub-mae-consumer    | 	- @org.springframework.beans.factory.annotation.Autowired(required=true)
datahub-mae-consumer    | 	- @org.springframework.beans.factory.annotation.Qualifier(value=elasticSearchSSLContext)
datahub-mae-consumer    | 
datahub-mae-consumer    | 
datahub-mae-consumer    | Action:
datahub-mae-consumer    | 
datahub-mae-consumer    | Consider defining a bean of type 'javax.net.ssl.SSLContext' in your configuration.
e
yup 😞
b
Did you find a fix for this?
e
we need to get better at signalling this
This PR seems to be the issue. https://github.com/linkedin/datahub/pull/2189
we will put out a fix or revert by early tomorrow but
you can remove the sslContext field and its usage in line 49 (just make it the same as line 51) and then ./gradlew build (This might take some time)
once that is done, you can run ./docker/nuke.sh (to nuke the MySql DB) and then run ./docker/dev.sh (instead of the quickstart one) to use the locally built binaries to deploy the containers
Sorry about this. Otherwise, we will have a functioning docker images in dockerhub by early tmr morning PST
b
Thank you, I’ll follow the steps and get back. Some context: I am trying to implement DataHub at Confluent (so wanna make sure if this is the right tool); this is critical, thank you.
🙌 1
Otherwise, we will have a functioning docker images in dockerhub by early tmr morning PST
This can wait till tomorrow, I can get the latest version then I guess
e
Awesome! I’ll update this thread once the images are ready.
w
The breaking of this was my fault. My apologies. I have a PR out for fixing this. https://github.com/linkedin/datahub/pull/2199
e
Thanks for the quick fix @wonderful-quill-11255 !!!
b
Thanks, @wonderful-quill-11255 .
e
@breezy-glass-7892 I just deployed latest image, and it is working well. Can you run ./docker/nuke.sh
and then ./docker/quickstart.sh ?
b
Thank you, will do.
Awesome, this works now! Thank you @early-lamp-41924
e
Awesome!!!