Hi We need to point to external kafka, mysql and e...
# all-things-deploymentf
fresh-fish-73471
07/07/2021, 9:29 AMHi We need to point to external kafka, mysql and elastic search from datahub, currently we point to dockerized versions of them. Please let us know what all changes we need to do in order to achieve this.
e
early-lamp-41924
07/07/2021, 4:26 PMHi! Do you deploy datahub on local docker or kubernetes?
f
fresh-fish-73471
07/13/2021, 5:01 AMWe are deploying it on docker
e
early-lamp-41924
07/13/2021, 6:11 AMAre you running using datahub cli?
early-lamp-41924
07/13/2021, 6:13 AMIf so, it’s much easier! Go to https://github.com/linkedin/datahub/blob/master/docker/quickstart/docker-compose-without-neo4j.quickstart.yml and change the docker variables corresponding to the storage layer end points. (Also remove unnecessary pods corresponding to kafka, mysql, and elastic. You still need schema registry tho)
early-lamp-41924
07/13/2021, 6:14 AMUnder frontend-react change KAFKA_BOOTSTRAP_SERVER, ELASTIC_CLIENT_HOST, ELASTIC_CLIENT_PORT
early-lamp-41924
07/13/2021, 6:15 AMUnder gms change everything that starts with EBEAN_DATASOURCE to match mysql setup, ELASTICSEARCH_HOST, ELASTICSEARCH_PORT, KAFKA_BOOTSTRAP_SERVER
early-lamp-41924
07/13/2021, 6:16 AMAfter doing so run
datahub docker quickstart --quickstart-compose-file docker/quickstart/docker-compose.quickstart.ymlearly-lamp-41924
07/13/2021, 6:16 AMif you use quickstart.sh
early-lamp-41924
07/13/2021, 6:16 AMmake sure you nuked before
early-lamp-41924
07/13/2021, 6:16 AMthen make the above changes to the same yaml file
early-lamp-41924
07/13/2021, 6:16 AMand run quickstart.sh! It should automatically deploy with the local yaml file!
g
great-london-69866
08/22/2023, 5:23 AMHi @early-lamp-41924 i updated docker-compose-without-neo4j.quickstart.yml and docker-compose.quickstart.yml file with external mysql server details and ran datahub docker quickstart --quickstart-compose-file docker/quickstart/docker-compose.quickstart.yml still its not pointing