I want to look at deploying DataHub on AWS for existing resources. Can I use Postgres instead of MySQL for our relational database and what changes would be needed? We have another existing ElasticSearch cluster(on aws) would it be possible/easy to share the same resource that we have with another application? Is there anything we need to know?

@nutritious-bird-77396 to answer the postgres question

Hey, for PostGres, please make sure you first disable mysql-setup-job on helm and enable postgres-setup-job. https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/values.yaml#L78 Then you should modify the fields in the global.sql.datasource https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/values.yaml#L132 to point to your postgres url. Note the driver needs to be set to org.postgresql.Driver For Elasticsearch, you should be able to share without an issue. To make sure there are no namespace clashes for indices, you can set global.elasticsearch.indexPrefix to add a prefix in front of all our index names i.e. {prefix}_datasetindex_v2

for your second question, I think you can refer my this blog

@adorable-receptionist-20059 I have deployed Datahub with Postgres as the metadata store within Peloton. In addition to the changes dexter highlighted above while deploying a couple of config changes in GMS are:

EBEAN_DATASOURCE_DRIVER="org.postgresql.Driver"
EBEAN_DATASOURCE_URL=jdbc:postgresql://<postgres-url>:5432/datahub

Let me know if you have any other questions.

Hello. I also have a problem original author mention. But I deploy DataHub using Docker Container. I couldn't find config file which is related to database path settings. Could you know where is path to change database?

Hi @nutritious-bird-77396, I'm trying to deploy DataHub with Postgres,

postgresqlSetupJob

is failing to start. the username is passed as database name, here is the link to error and config https://datahubspace.slack.com/archives/CV2UVAPPG/p1658173279061999