A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Question - How to adjust values.yaml to used a external eslasticsearch service, on gcp? Deploying on GKE with helm.

Hey! Take a look at the variables set here <https://datahubproject.io/docs/deploy/aws#elasticsearch-service> Though it’s for AWS, it’s applicable elsewhere. Note, you can skip the elasticsearchSetupJob change since that is specific to AWS elasticsearch that uses OpenDistro instead of latest elasticsearch

You don’t have to set indexPrefix tho. Fixing docs now

So basically set global.elasticsearch.host to your elasticsearch url

global.elasticsearch.auth.username and global.elasticsearch.auth.password

<https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/templates/elasticsearch-setup-job.yml#L52> Need to add more docs on thsione

for password, we fetch it through secrets

so you can create the secret in the same namespace with the elasticsearch password

global.elasticsearch.auth.password.secretRef for the name of the secret

and global.elasticsearch.auth.password.secretKey for the value name inside the secret

<https://github.com/linkedin/datahub/pull/3360/files>

Sent out a PR to add more details! Take a look at the basic auth settings!

Another doubt: is it possible to use other no relation db other than elasticsearch?

We only support elasticsearch as the search backend as of now. But even in the future, we maybe supporting other search indices, but not RDBMS since implementing search capabilities using RDBMS is very inefficient