is there any tutorial to set up datahub on kubernetes, I followed the official guide but I cannot work through it, I don’t know where to configure the storageclass and use external service like kafka\postgres rather than the integrated ones. great thanks.

Hi, which cloud platform are you using? GCP or AWS?

I am using a on-premise cluster set up on rancher rke2

You can find the helm charts at https://github.com/acryldata/datahub-helm/tree/master/charts After that you could configure various parameters in charts and sub charts values.yaml files.

@brave-engine-32813 I am not sure if the chart for Prerequisites lacks some of the files, e.g. its dependencies like mysql sub chart. Besides, the chart of Prerequisites seems lack of configurations for

storageClass

, which cause the

pvc

stay in

pending

state and thus pods cannot start.

I am not using the prerequisite charts in my deployment. I have the db as seperate installation. Although , can you add setting "global.storageClass" in the values.yaml mysql section.(just like auth.existingSecret)

@brave-engine-32813 thanks for your reply. could I ask one more question, what’s the minimal dependencies for datahub. I want to deploy its dependencies as yours, could you give me some advices about your configurations.

I have elastic search ,kafka and postgres as seperate installations and mentioned the connection parameters in the datahub chart and subchart values.yaml files.This is just a poc set up and therefore may not be recommended dependencies. I used the same versions as mentioned in the prerequisites charts.

@brave-engine-32813 I set up my own elastic search and kafka, but I found it’s hard to make them connected. my datahub elsastic setup job keep erroring and I cannot find out what happened. what’s more, the official prerequisites seems to have no version informations about it. I wonder if I am using a differnet prerequisites chart with yours. thanks a lot.