A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi, I have a question regarding the datahub storage. So let's say I had uploaded the dataset to the datahub and it is visible on main page of the datahub, where is the dataset file stored locally in datahub folder? I would like to make backup for them and I am not sure where to find them now

Hello Pawel,

DataHub does not store the dataset itself on metadata information about it. This information is stored in the relational database that you configured to use with datahub. If you’re using `datahub docker quickstart`  that would be MySQL.

We also store some information in elasticsearch for indexing purposes for graph, timeseries &amp; search purposes.

You can read more about how metadata is stored here: <https://datahubproject.io/docs/architecture/metadata-serving>

Thank you for the reply! Is it easy to switch from MySQL to Postgres, is there some instruction on how to do it or some example? :smile:

I have already postgres service running, and would like to switch from MySQL to postgres

hi <@U01L2QD243Z> could you provide some instruction or link to tutorial on how to proceed with postgres/MySql switch regarding my previous comment? I would be really grateful for all the help

Pawel,

If you’re deploying using `datahub docker quickstart` simply download this file: <https://raw.githubusercontent.com/linkedin/datahub/master/docker/quickstart/docker-compose-without-neo4j-m1.quickstart.yml>

Delete the mysql service &amp; replace mysql references with your configs from Postgres and then run:
`datahub docker quickstart --quickstart-compose-file &lt;your compose file&gt;`