A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi. I'm trying to upgrade our datahub but I'm seeing an error that the gms doesn't find an elasticsearch index. Previously we have run the `docker/elasticsearch-setup/create-indices.sh` script to update indices but after <https://github.com/linkedin/datahub/pull/2840|2840> that script only creates the usage analytics indices. I'm wondering, how are the indices created these days? <@U01NN9CTQ01> Perhaps you know?

I'm upgrading from around 0.7.1 to 0.8.10. Seems like it is something to do with the no-code metadata model changes. The index that can't be found is the `dataset_datasetprofileaspect_v1` . Perhaps this is fixed by the upgrade-docker. Will read up on it again.

Nvm. I see they are dynamically created nowadays and we limit permissions on our elasticsearch so this is likely just a permission issue. Carry on.

Yes! We create them on mae processor start up (if standalone, this would be gms, if not, mae cnosumer)