Hi folks! I recently ran into an issue of losing data being shown on the frontend. The issue started when I tried ingesting a dbt source and I believe that caused my small elasticsearch instance to crash (ES and MYSQL are being hosted on AWS, rest of containers are ran on ECS). I increased my ES instance, and restarted the containers. When I logged back into the datahub frontend I am missing all data that was there previously. I am able to use my user I had created previously. But I cannot see the users I created in the admin page, as well as my other team member users. Also the demo data I ingested does not show up, and when I try re-ingesting the demo data it succeeds on the cli, but nothing shows up in the datahub frontend. My guess is that that GMS know I had ingested previously, but the frontend is not showing any info on those datasets. Any ideas? I am at the early stages of testing out datahub within the team.

Have you checked if your mysql and es have data?

data should be in mysql. I am able to login with my user. Data is most likely missing in es. Is there a way to recover data from mysql into es? what is the functionality of es in datahub?

You can restore the ES index from your mysql instance https://datahubproject.io/docs/api/restli/restore-indices

would this work for restoring the users that have been created? how would i find the urns?

There is There is another guide https://datahubproject.io/docs/how/restore-indices/