Hi, what is the difference between

datahubSystemUpgrade

and

datahubUpgrade

job in the helm chart?

@bulky-soccer-26729 any ideas?

@bulky-soccer-26729 Hi, can you help me take a look? Thanks.

hey! sorry for the delay just seeing this now. I'm not entirely positive but can look into this. I'll also tag @dazzling-yak-93039 as she might have a better idea here

Hi, any update?

Hi, thanks for the patience. @dazzling-yak-93039 tagging this for a reminder 🙂

@bland-gigabyte-28270 Hope you have seen this README 🤞 It is the same image with various options to perform pre and post install of various DataHub components. If you want to dive deep into what exactly are these various steps I would recommend you to taka a look at the implementation here while you get an expert opinion 🙂

Hi @bland-gigabyte-28270, I got this answer from @incalculable-ocean-74010:

datahubSystemUpgrade

is the more recent one. It is responsible for performing elastic search data migrations after DataHub v0.10+. I.e: index re-sharding and applying mapping changes that come into the product without manual intervention.

datahubUpgrade

is a job that can (on user trigger) run 1 of multiple actions. This is legacy, DataHub operators can use it to run things like restore indicies if their elasticsearch data is out of sync with MySQL. We rarely use it. I hope that helps!