Dear Team. I opened this PR (and its corresponding PR in the helm chart) to fix a quite important lineage query performance issue. DataHub adopters with larger amount of datasets (like us) will find it necessary since otherwise the lineage features in the UI are not usable due to such issue. More explanation is in the PR and questions are welcome. Could someone please check if the fix is good? Thanks! 🙏 (@bulky-soccer-26729 @orange-night-91387 - Tagging you since you seem to be the experts in the lineage part of the code lookaround)

Thanks, @fierce-guitar-16421! Someone from the team will take a look teamwork

yes thanks so much!