I face with an issue of duplicating keys (logs thr...
# ingestion
e
I face with an issue of duplicating keys (logs throw by datahub-gms) because of lower and upper case. I believe that I already delete those cases in elasticsearch and mysql, but those errors are still there. I already using search api on elasticsearch and querying in mysql but didn't hit keys which throw by gms. Is data only stored in elasticsearch and mysql?
s
what version are you running? Adding stacktrace would be helpful. Otherwise people won't know what issue you are facing.
b
Hi @eager-answer-71364, we recently made a change to the MySQL collation so that keys with different cases are different rows in MySQL
Which version are you running? If you deployed with an old version I can give you a SQL statement that will upgrade your collation
e
I already fix it by myself. To load ui of any urns, datahub-gms need to call graph-service index (elasticsearch) to find the first-depth downstream. So I fixed it by delete graph-service in elasticsearch and re-create empty one to make it start ingest to elasticsearch. This document https://github.com/linkedin/datahub/blob/master/docs/rfc/active/2042-graphql_frontend/queries.md describe how it actually works. Thank. I also close issue by myself. Thanks.