Hi! We’re moving ahead with out PoC, and now we’re...
# getting-startedh
high-hospital-85984
09/30/2020, 7:57 AMHi! We’re moving ahead with out PoC, and now we’re wondering what the minimum/maximum supported version are for the databases:
• MySQL or Postgres
• Neo4J
• Elasticsearch
high-hospital-85984
09/30/2020, 7:59 AMSorry, didn’t find any mention of this in the docs
high-hospital-85984
09/30/2020, 10:41 AMStumbled on this discussion: https://github.com/linkedin/datahub/issues/1722. So ES 6.X seems possible, but 5.X is the safer bet
b
bumpy-keyboard-50565
09/30/2020, 10:54 AMYou can check the docker files for recommended versions, e.g. https://github.com/linkedin/datahub/blob/master/docker/docker-compose.yml
bumpy-keyboard-50565
09/30/2020, 11:00 AMInternally we're running
• MySQL 5.7
• ES 5.5 (planning to upgrade to 7.x by EOY)
• neo4j 4.0.6
h
high-hospital-85984
09/30/2020, 12:28 PMokey thanks! Our worry is that ES 5.6 is EOL in March 2019 😬
high-hospital-85984
09/30/2020, 12:29 PMWould the internal bump to ES 7.x require some time to trickle down to the open source code base?
b
bumpy-keyboard-50565
09/30/2020, 12:31 PMMost likely. We'd prefer to battle test it before releasing it to OSS. That said, I believe someone in the OSS has already got it working. Need to dig through Slack and GH to find the conversation.
h
high-hospital-85984
09/30/2020, 12:41 PMAnd shouldn’t be too difficult to test locally, i guess 🤷♂️
b
bumpy-keyboard-50565
09/30/2020, 1:18 PMShould be fairly easy to test.
a
acceptable-architect-70237
09/30/2020, 2:35 PMI have tested the latest MySQL, the latest ES and latest Neo4j. I only saw the
dataset-index.json👍 1
acceptable-architect-70237
10/02/2020, 7:38 PMHave to take my word back. there are quite some code modification around ES in Datahub need to be modified for the latest ES.
h
high-hospital-85984
10/02/2020, 7:49 PMokey, good to know!
b
bumpy-keyboard-50565
10/02/2020, 8:36 PM@acceptable-architect-70237 care to do a PR if you get ES 7 working?
a
acceptable-architect-70237
10/02/2020, 8:45 PMsure. Internally we are using ES 7 so everything has been figured out.
b
bumpy-keyboard-50565
10/02/2020, 8:56 PMAwesome. @microscopic-waitress-95820 @microscopic-receptionist-23548 FYI
m
microscopic-receptionist-23548
10/02/2020, 9:46 PMI mentioned on github, might be a bit different for us
microscopic-receptionist-23548
10/02/2020, 9:46 PMWe need to provide an upgrade path to 7, we can't just drop 5 😛
microscopic-receptionist-23548
10/02/2020, 9:47 PMNot sure how LJ did it, if it just breaks 5 it is a no go. Though we can certainly take advantage of his work for a 7 implementation, we just might need to also have a 5 implementation for a bit, sadly
a
acceptable-architect-70237
10/05/2020, 2:44 PMinternally we only use es7 so yes, my implementation didn't support ES 5. It seems it is not easy to support both in code level. I saw some people does that in package level (also easier to drop the support to a certain version totally) down to the road. based on how datahub modules are organized, package level might not be realistic.