https://datahubproject.io logo
Join SlackCommunities
Powered by
Hi, My datahub setup is running on EKS, using AWS...
# all-things-deployment
c
Hi, My datahub setup is running on EKS, using AWS Elasticsearch 
7.10
, and also using it as a backend for GMS graph service by setting 
global.graph_service_impl = elasticsearch
in the helm chart. I'm getting errors while accessing data on Datahub UI, for e.g 
Analytics
page. I have attached the corresponding errors produced by GMS service. See datahub-gms.log Any help or hint in this case, please.
datahub-gms.log
b
We will get back shortly on this
c
@big-carpet-38439 I dunno if this interpretation is true; is it possible that I'm getting this error because I'm using elastic as graph backend for GMS service. Shall I try with neo4j instead? What do you think?
b
No o don’t think so. I think this is related to elasticsearch setup job! Cc @early-lamp-41924
Are you using ElasticSearch container ? Or Open Search or what?
c
I'm using AWS managed elasticsearch using es version 
7.10
. And from https://aws.amazon.com/blogs/aws/amazon-elasticsearch-service-is-now-amazon-opensearch-service-and-supports-opensearch-10/ I think AWS elasticsearch is now opensearch
And following are the logs from Elasticsearch setup job on EKS:
Copy code
datahub_usage_event_policy exists

datahub_usage_event_index_template exists
2022/06/14 11:55:58 Command finished successfully.
b
Got it thank you. US part of team is on national holiday today (Juneteenth) - I’ll refer you to me colleagues @square-activity-64562 @incalculable-ocean-74010 to help take a look. Thanks!
👍 1
s
In AWS OpenSearch what version of Elasticsearch are you using? Please note that all testing is done with Elasticsearch not Opensearch. So you will have to use a version of Opensearch when it was compatible with Elasticsearch
c
I am also having the same question around switching it from neo4g to managed version of AWS ES
c
I found the actual cause; basically, while passing es version as 
7.10
in 
terraform
, type conversion from 
number
to 
string
omitted the trailing zero and provisioned the es version 
7.1
instead. It is fixed by adding quotes like 
"7.10"
. After correction, Datahub UI is working fine Sorry for the noise 😞
4 Views
Open in Slack
PreviousNext
Powered by