Hello!
So, I have done <https://datahubproject.io/...
# all-things-deployments
steep-doctor-17127
04/20/2023, 10:55 PMHello!
So, I have done https://datahubproject.io/docs/deploy/kubernetes and no issue .
However, now need to https://datahubproject.io/docs/deploy/aws Use AWS managed services for the storage layer and getting errors with Elasticsearch host connection.
It is too long to explain all I have done but if anyone could help with.
Thanks in advance
🔍 1
📖 1
l
lively-cat-88289
04/20/2023, 10:55 PMHey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request.
Let's double check a few things first: ✅ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? ✅ button ✅ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? ✅ button Did you find a solution to your issue? ❌ Sorry you weren't able to find a solution. I'm sending you some tips on info you can provide to help the community troubleshoot. Whenever you feel your issue is solved, please react ✅ to your original message to let us know!
d
delightful-ram-75848
04/25/2023, 3:17 AMHello @steep-doctor-17127, could you post the error logs here? also, could you share the value.yaml settings of elasticsearch? 🙂
s
steep-doctor-17127
05/10/2023, 5:38 PMHi I resolve the issue with elastic
However, I have an issue with aws glue schema
steep-doctor-17127
06/06/2023, 12:07 PMHello can you help me to add IAM conf for msk in value. yaml
=============
kafka:
====== I want to add this part =====
# client:
# properties:
# security.protocol: "SASL_SSL"
# sasl.mechanism: "AWS_MSK_IAM"
# sasl.jaas.config: software.amazon.msk.auth.iam.IAMLoginModule required;
# sasl.client.callback.handler.class: software.amazon.msk.auth.iam.IAMClientCallbackHandler
bootstrap:
server: "b-2.elantestdatahubnew.q54zfo.c21.kafka.us-east-1.amazonaws.com:9098,b-1.elantestdatahubnew.q54zfo.c21.kafka.us-east-1.amazonaws.com:9098,b-3.elantestdatahubnew.q54zfo.c21.kafka.us-east-1.amazonaws.com:9098"
zookeeper:
server: "z-1.elantestdatahubnew.q54zfo.c21.kafka.us-east-1.amazonaws.com:2181,z-2.elantestdatahubnew.q54zfo.c21.kafka.us-east-1.amazonaws.com:2181,z-3.elantestdatahubnew.q54zfo.c21.kafka.us-east-1.amazonaws.com:2181"
topics:
#metadata_change_event_name: "MetadataChangeEvent_v4"
# failed_metadata_change_event_name: "FailedMetadataChangeEvent_v4"
# metadata_audit_event_name: "MetadataAuditEvent_v4"
# datahub_usage_event_name: "DataHubUsageEvent_v1"
# metadata_change_proposal_topic_name: "MetadataChangeProposal_v1"
# failed_metadata_change_proposal_topic_name: "FailedMetadataChangeProposal_v1"
# metadata_change_log_versioned_topic_name: "MetadataChangeLog_Versioned_v1"
# metadata_change_log_timeseries_topic_name: "MetadataChangeLog_Timeseries_v1"
# platform_event_topic_name: "PlatformEvent_v1"
# datahub_upgrade_history_topic_name: "DataHubUpgradeHistory_v1"
metadata_change_event_name: "_schemas"
schemaregistry:
type: AWS_GLUE
glue:
region: "us-east-1"
registry: noor-new
partitions: 3
replicationFactor: 3
steep-doctor-17127
06/06/2023, 12:07 PMhttps://datahubspace.slack.com/files/U054XKD7DCG/F05BSGN6QSU/image.png▾