https://datahubproject.io logo
Join SlackCommunities
Powered by
Getting errors in datahub-acryl-datahub-actions li...
# all-things-deployment
g
Getting errors in datahub-acryl-datahub-actions like
Copy code
%6|1661871831.917|FAIL|rdkafka#consumer-1| [thrd:<redacted>:9094/b]: redacted>:9094/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 0ms in state APIVERSION_QUERY, 4 identical error(s) suppressed)
d
Did you set up some security protocol to communicate with Kafka?
g
Yes @dazzling-judge-80093 Only SSL is supported I am setting under global
Copy code
springKafkaConfigurationOverrides:
    security.protocol: SSL
in helm chart values Earlier kafka setup job was also failing. But it worked after setting springKafkaConfigurationOverrides in global helm chart
a
We’re using acryldata/datahub-actions:v0.0.11
acryldata/datahub-gms:v0.9.6.2 successfully connected to the bootstrap server
Here’s a snippet from our Helm values.yaml
here nested under the 
global
key
Copy code
credentialsAndCertsSecrets:
      name: datahub-ssm-secrets
      secureEnv:
        sasl.jaas.config: sasl_jaas_config
        <http://basic.auth.user.info|basic.auth.user.info>: basic_auth_user_info
        sasl.username: sasl_username
        sasl.password: sasl_password
    springKafkaConfigurationOverrides:
      security.protocol: SASL_SSL
      sasl.mechanism: PLAIN
      client.dns.lookup: use_all_dns_ips
      basic.auth.credentials.source: USER_INFO
b
Hey @aloof-balloon-41159, is 
springKafkaConfigurationOverrides
on the same level as 
credentialsAndCertsSecrets
?
in your snippet above it's indented differently
Are you also seeing this on actionpod?
a
@bulky-electrician-72362 thanks for getting back to me! 😄
The formatting error is only in the snippet above - sorry about that! The values.yaml file has them on the same level
The action pod is the one logging this error. I only mentioned datahub-gms because it has successfully connected
(indicating that the credentials were configured correctly)
I confirmed with our infra team that Confluent Kafka is >0.10
s
Hi @aloof-balloon-41159 Did you manage to resolve this?
a
Yess I had to configure a custom executor.yaml per the docs 😓
BTW I used a K8s ConfigMap and mounted executor.yaml that way
Mounted it like this
values.yaml
Here’s an example ConfigMap
actions-configs-configmap.yaml
you could template it like that
actions-configs-configmap-template.yaml
then have a default values.yaml ike that
values-with-default-config.yaml
and modify the deployment like this? Think it would work. Untested!
deployment-mounting-actions-configs.yaml
lol anyway
thanks!
s
Thats quite helpful. Thanks for sharing 👍
Hi @aloof-balloon-41159 Since you have started using datahub-actions with k8s deployment, I was wondering if you have faced similar permissions issue I have mentioned here Please let me know if you managed to fix that 🙂
a
@shy-dog-84302 I don’t have the same security constraints you do. I’m running as root
s
Ok.. thanks
159 Views
Open in Slack
PreviousNext
Powered by