I'm trying to get the frontend working with our Ka...
# uiw
white-beach-27328
07/10/2021, 12:27 AMI'm trying to get the frontend working with our Kafka SSL so that analytics can be enabled, but for some reason the environment variables I'm setting don't seem to be getting picked up in the configuration. Ex:
KAFKA_PROPERTIES_SSL_TRUSTSTORE_LOCATION: file:/etc/service/keys/client.truststore.jksssl.truststore.location = nullwhite-beach-27328
07/12/2021, 3:38 PMFYI: @early-lamp-41924
e
early-lamp-41924
07/12/2021, 5:07 PMDid you turn on analytics? Zack?
w
white-beach-27328
07/12/2021, 5:11 PMyeah I set
global.datahub_analytics_enabledtruewhite-beach-27328
07/12/2021, 5:13 PMwhich sets the env var to
DATAHUB_ANALYTICS_ENABLEDtruewhite-beach-27328
07/12/2021, 5:13 PMon the frontend pod
e
early-lamp-41924
07/12/2021, 5:26 PMand KAFKA_PROPERTIES_SECURITY_PROTOCOL is set right?
early-lamp-41924
07/12/2021, 5:27 PMtho sorry about this, but ssl with prod analytics have recently been fixed
early-lamp-41924
07/12/2021, 5:27 PMwe will cut out a release soon
early-lamp-41924
07/12/2021, 5:27 PMsidenote. unrelated to the question tho
early-lamp-41924
07/12/2021, 5:28 PMKAFKA_PROPERTIES_SECURITY_PROTOCOL needs to be set to SSL
w
white-beach-27328
07/12/2021, 5:50 PMah the pod has
KAFKA_PROPERTIES_SSL_PROTOCOL: TLSwhite-beach-27328
07/12/2021, 5:56 PMside note, what’re the KAFKASTORE env vars used for?
e
early-lamp-41924
07/12/2021, 6:03 PMWe just copied over the kafka settings that get set on other pods for consistency
early-lamp-41924
07/12/2021, 6:04 PMbut in v0.8.1 there is a bug where we require all of the variables
early-lamp-41924
07/12/2021, 6:04 PMWe just released v0.8.6
early-lamp-41924
07/12/2021, 6:04 PMwith the fix included!!
early-lamp-41924
07/12/2021, 6:04 PMCan you try deploying? Should be a much smoother upgrade than before haha
w
white-beach-27328
07/12/2021, 6:15 PMprobably not immediately. It doesn’t seem like that
KAFKA_PROPERTIES_SECURITY_PROTOCOLwhite-beach-27328
07/12/2021, 6:17 PMwell if it doesn’t work with v0.8.1 then we can try to upgrade to fix this. I just wanted to know if that was required or not.
e
early-lamp-41924
07/12/2021, 6:32 PMThat’s very strange. that should’ve started reading new env variables and thrown an error bc you didn’t put in all of them
early-lamp-41924
07/12/2021, 6:33 PMis the security protocol getting set at least?
early-lamp-41924
07/12/2021, 6:33 PMUpgrade is required to enable kafka ssl with product analytics 😞 sorry about that
w
white-beach-27328
07/12/2021, 6:39 PMno the security protocol wasn’t being set with either the kafkastore setting or the normal properties. It also wasn’t logging any error.
white-beach-27328
07/12/2021, 6:39 PMOk cool. Thanks for the help! I’ll circle back when we get to the upgrade.
2 Views