guys, how do you manage flink environment variable...
# random
g
guys, how do you manage flink environment variables. it seems the flink environment has a file that it copies into /opt/flink/conf in the current available containers. need to have a look at the startup script, have a plan how to create a flink-conf.yaml on container start.
p
If you’re using Flink operator, there is a way to override that within
values.yml
g
i'm using the apache flink images, atm 1.18.1, looking at updating to 1.19.x want something better than copying file into image.
p
Do you deploy your Flink pipelines to a k8s environment?
g
this is local dev atm still
p
Gotcha. Depending on the config, you can set them in your
StreamExecutionEnvironment
g
docker
using docker compose
want to see what others are doing
p
You can override files with docker compose as well. Or you can add a environment variable named
FLINK_PROPERTIES
which will get append to the configurations file
g
will look. thanks.
👍 1
i've seen the flink properties before... never though to look further
and the log4jproperties and hive file... aka all the config files in the ./conf directory... option might be to pull them all out into a volume i mount back... and then disable the step in the startup that copies them into ./conf