Hey everyone,
I have a Flink job which processes a data stream and eventually writes it to Redis. I want the user to be able to change the Redis connection settings dynamically.
To enable this, I tried to send the connection settings in another stream in order to set the connection settings in the Redis sink according the connection config.
But I didn't find a way to connect the config stream directly to the sink. Moreover, even if I connect the streams before the sink and send the config and the data in the same stream to the sink, I still need to have some broadcast state in the sink, so I can have all the sink instances synchronized to the last connection settings. But as far as I can see, broadcast state is working only for BroadcastStream, not for sinks.
How something like that can be done?