I see process functions have access to an `open` m...
# troubleshootingn
Nathanael England
02/16/2023, 4:16 AMI see process functions have access to an
openNathanael England
02/16/2023, 4:19 AMMy broadcast state is a map state, but it doesn't seem right to do a
get_map_state(<descriptor>)Nathanael England
02/16/2023, 4:22 AMThe context is that I'd like to have certain state that is broadcasted and have my process function maintain some convenience lookups inside the class. I don't want to have to broadcast out all the lookups as well, but it would seem like I'd need a way to rebuild the lookups on startup from any existing broadcast state (e.g. in the event of a restart).
Nathanael England
02/16/2023, 4:53 AMhttps://stackoverflow.com/questions/70083866/looking-for-flink-startup-hook-initialization-listener-to-recover-the-broadcast?rq=1 makes it seem like this would be doable in
openNathanael England
02/16/2023, 4:59 AMI suppose I don't need to do things on
openu
胡俊涛(Juntao Hu)
02/17/2023, 7:16 AMOperator state is not fully supported in PyFlink (only broadcast state) with some issues in chaining python operators, so you can’t do operator state initializing, like by implementing
CheckpointedFunctionn
Nathanael England
02/17/2023, 3:04 PMI don’t need operator state I don’t think. I just wanted a way to gather broadcast state in my open method. It seemed like I had to wait until process element or process broadcast element was called to do that.
2 Views