Apache Flink

Hello folks, I think PyFlink doesn't have support for <https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/operators/asyncio/|AsyncIO> yet. Does anyone have experience making parallel network calls with PyFlink? What do people think the best way for this is? Thanks!

not much familiar with pyflink but something making it within a richflatmap function (or process function) should be ok.

just make sure to take into account the external service (maybe do async calls?) to not block the pipeline, as it might cause issues with latency, checkpoints etc.

Thanks Giannis, yeah I am more concerned about the async calls part :sweat_smile: I think <https://docs.python.org/3/library/asyncio.html|asyncio> is pretty standard for non-blocking I/O in Python. Since PyFlink doesn't seem to support it yet, I am wondering how/if I can achieve a similar functionality without PyFlink supporting it.