Hello All, Has any one ever tried giving a sync AP...
# randomg
Gaurav Gupta
03/30/2023, 12:02 PMHello All, Has any one ever tried giving a sync API to trigger a task/job in FLINK? Any pointers will be helpful. We have a upstream looking forward to connect to our flink app using a sync API.
m
Martijn Visser
03/30/2023, 12:02 PMWhat's the use case for that?
g
Gaurav Gupta
03/30/2023, 12:04 PMBasically whatever processing we do in our FLINK app using streams, they want to use that DAG and call using an API. The upstream is also an orchestrator that waits on the response from our app to proceed further.
m
Martijn Visser
03/30/2023, 12:06 PMBut wouldn't that already be possible with your own source & sink? Basically you have an API, that triggers something as a source in Flink and waits until Flink sinks something to that?
Martijn Visser
03/30/2023, 12:07 PMI've seen people try to build this in Stackoverflow, but then they run into issues around guarantees etc.
g
Gaurav Gupta
03/30/2023, 12:11 PMissues around guaranteesThats exactly what my worry is if I build a wrapper API, that puts request to source and waits for a call back from SINK. Hence looking for any options that can help here - probably out of box from flink, such as HTTPReader source (if at all someone has tried) - how would we add call back to this URL to return back the response, etc.
m
Martijn Visser
03/30/2023, 12:11 PMg
Gaurav Gupta
03/30/2023, 12:12 PMahh great, let me have a look.