Hi team, we observed there's a lot of network comm...
# troubleshootings
Sylvia Lin
07/14/2023, 5:28 PMHi team, we observed there's a lot of network communication btw task managers for stateful streaming pipeline, especially with large states.
For stateless streaming service, do we expect a lot network communication between each task managers as well?
r
Rajat Ahuja
07/14/2023, 5:32 PMmight happen there's a lot of shuffle for those jobs
s
Sylvia Lin
07/14/2023, 5:33 PMstate shuffle?
Sylvia Lin
07/14/2023, 5:34 PMYeah I guess the network communication is because of state shuffle. So I guess it shouldn't happen on stateless service?
r
Rajat Ahuja
07/14/2023, 5:35 PMyup
Rajat Ahuja
07/14/2023, 5:36 PM( Also i saw a post from you regarding the FLINK SQL infra set up on top of k8s ) Can. you check my post if you have faced similar issues ?
s
Sylvia Lin
07/14/2023, 5:36 PMcan you share the link?