Apache Flink

Hello Guys,
I am experimenting with a flink job that has 3 kafka sources for 3 topics and 3 kafka sinks for the same sources. What are the minimum number of slots required in this case?

minimum is 1 but it will depend on your parallelism setting

In Flink by default 1 instance of the entire pipeline runs in the same slot. So you need numslots == parallelism

If you start messing with slotsharing groups etc you can of course increase this requirement to higher but I would not worry about that for starters

I wanna run with 1 parallelism now. I am having have 1 slot per 1 taskmanager now.

okay. On the same lines how do i specify following configuration with flink operator
parallelism: 4 
taskSlots per TM : 1


did you check the docs and the examples? This should be obvious from any included example :slightly_smiling_face:

Yes I did. I set taskSlots =1 and parallelism=4. It din work. So i was checking here.

I am getting this error
2022-08-24 13:19:02,578 ERROR org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Fatal error occurred while executing the TaskManager. Shutting it down...
org.apache.flink.util.FlinkException: The TaskExecutor’s registration at the ResourceManager <akka.tcp://flink@10.42.0.241:6123/user/rpc/resourcemanager_0> has been rejected: Rejected TaskExecutor registration at the ResourceManager because: The ResourceManager does not recognize this TaskExecutor.

how does flink TM connects to JM when installed using a Flink operator . Does it use a service name?