Hi team
Is there any correlation between no of cpu memory and architecture with no of task slots in task manager ?
How to calculate effective no of task slots for a job in flink ?
k
Ken Krugler
11/22/2022, 10:59 PM
I’m not sure what you mean by “calculate effective no of task slots for a job”. If you’re asking how to determine how many slots you need…there’s no good answer, as it depends on your data rates, what processing happens in the workflow, your sources & sinks, etc. etc.
👍 1
c
clen.moras
11/24/2022, 9:45 AM
source. ->. processing ->. sink
Is there someone consuming from sink and what rate ?
what is the incoming rate at the source?
this should more or else detemine your processing speed. How you split this section is upto :
1. what is per taskmanager resource and limit.
2. what is the number of slots per TM.
3. Parallelism or reactive mode?
I think you should arrive at the right number
👍 1
s
Samrat Deb
11/24/2022, 5:50 PM
Thank you !
Samrat Deb
11/24/2022, 5:51 PM
I am reading more on flink code ! i see by default no of task slots = 1, irrespective of any type of architecture of machine in which taskmanager runs,
I agree lot of other factors like bandwidth , influx etc contribute to the no of slots per taskmanager .