Hi team Is there any correlation between no of cpu...
# random
s
Hi team Is there any correlation between no of cpu memory and architecture with no of task slots in task manager ? How to calculate effective no of task slots for a job in flink ?
k
I’m not sure what you mean by “calculate effective no of task slots for a job”. If you’re asking how to determine how many slots you need…there’s no good answer, as it depends on your data rates, what processing happens in the workflow, your sources & sinks, etc. etc.
👍 1
c
source. ->. processing ->. sink Is there someone consuming from sink and what rate ? what is the incoming rate at the source? this should more or else detemine your processing speed. How you split this section is upto : 1. what is per taskmanager resource and limit. 2. what is the number of slots per TM. 3. Parallelism or reactive mode? I think you should arrive at the right number
👍 1
s
Thank you !
I am reading more on flink code ! i see by default no of task slots = 1, irrespective of any type of architecture of machine in which taskmanager runs, I agree lot of other factors like bandwidth , influx etc contribute to the no of slots per taskmanager .