It depends on your partition assignment and how often Flink is staying on each partition.
You'd have the time of to be paid as the context switch. You could also create some specific srtream to focus in some partitions if needed. This would be achievable using specific partitions 😄