Hi, If I know the state sizes of my operators how can I calculate the minimum cluster size (Num TM, RAM, DISK)?
I have a job that has between 80-120 GB of state size and I was having issues with 3 replicas of 14GB + 100 GB of SSD. 4 Task Slots. I added a fourth replica and it was able to start before the exceeding the checkpoint timeout.
This looks to me oversized, as the job has low throughput and evenly distributed state across slots.