that will heavy depend on your use case, maybe if the number of segments increase you could have problems just to keep the segments meta info in the heap
I can't find any material over this exact subject, but I use 200GB for each 4vCPU/8GB RAM, but I want querys with < 100ms latency