HI, we are trying to load test on AWS ec2 instance...
# general
k
HI, we are trying to load test on AWS ec2 instances for few datasources of size ~ 1TB , we have 5 brokers (R7a.8xlarge) and we tried different historicals like mgid.4xlarge ( 3 servers) , r6id.4xlarge ( 4 servers) r7a.8xlarge ( 4 servers) we started with 5 qps across 5 brokers and increase to 20 and we try to wentup to 40 qps . our queries are failing and we see success rate of about 70% and and latency is also around 10 secs but we are expecting around 1 secs latency . Any suggestions how to identify best ec2 for historical and brokers will be greatly appreciated .