Enrico Olivelli
05/26/2023, 6:41 AMEnrico Olivelli
05/26/2023, 6:42 AMEnrico Olivelli
05/26/2023, 9:20 AMEnrico Olivelli
05/26/2023, 10:04 AMFelix GV
05/26/2023, 10:05 AMFelix GV
05/26/2023, 10:06 AMEnrico Olivelli
05/26/2023, 10:34 AMFelix GV
05/26/2023, 11:15 AMEnrico Olivelli
05/26/2023, 12:45 PMFelix GV
05/26/2023, 12:48 PMEnrico Olivelli
05/26/2023, 1:24 PMEnrico Olivelli
05/26/2023, 1:45 PMEnrico Olivelli
05/26/2023, 3:47 PMClientConfig clientConfig = ClientConfig.defaultGenericClientConfig(storeName);
clientConfig.setVeniceURL("<http://localhost:7777>");
.....
CloseableHttpAsyncClient httpClient = HttpAsyncClients.custom()
.setMaxConnPerRoute(10)
.setMaxConnTotal(10)
.build();
HttpTransportClient transportClient = new HttpTransportClient(clientConfig.getVeniceURL(),
httpClient, ClientAuthenticationProvider.DISABLED);
clientConfig.setTransportClient(transportClient);
And now on my laptop I am able to see sub millisecond p50 latencies (0.6ms) and <2ms p99 latencies even with 10 concurrent requests.
So I think that there is some tuning to do hereEnrico Olivelli
05/26/2023, 3:47 PMZac Policzer
05/26/2023, 3:47 PMZac Policzer
05/26/2023, 3:48 PMEnrico Olivelli
05/27/2023, 6:04 AMFelix GV
05/27/2023, 9:31 AMZac Policzer
05/27/2023, 3:00 PMEnrico Olivelli
05/27/2023, 4:09 PMEnrico Olivelli
05/27/2023, 4:10 PMEnrico Olivelli
05/29/2023, 11:05 AM1.38
With 10 requests at a time, http1, 10 connections
0.65
1.13
1.47
With 100 requests at a time, http2, 1 connection
6.80
12.04
14.99
With 100 requests at a time, http1, 10 connections
6.71
9.53
12.99