On 5/27/23 02:59, Willy Tarreau wrote:
The little difference makes me think you've sent your requests over a keep-alive connection, which is fine, but which doesn't stress the TLS stack anymore.
Yup. It was using keepalive. I turned keepalive off and repeated the tests.
I'm still not seeing a notable difference between the branches, so I have to wonder whether I need a completely different test. Or whether I simply don't need to worry about it at all because my traffic needs are so small.
Requests per second is down around 60 instead of 1200, and the request time percentile values went up. I've included two runs per branch here. 24 threads, each doing 1000 requests. The haproxy logs indicate the page I'm hitting returns 829 bytes, while the actual index.html is 1187 bytes. I think gzip compression and the HTTP headers explains the difference. Without keepalive, the overall test takes a lot longer, which is not surprising.
The high percentiles are not encouraging. 7 seconds to get a web page under 1kb?, even with 1.1.1t?
This might be interesting to someone: https://asciinema.elyograg.org/haproxyssltest1.html I put the project in github. https://github.com/elyograg/haproxytestssl quictls branch: OpenSSL_1_1_1t+quic 14:15:57.496 [main] INFO o.e.t.h.MainSSLTest Count 24000 64.65/s 14:15:57.498 [main] INFO o.e.t.h.MainSSLTest 10th % 28 ms 14:15:57.499 [main] INFO o.e.t.h.MainSSLTest 25th % 28 ms 14:15:57.499 [main] INFO o.e.t.h.MainSSLTest Median 31 ms 14:15:57.499 [main] INFO o.e.t.h.MainSSLTest 75th % 65 ms 14:15:57.500 [main] INFO o.e.t.h.MainSSLTest 95th % 2690 ms 14:15:57.500 [main] INFO o.e.t.h.MainSSLTest 99th % 5058 ms 14:15:57.500 [main] INFO o.e.t.h.MainSSLTest 99.9 % 9342 ms - 14:22:19.922 [main] INFO o.e.t.h.MainSSLTest Count 24000 65.39/s 14:22:19.924 [main] INFO o.e.t.h.MainSSLTest 10th % 28 ms 14:22:19.924 [main] INFO o.e.t.h.MainSSLTest 25th % 28 ms 14:22:19.924 [main] INFO o.e.t.h.MainSSLTest Median 31 ms 14:22:19.925 [main] INFO o.e.t.h.MainSSLTest 75th % 62 ms 14:22:19.925 [main] INFO o.e.t.h.MainSSLTest 95th % 2683 ms 14:22:19.925 [main] INFO o.e.t.h.MainSSLTest 99th % 4978 ms 14:22:19.925 [main] INFO o.e.t.h.MainSSLTest 99.9 % 7291 ms quictls branch: openssl-3.1.0+quic+locks 13:15:28.901 [main] INFO o.e.t.h.MainSSLTest Count 24000 63.43/s 13:15:28.903 [main] INFO o.e.t.h.MainSSLTest 10th % 29 ms 13:15:28.903 [main] INFO o.e.t.h.MainSSLTest 25th % 29 ms 13:15:28.903 [main] INFO o.e.t.h.MainSSLTest Median 32 ms 13:15:28.904 [main] INFO o.e.t.h.MainSSLTest 75th % 66 ms 13:15:28.904 [main] INFO o.e.t.h.MainSSLTest 95th % 2660 ms 13:15:28.904 [main] INFO o.e.t.h.MainSSLTest 99th % 4879 ms 13:15:28.905 [main] INFO o.e.t.h.MainSSLTest 99.9 % 9241 ms - 13:23:15.119 [main] INFO o.e.t.h.MainSSLTest Count 24000 62.99/s 13:23:15.121 [main] INFO o.e.t.h.MainSSLTest 10th % 29 ms 13:23:15.122 [main] INFO o.e.t.h.MainSSLTest 25th % 29 ms 13:23:15.122 [main] INFO o.e.t.h.MainSSLTest Median 32 ms 13:23:15.122 [main] INFO o.e.t.h.MainSSLTest 75th % 61 ms 13:23:15.123 [main] INFO o.e.t.h.MainSSLTest 95th % 2275 ms 13:23:15.123 [main] INFO o.e.t.h.MainSSLTest 99th % 6189 ms 13:23:15.123 [main] INFO o.e.t.h.MainSSLTest 99.9 % 11406 ms quictls branch: openssl-3.0.8+quic 13:34:25.780 [main] INFO o.e.t.h.MainSSLTest Count 24000 64.57/s 13:34:25.783 [main] INFO o.e.t.h.MainSSLTest 10th % 28 ms 13:34:25.783 [main] INFO o.e.t.h.MainSSLTest 25th % 28 ms 13:34:25.783 [main] INFO o.e.t.h.MainSSLTest Median 33 ms 13:34:25.783 [main] INFO o.e.t.h.MainSSLTest 75th % 66 ms 13:34:25.784 [main] INFO o.e.t.h.MainSSLTest 95th % 2642 ms 13:34:25.784 [main] INFO o.e.t.h.MainSSLTest 99th % 4994 ms 13:34:25.784 [main] INFO o.e.t.h.MainSSLTest 99.9 % 7503 ms - 14:08:33.750 [main] INFO o.e.t.h.MainSSLTest Count 24000 63.06/s 14:08:33.753 [main] INFO o.e.t.h.MainSSLTest 10th % 28 ms 14:08:33.753 [main] INFO o.e.t.h.MainSSLTest 25th % 29 ms 14:08:33.754 [main] INFO o.e.t.h.MainSSLTest Median 33 ms 14:08:33.754 [main] INFO o.e.t.h.MainSSLTest 75th % 64 ms 14:08:33.754 [main] INFO o.e.t.h.MainSSLTest 95th % 2904 ms 14:08:33.754 [main] INFO o.e.t.h.MainSSLTest 99th % 5216 ms 14:08:33.755 [main] INFO o.e.t.h.MainSSLTest 99.9 % 8287 ms
