Zix-0.5.x-rcN-http3

[prothegee]

Description

Bump the zix entry to 0.5.x-rc1 for zix-http3.

Update:

• Zix new entry for H3.

Required to call from HttpArena:

• /benchmark -f zix-http3
• /benchmark -f zix-http3 --save

[prothegee]

/benchmark -f zix-http3

[github-actions]

👋 /benchmark request received. A collaborator will review and approve the run.

[github-actions]

Benchmark Results

Framework: zix-http3 | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline-h3	64	1,424	0.0%	280MiB	NEW	NEW
static-h3	64	1,225	46.4%	281MiB	NEW	NEW

Full log

Resumption: no
Application protocol: h3
. Stopping all clients.

6123. Stopping all clients.
. Stopping all clients.
. Stopping all clients.60


finished in 5.02s, 1390.80 req/s, 10.90KB/s
requests: 6954 total, 11050 started, 6954 done, 6954 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 6954 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 54.52KB (55824) total, 20.37KB (20862) headers (space savings 70.00%), 6.79KB (6954) data
UDP datagram: 950 sent, 7394 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      440us      2.06ms       701us     1.40ms     1.78ms      775us       294us    79.42%
connect     :      971us      2.90ms      1.32ms     2.20ms     2.90ms     1.43ms       377us    76.56%
TTFB        :     1.48ms      3.65ms      2.13ms     2.94ms     3.65ms     2.22ms       490us    67.19%
req/s       :      22.17    36199.22       22.38   14929.18   36199.22    1777.10     6682.32    92.19%
min RTT     :       51us       841us       390us      736us      841us      410us       153us    71.88%
smoothed RTT:      427us      1.21ms       558us     1.08ms     1.21ms      638us       206us    82.81%
packets sent:         11          19          17         18         19      16.77        1.27    93.75%
packets recv:         40         121         119        120        121     115.39       15.14    93.75%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          21           2         17         20       5.67        6.57    76.15%
[info] CPU 4.1% | Mem 280MiB

=== Best: 1424 req/s (CPU: 0.0%, Mem: 280MiB) ===
[info] saved results/baseline-h3/64/zix-http3.json
httparena-bench-zix-http3
httparena-bench-zix-http3

==============================================
=== zix-http3 / static-h3 / 64c (tool=h2load-h3) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
starting benchmark...
.Main benchmark duration is started for thread #1.

49.
.
27.
23.
050.
.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
Certificate: ED25519 256 bits
Negotiated Group: x25519
Resumption: no
Application protocol: h3

17. Stopping all clients.Stopped all clients for thread #

1Stopped all clients for thread #3
17
. Stopping all clients.
60Stopped all clients for thread #. Stopping all clients.14

38. Stopping all clients.
13

. Stopping all clients.
. Stopping all clients.

22. Stopping all clients.
. Stopping all clients.


finished in 5.02s, 1133.60 req/s, 67.66MB/s
requests: 5668 total, 9764 started, 5668 done, 5668 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 6151 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 338.32MB (354752213) total, 18.02KB (18453) headers (space savings 70.00%), 338.26MB (354694353) data
UDP datagram: 3451 sent, 327517 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      229us     26.49ms      9.39ms    19.55ms    24.43ms     9.88ms      5.44ms    71.05%
connect     :      952us     19.51ms      1.70ms    17.86ms    19.51ms     5.19ms      5.70ms    78.13%
TTFB        :     1.47ms     29.39ms      7.05ms    27.55ms    29.39ms     9.88ms      7.92ms    79.69%
req/s       :       0.00     4424.85       18.68    3208.59    4424.85     457.95     1132.72    85.94%
min RTT     :        0us     13.79ms       475us     9.99ms    13.79ms     2.22ms      3.50ms    84.38%
smoothed RTT:      973us    333.00ms      9.41ms    16.78ms   333.00ms    14.41ms     40.64ms    98.44%
packets sent:         25         117          50         91        117      55.86       19.76    73.44%
packets recv:       1972        6082        5385       5989       6082    5117.30      892.58    85.94%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          32           6         32         32      11.48       11.71    78.50%
[info] CPU 46.4% | Mem 281MiB

[run 2/3]
starting benchmark...


13.
11Main benchmark duration is started for thread #4.
.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 Warm-up started for thread #21.
253 bits
Certificate: ED25519 256 bits
Negotiated Group: x25519
Resumption: no
Application protocol: h3
53.
60. Stopping all clients.5. Stopping all clients.
0Stopped all clients for thread #. Stopping all clients.5

55. Stopping all clients.Stopped all clients for thread #0


19. Stopping all clients.Stopped all clients for thread #51

. Stopping all clients.Stopped all clients for thread #7


21. Stopping all clients.
40. Stopping all clients.
50. Stopping all clients.
. Stopping all clients.

finished in 5.02s, 1085.40 req/s, 64.81MB/s
requests: 5427 total, 9523 started, 5427 done, 5427 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 5961 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 324.05MB (339789316) total, 17.46KB (17883) headers (space savings 70.00%), 323.99MB (339733246) data
UDP datagram: 3209 sent, 317307 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      177us     18.70ms      6.14ms    15.36ms    18.37ms     6.90ms      4.05ms    64.70%
connect     :      904us     14.35ms      1.94ms     6.81ms    14.35ms     2.78ms      2.33ms    85.94%
TTFB        :     1.51ms     20.92ms      3.33ms    14.70ms    20.92ms     5.85ms      4.83ms    81.25%
req/s       :       0.00     7062.71       18.68    3290.92    7062.71     493.83     1409.66    89.06%
min RTT     :        0us      9.47ms       613us     6.19ms     9.47ms     1.96ms      2.43ms    82.81%
smoothed RTT:      280us    333.00ms      4.88ms    13.31ms   333.00ms    15.78ms     57.52ms    96.88%
packets sent:         21         108          44         91        108      52.02       18.55    81.25%
packets recv:       1966        6073        5216       6049       6073    4957.78      957.66    78.13%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          32           7         32         32      11.59       11.71    78.37%
[info] CPU 22.3% | Mem 280MiB

[run 3/3]
starting benchmark...
7.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
Certificate: ED25519 256 bits
Negotiated Group: x25519
Resumption: no
Application protocol: h3
48. Stopping all clients.
37Stopped all clients for thread #6
. Stopping all clients.
23. Stopping all clients.

33. Stopping all clients.
21. Stopping all clients.

47. Stopping all clients.
58. Stopping all clients.

finished in 5.02s, 1025.00 req/s, 62.23MB/s
requests: 5125 total, 9221 started, 5125 done, 5125 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 5750 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 311.15MB (326264694) total, 16.85KB (17250) headers (space savings 70.00%), 311.10MB (326210614) data
UDP datagram: 2982 sent, 309343 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      123us     15.80ms      5.11ms    13.86ms    15.72ms     5.43ms      3.47ms    73.00%
connect     :      860us      6.05ms      1.41ms     4.20ms     6.05ms     1.86ms      1.12ms    87.50%
TTFB        :     1.63ms     12.67ms      2.30ms     9.91ms    12.67ms     3.40ms      2.53ms    84.38%
req/s       :       0.00     6864.22       17.38    5541.09    6864.22     586.89     1622.58    87.50%
min RTT     :        0us     12.18ms        93us     4.29ms    12.18ms      758us      1.83ms    90.63%
smoothed RTT:       58us    333.00ms      3.78ms    12.18ms   333.00ms     8.81ms     41.30ms    98.44%
packets sent:         17          94          45         69         94      48.45       12.73    75.00%
packets recv:       1708        5979        4981       5925       5979    4833.34      894.18    81.25%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          32           8         32         32      11.83       11.76    77.82%
[info] CPU 0.0% | Mem 281MiB

=== Best: 1225 req/s (CPU: 46.4%, Mem: 281MiB) ===
[info] saved results/static-h3/64/zix-http3.json
httparena-bench-zix-http3
httparena-bench-zix-http3
[info] skip: zix-http3 does not subscribe to gateway-64
[info] skip: zix-http3 does not subscribe to gateway-h3
[info] skip: zix-http3 does not subscribe to production-stack
[info] skip: zix-http3 does not subscribe to unary-grpc
[info] skip: zix-http3 does not subscribe to unary-grpc-tls
[info] skip: zix-http3 does not subscribe to stream-grpc
[info] skip: zix-http3 does not subscribe to stream-grpc-tls
[info] skip: zix-http3 does not subscribe to echo-ws
[info] skip: zix-http3 does not subscribe to echo-ws-pipeline
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-h3-64.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-h3-64.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536

[prothegee]

/benchmark -f zix-http3

[github-actions]

👋 /benchmark request received. A collaborator will review and approve the run.

[github-actions]

Benchmark Results

Framework: zix-http3 | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline-h3	64	1,429	5.2%	288MiB	NEW	NEW
static-h3	64	1,159	0.0%	290MiB	NEW	NEW

Full log

status codes: 7058 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 55.33KB (56656) total, 20.68KB (21174) headers (space savings 70.00%), 6.89KB (7058) data
UDP datagram: 968 sent, 7501 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      393us      4.62ms       723us     2.23ms     3.66ms      923us       623us    90.88%
connect     :      905us      2.69ms      1.44ms     2.38ms     2.69ms     1.52ms       437us    68.75%
TTFB        :     1.40ms      4.47ms      2.08ms     3.61ms     4.47ms     2.36ms       693us    76.56%
req/s       :      22.17    29517.98       22.37      22.39   29517.98    1185.66     5475.97    95.31%
min RTT     :       47us      1.93ms       392us      932us     1.93ms      461us       290us    85.94%
smoothed RTT:      420us      2.90ms       577us     2.03ms     2.90ms      764us       509us    92.19%
packets sent:         14          18          17         18         18      16.92        0.76    59.38%
packets recv:         69         120         119        120        120     117.12        8.08    95.31%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          21           2         17         20       5.67        6.55    76.11%
[info] CPU 3.8% | Mem 288MiB

=== Best: 1429 req/s (CPU: 5.2%, Mem: 288MiB) ===
[info] saved results/baseline-h3/64/zix-http3.json
httparena-bench-zix-http3
httparena-bench-zix-http3

==============================================
=== zix-http3 / static-h3 / 64c (tool=h2load-h3) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
starting benchmark...
.Warm-up phase is over for thread #37.

.
.
.Main benchmark duration is started for thread #60.

15.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
Certificate: ED25519 256 bits
Negotiated Group: x25519
Resumption: no
Application protocol: h3
. Stopping all clients.

63. Stopping all clients.
40. Stopping all clients.
59. Stopping all clients.


. Stopping all clients.Stopped all clients for thread #30

13. Stopping all clients.
47. Stopping all clients.
5. Stopping all clients.


finished in 5.02s, 1042.00 req/s, 62.27MB/s
requests: 5210 total, 9306 started, 5210 done, 5210 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 5805 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 311.36MB (326487885) total, 17.01KB (17415) headers (space savings 70.00%), 311.31MB (326433339) data
UDP datagram: 3013 sent, 307187 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      208us     20.51ms      8.48ms    19.37ms    20.18ms     8.58ms      5.03ms    67.52%
connect     :      890us     19.91ms      1.54ms    16.29ms    19.91ms     4.04ms      4.89ms    82.81%
TTFB        :     1.62ms     33.59ms      6.04ms    19.68ms    33.59ms     7.87ms      6.66ms    85.94%
req/s       :       0.00     4234.04       18.09    2960.35    4234.04     504.85     1119.97    82.81%
min RTT     :        0us     10.42ms       394us     8.19ms    10.42ms     1.83ms      2.63ms    84.38%
smoothed RTT:      149us    333.00ms      8.09ms    15.85ms   333.00ms    13.03ms     40.83ms    98.44%
packets sent:         25          89          43         81         89      48.94       14.33    81.25%
packets recv:       1765        6052        4991       6002       6052    4799.61      986.61    78.13%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          32           7         32         32      11.62       11.72    78.24%
[info] CPU 42.5% | Mem 291MiB

[run 2/3]
starting benchmark...
22.
0.
60.
3.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
Certificate: ED25519 256 bits
Negotiated Group: x25519
Resumption: no
Application protocol: h3
.
27.Main benchmark duration is started for thread #53.

0. Stopping all clients.
1. Stopping all clients.
22. Stopping all clients.

39. Stopping all clients.

8. Stopping all clients.
43. Stopping all clients.
4. Stopping all clients.
23. Stopping all clients.
54. Stopping all clients.
49. Stopping all clients.

. Stopping all clients.
25. Stopping all clients.
. Stopping all clients.

finished in 5.02s, 1025.00 req/s, 61.67MB/s
requests: 5125 total, 9221 started, 5125 done, 5125 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 5689 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 308.35MB (323325729) total, 16.67KB (17067) headers (space savings 70.00%), 308.30MB (323272199) data
UDP datagram: 2990 sent, 306483 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      125us     12.50ms      5.68ms    10.51ms    12.02ms     5.77ms      2.75ms    67.61%
connect     :      815us      7.32ms      1.51ms     4.00ms     7.32ms     1.95ms      1.20ms    89.06%
TTFB        :     1.60ms     10.97ms      2.36ms     8.95ms    10.97ms     3.58ms      2.39ms    81.25%
req/s       :       0.00     7129.83       18.68    6236.10    7129.83    1207.31     2233.93    78.13%
min RTT     :        0us      9.11ms       146us     3.58ms     9.11ms      911us      1.54ms    87.50%
smoothed RTT:       64us    333.00ms      3.45ms     9.11ms   333.00ms    14.10ms     57.78ms    96.88%
packets sent:         17         118          42         89        118      48.62       20.07    79.69%
packets recv:       1801        6083        4938       5956       6083    4788.53     1007.34    75.00%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          32           8         32         32      11.74       11.75    77.94%
[info] CPU 21.2% | Mem 289MiB

[run 3/3]
starting benchmark...

0.
TLS Protocol: TLSv1.3
Cipher: TLS_AES_128_GCM_SHA256
Server Temp Key: X25519 253 bits
Certificate: ED25519 256 bits
Negotiated Group: x25519
Resumption: no
Application protocol: h3
10. Stopping all clients.. Stopping all clients.Main benchmark duration is over for thread #
. Stopping all clients.Stopped all clients for thread #Stopped all clients for thread #19
18
21Stopped all clients for thread #10


. Stopping all clients.

. Stopping all clients.Main benchmark duration is over for thread #Stopped all clients for thread #63
13. Stopping all clients.
12. Stopping all clients.

32. Stopping all clients.
24. Stopping all clients.



40. Stopping all clients.Stopped all clients for thread #60

. Stopping all clients.
44. Stopping all clients.
53. Stopping all clients.
58. Stopping all clients.Stopped all clients for thread #61


finished in 5.02s, 1034.60 req/s, 62.45MB/s
requests: 5173 total, 9269 started, 5173 done, 5173 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 5823 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 312.24MB (327406102) total, 17.06KB (17469) headers (space savings 70.00%), 312.19MB (327351282) data
UDP datagram: 2819 sent, 314607 received
                 min         max         median     p95        p99        mean         sd        +/- sd
request     :      262us     17.63ms      5.48ms    10.83ms    16.87ms     5.50ms      3.17ms    71.29%
connect     :      905us      9.15ms      1.70ms     3.98ms     9.15ms     2.00ms      1.26ms    92.19%
TTFB        :     1.45ms     13.91ms      2.57ms     9.02ms    13.91ms     3.62ms      2.72ms    87.50%
req/s       :      13.38     6608.52       17.98    4499.95    6608.52     668.79     1588.19    84.38%
min RTT     :        0us      6.18ms       105us     3.75ms     6.18ms      758us      1.37ms    85.94%
smoothed RTT:      100us    333.00ms      3.75ms     8.63ms   333.00ms     8.68ms     41.26ms    98.44%
packets sent:         16          84          43         69         84      46.00       12.28    79.69%
packets recv:       1318        5967        4999       5832       5967    4915.58      821.56    82.81%
packets lost:          0           0           0          0          0       0.00        0.00   100.00%
GRO packets :          1          32           8         32         32      11.85       11.78    77.65%
[info] CPU 0.0% | Mem 290MiB

=== Best: 1159 req/s (CPU: 0.0%, Mem: 290MiB) ===
[info] saved results/static-h3/64/zix-http3.json
httparena-bench-zix-http3
httparena-bench-zix-http3
[info] skip: zix-http3 does not subscribe to gateway-64
[info] skip: zix-http3 does not subscribe to gateway-h3
[info] skip: zix-http3 does not subscribe to production-stack
[info] skip: zix-http3 does not subscribe to unary-grpc
[info] skip: zix-http3 does not subscribe to unary-grpc-tls
[info] skip: zix-http3 does not subscribe to stream-grpc
[info] skip: zix-http3 does not subscribe to stream-grpc-tls
[info] skip: zix-http3 does not subscribe to echo-ws
[info] skip: zix-http3 does not subscribe to echo-ws-pipeline
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-h3-64.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-h3-64.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536

[prothegee]

This baby is hard. Make this PR as the draft.