Bonjour,
Cela faisait longtemps.
Bon, je dois dire que l'algo BBR fonctionne plutôt bien.
J'ai vu sur le thread des tests à 10Gbps qu'avec un -P16 cela dégradait les résultats, du coup j'ai voulu tester l'upload en BBR chez moi avec une connexion à 1Gbps:
~$ iperf3 -c ping6.online.net -p 5207 -P 16 --get-server-output -V
iperf 3.6
Linux server 5.3.0-26-generic #28-Ubuntu SMP Wed Dec 18 05:37:46 UTC 2019 x86_64
Control connection MSS 1428
Time: Fri, 24 Jan 2020 09:11:22 GMT
Connecting to host ping6.online.net, port 5207
Cookie: eaowhsetdiy2ro67dskgbu24evhphasoeyu7
TCP MSS: 1428 (default)
[ 5] local 2a01:e0a:x port 50896 connected to 2001:bc8:1::40 port 5207
<...>
[ 35] local 2a01:e0a:x port 50926 connected to 2001:bc8:1::40 port 5207
Starting Test: protocol: TCP, 16 streams, 131072 byte blocks, omitting 0 seconds, 10 second test, tos 0
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 10.5 MBytes 88.5 Mbits/sec 1619 43.2 KBytes
[ 7] 0.00-1.00 sec 8.64 MBytes 72.5 Mbits/sec 1424 145 KBytes
[ 9] 0.00-1.00 sec 7.89 MBytes 66.1 Mbits/sec 1390 114 KBytes
[ 11] 0.00-1.00 sec 14.5 MBytes 122 Mbits/sec 2007 248 KBytes
[ 13] 0.00-1.00 sec 4.94 MBytes 41.5 Mbits/sec 925 41.8 KBytes
[ 15] 0.00-1.00 sec 600 KBytes 4.91 Mbits/sec 109 1.39 KBytes
[ 17] 0.00-1.00 sec 5.25 MBytes 44.1 Mbits/sec 836 160 KBytes
[ 19] 0.00-1.00 sec 1.48 MBytes 12.4 Mbits/sec 294 39.0 KBytes
[ 21] 0.00-1.00 sec 11.4 MBytes 95.6 Mbits/sec 2058 159 KBytes
[ 23] 0.00-1.00 sec 2.68 MBytes 22.5 Mbits/sec 490 9.76 KBytes
[ 25] 0.00-1.00 sec 4.03 MBytes 33.8 Mbits/sec 834 50.2 KBytes
[ 27] 0.00-1.00 sec 8.15 MBytes 68.4 Mbits/sec 1495 82.3 KBytes
[ 29] 0.00-1.00 sec 2.36 MBytes 19.8 Mbits/sec 522 47.4 KBytes
[ 31] 0.00-1.00 sec 1.11 MBytes 9.34 Mbits/sec 220 13.9 KBytes
[ 33] 0.00-1.00 sec 354 KBytes 2.90 Mbits/sec 74 22.3 KBytes
[ 35] 0.00-1.00 sec 5.71 MBytes 47.9 Mbits/sec 1122 71.1 KBytes
[SUM] 0.00-1.00 sec 89.7 MBytes 752 Mbits/sec 15419
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 1.00-2.00 sec 7.50 MBytes 62.9 Mbits/sec 1164 187 KBytes
[ 7] 1.00-2.00 sec 6.62 MBytes 55.5 Mbits/sec 1184 92.0 KBytes
[ 9] 1.00-2.00 sec 5.58 MBytes 46.8 Mbits/sec 980 90.6 KBytes
[ 11] 1.00-2.00 sec 15.0 MBytes 126 Mbits/sec 2166 117 KBytes
[ 13] 1.00-2.00 sec 3.43 MBytes 28.8 Mbits/sec 722 66.9 KBytes
[ 15] 1.00-2.00 sec 628 KBytes 5.14 Mbits/sec 113 27.9 KBytes
[ 17] 1.00-2.00 sec 9.74 MBytes 81.7 Mbits/sec 1505 71.1 KBytes
[ 19] 1.00-2.00 sec 1.10 MBytes 9.25 Mbits/sec 193 25.1 KBytes
[ 21] 1.00-2.00 sec 5.58 MBytes 46.8 Mbits/sec 1070 20.9 KBytes
[ 23] 1.00-2.00 sec 1.84 MBytes 15.4 Mbits/sec 357 58.6 KBytes
[ 25] 1.00-2.00 sec 2.14 MBytes 18.0 Mbits/sec 385 25.1 KBytes
[ 27] 1.00-2.00 sec 3.92 MBytes 32.9 Mbits/sec 768 66.9 KBytes
[ 29] 1.00-2.00 sec 1.72 MBytes 14.4 Mbits/sec 333 33.5 KBytes
[ 31] 1.00-2.00 sec 628 KBytes 5.14 Mbits/sec 146 22.3 KBytes
[ 33] 1.00-2.00 sec 950 KBytes 7.78 Mbits/sec 124 13.9 KBytes
[ 35] 1.00-2.00 sec 3.25 MBytes 27.2 Mbits/sec 631 44.6 KBytes
[SUM] 1.00-2.00 sec 69.6 MBytes 584 Mbits/sec 11841
- - - - - - - - - - - - - - - - - - - - - - - - -
<...>
[SUM] 9.00-10.00 sec 67.0 MBytes 562 Mbits/sec 9385
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 35.5 MBytes 29.8 Mbits/sec 5995 sender
[ 5] 0.00-10.00 sec 32.5 MBytes 27.3 Mbits/sec receiver
[ 7] 0.00-10.00 sec 80.5 MBytes 67.5 Mbits/sec 12610 sender
[ 7] 0.00-10.00 sec 77.9 MBytes 65.3 Mbits/sec receiver
[ 9] 0.00-10.00 sec 24.6 MBytes 20.6 Mbits/sec 4684 sender
[ 9] 0.00-10.00 sec 23.5 MBytes 19.7 Mbits/sec receiver
[ 11] 0.00-10.00 sec 125 MBytes 104 Mbits/sec 17657 sender
[ 11] 0.00-10.00 sec 121 MBytes 102 Mbits/sec receiver
[ 13] 0.00-10.00 sec 67.8 MBytes 56.9 Mbits/sec 11859 sender
[ 13] 0.00-10.00 sec 65.6 MBytes 55.1 Mbits/sec receiver
[ 15] 0.00-10.00 sec 7.57 MBytes 6.35 Mbits/sec 1499 sender
[ 15] 0.00-10.00 sec 7.22 MBytes 6.05 Mbits/sec receiver
[ 17] 0.00-10.00 sec 148 MBytes 124 Mbits/sec 19700 sender
[ 17] 0.00-10.00 sec 145 MBytes 122 Mbits/sec receiver
[ 19] 0.00-10.00 sec 12.7 MBytes 10.7 Mbits/sec 2520 sender
[ 19] 0.00-10.00 sec 12.2 MBytes 10.3 Mbits/sec receiver
[ 21] 0.00-10.00 sec 33.0 MBytes 27.7 Mbits/sec 6322 sender
[ 21] 0.00-10.00 sec 30.9 MBytes 25.9 Mbits/sec receiver
[ 23] 0.00-10.00 sec 17.0 MBytes 14.3 Mbits/sec 3134 sender
[ 23] 0.00-10.00 sec 16.2 MBytes 13.6 Mbits/sec receiver
[ 25] 0.00-10.00 sec 17.9 MBytes 15.1 Mbits/sec 3644 sender
[ 25] 0.00-10.00 sec 17.1 MBytes 14.4 Mbits/sec receiver
[ 27] 0.00-10.00 sec 19.9 MBytes 16.7 Mbits/sec 3864 sender
[ 27] 0.00-10.00 sec 17.8 MBytes 14.9 Mbits/sec receiver
[ 29] 0.00-10.00 sec 37.6 MBytes 31.5 Mbits/sec 6918 sender
[ 29] 0.00-10.00 sec 36.2 MBytes 30.4 Mbits/sec receiver
[ 31] 0.00-10.00 sec 10.2 MBytes 8.59 Mbits/sec 1942 sender
[ 31] 0.00-10.00 sec 9.86 MBytes 8.27 Mbits/sec receiver
[ 33] 0.00-10.00 sec 42.2 MBytes 35.4 Mbits/sec 7520 sender
[ 33] 0.00-10.00 sec 40.3 MBytes 33.8 Mbits/sec receiver
[ 35] 0.00-10.00 sec 19.7 MBytes 16.5 Mbits/sec 3852 sender
[ 35] 0.00-10.00 sec 18.7 MBytes 15.7 Mbits/sec receiver
[SUM] 0.00-10.00 sec 699 MBytes 586 Mbits/sec 113720 sender
[SUM] 0.00-10.00 sec 672 MBytes 564 Mbits/sec receiver
CPU Utilization: local/sender 2.7% (0.2%u/2.5%s), remote/receiver 4.9% (0.3%u/4.6%s)
snd_tcp_congestion bbr
Server output:
iperf 3.1.3
Linux ping 4.15.0-47-generic #50-Ubuntu SMP Wed Mar 13 10:44:52 UTC 2019 x86_64
-----------------------------------------------------------
Server listening on 5207
-----------------------------------------------------------
Time: Fri, 24 Jan 2020 09:11:22 GMT
Accepted connection from 2a01:e0a:x, port 50894
Cookie: eaowhsetdiy2ro67dskgbu24evhphasoeyu7
TCP MSS: 1428 (default)
[ 8] local 2001:bc8:1::40 port 5207 connected to 2a01:e0a:x port 50896
<...>
[ 38] local 2001:bc8:1::40 port 5207 connected to 2a01:e0a:x port 50926
Starting Test: protocol: TCP, 16 streams, 131072 byte blocks, omitting 0 seconds, 10 second test
[ ID] Interval Transfer Bandwidth
[ 8] 0.00-2.00 sec 14.6 MBytes 61.4 Mbits/sec
[ 10] 0.00-2.00 sec 12.2 MBytes 51.4 Mbits/sec
[ 12] 0.00-2.00 sec 12.1 MBytes 50.5 Mbits/sec
[ 14] 0.00-2.00 sec 25.7 MBytes 108 Mbits/sec
[ 16] 0.00-2.00 sec 7.34 MBytes 30.8 Mbits/sec
[ 18] 0.00-2.00 sec 987 KBytes 4.04 Mbits/sec
[ 20] 0.00-2.00 sec 12.8 MBytes 53.7 Mbits/sec
[ 22] 0.00-2.00 sec 2.20 MBytes 9.21 Mbits/sec
[ 24] 0.00-2.00 sec 14.8 MBytes 62.0 Mbits/sec
[ 26] 0.00-2.00 sec 3.98 MBytes 16.7 Mbits/sec
[ 28] 0.00-2.00 sec 5.10 MBytes 21.4 Mbits/sec
[ 30] 0.00-2.00 sec 9.67 MBytes 40.6 Mbits/sec
[ 32] 0.00-2.00 sec 3.45 MBytes 14.5 Mbits/sec
[ 34] 0.00-2.00 sec 1.45 MBytes 6.07 Mbits/sec
[ 36] 0.00-2.00 sec 1001 KBytes 4.10 Mbits/sec
[ 38] 0.00-2.00 sec 7.56 MBytes 31.7 Mbits/sec
[SUM] 0.00-2.00 sec 135 MBytes 566 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 8] 2.00-4.00 sec 17.9 MBytes 75.0 Mbits/sec
[ 10] 2.00-4.00 sec 9.02 MBytes 37.8 Mbits/sec
[ 12] 2.00-4.00 sec 5.44 MBytes 22.8 Mbits/sec
[ 14] 2.00-4.00 sec 42.5 MBytes 178 Mbits/sec
[ 16] 2.00-4.00 sec 6.47 MBytes 27.2 Mbits/sec
[ 18] 2.00-4.00 sec 2.91 MBytes 12.2 Mbits/sec
[ 20] 2.00-4.00 sec 15.1 MBytes 63.2 Mbits/sec
[ 22] 2.00-4.00 sec 2.61 MBytes 10.9 Mbits/sec
[ 24] 2.00-4.00 sec 5.74 MBytes 24.1 Mbits/sec
[ 26] 2.00-4.00 sec 3.08 MBytes 12.9 Mbits/sec
[ 28] 2.00-4.00 sec 2.13 MBytes 8.92 Mbits/sec
[ 30] 2.00-4.00 sec 4.39 MBytes 18.4 Mbits/sec
[ 32] 2.00-4.00 sec 5.96 MBytes 25.0 Mbits/sec
[ 34] 2.00-4.00 sec 1.11 MBytes 4.67 Mbits/sec
[ 36] 2.00-4.00 sec 4.58 MBytes 19.2 Mbits/sec
[ 38] 2.00-4.00 sec 3.19 MBytes 13.4 Mbits/sec
[SUM] 2.00-4.00 sec 132 MBytes 554 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
<...>
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 8] 8.00-10.00 sec 0.00 Bytes 0.00 bits/sec
[ 10] 8.00-10.00 sec 13.5 MBytes 56.8 Mbits/sec
[ 12] 8.00-10.00 sec 1.40 MBytes 5.88 Mbits/sec
[ 14] 8.00-10.00 sec 9.65 MBytes 40.5 Mbits/sec
[ 16] 8.00-10.00 sec 16.0 MBytes 67.3 Mbits/sec
[ 18] 8.00-10.00 sec 1.25 MBytes 5.23 Mbits/sec
[ 20] 8.00-10.00 sec 54.5 MBytes 229 Mbits/sec
[ 22] 8.00-10.00 sec 2.17 MBytes 9.11 Mbits/sec
[ 24] 8.00-10.00 sec 3.80 MBytes 16.0 Mbits/sec
[ 26] 8.00-10.00 sec 6.34 MBytes 26.6 Mbits/sec
[ 28] 8.00-10.00 sec 2.54 MBytes 10.6 Mbits/sec
[ 30] 8.00-10.00 sec 1.95 MBytes 8.18 Mbits/sec
[ 32] 8.00-10.00 sec 4.26 MBytes 17.9 Mbits/sec
[ 34] 8.00-10.00 sec 3.56 MBytes 14.9 Mbits/sec
[ 36] 8.00-10.00 sec 7.73 MBytes 32.4 Mbits/sec
[ 38] 8.00-10.00 sec 4.49 MBytes 18.8 Mbits/sec
[SUM] 8.00-10.00 sec 133 MBytes 559 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 8] 10.00-10.01 sec 0.00 Bytes 0.00 bits/sec
[ 10] 10.00-10.01 sec 0.00 Bytes 0.00 bits/sec
[ 12] 10.00-10.01 sec 0.00 Bytes 0.00 bits/sec
[ 14] 10.00-10.01 sec 1.39 KBytes 1.86 Mbits/sec
[ 16] 10.00-10.01 sec 58.6 KBytes 78.1 Mbits/sec
[ 18] 10.00-10.01 sec 0.00 Bytes 0.00 bits/sec
[ 20] 10.00-10.01 sec 0.00 Bytes 0.00 bits/sec
[ 22] 10.00-10.01 sec 8.37 KBytes 11.2 Mbits/sec
[ 24] 10.00-10.01 sec 8.37 KBytes 11.2 Mbits/sec
[ 26] 10.00-10.01 sec 23.7 KBytes 31.6 Mbits/sec
[ 28] 10.00-10.01 sec 2.79 KBytes 3.72 Mbits/sec
[ 30] 10.00-10.01 sec 2.79 KBytes 3.72 Mbits/sec
[ 32] 10.00-10.01 sec 0.00 Bytes 0.00 bits/sec
[ 34] 10.00-10.01 sec 0.00 Bytes 0.00 bits/sec
[ 36] 10.00-10.01 sec 5.58 KBytes 7.44 Mbits/sec
[ 38] 10.00-10.01 sec 13.9 KBytes 18.6 Mbits/sec
[SUM] 10.00-10.01 sec 126 KBytes 167 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval Transfer Bandwidth
[ 8] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 8] 0.00-10.01 sec 32.5 MBytes 27.2 Mbits/sec receiver
[ 10] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 10] 0.00-10.01 sec 77.9 MBytes 65.3 Mbits/sec receiver
[ 12] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 12] 0.00-10.01 sec 23.5 MBytes 19.7 Mbits/sec receiver
[ 14] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 14] 0.00-10.01 sec 121 MBytes 102 Mbits/sec receiver
[ 16] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 16] 0.00-10.01 sec 65.6 MBytes 55.0 Mbits/sec receiver
[ 18] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 18] 0.00-10.01 sec 7.22 MBytes 6.05 Mbits/sec receiver
[ 20] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 20] 0.00-10.01 sec 145 MBytes 122 Mbits/sec receiver
[ 22] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 22] 0.00-10.01 sec 12.2 MBytes 10.3 Mbits/sec receiver
[ 24] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 24] 0.00-10.01 sec 30.9 MBytes 25.9 Mbits/sec receiver
[ 26] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 26] 0.00-10.01 sec 16.2 MBytes 13.6 Mbits/sec receiver
[ 28] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 28] 0.00-10.01 sec 17.1 MBytes 14.3 Mbits/sec receiver
[ 30] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 30] 0.00-10.01 sec 17.8 MBytes 14.9 Mbits/sec receiver
[ 32] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 32] 0.00-10.01 sec 36.2 MBytes 30.4 Mbits/sec receiver
[ 34] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 34] 0.00-10.01 sec 9.86 MBytes 8.27 Mbits/sec receiver
[ 36] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 36] 0.00-10.01 sec 40.3 MBytes 33.8 Mbits/sec receiver
[ 38] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 38] 0.00-10.01 sec 18.7 MBytes 15.7 Mbits/sec receiver
[SUM] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[SUM] 0.00-10.01 sec 672 MBytes 564 Mbits/sec receiver
CPU Utilization: local/receiver 4.9% (0.3%u/4.6%s), remote/sender 1.4% (0.3%u/1.1%s)
iperf Done.
Bilan: même avec -P16 le débit reste à 564 (pareil avec un thread).
Du coup j'avais parlé aussi d'un test en UDP pour éviter toute intervention du protocol de congestion TCP:
~$ iperf3 -6 -c ping6.online.net -p 5207 --get-server-output -V -u -b 565M
iperf 3.6
Linux server 5.3.0-26-generic #28-Ubuntu SMP Wed Dec 18 05:37:46 UTC 2019 x86_64
Control connection MSS 1428
Setting UDP block size to 1428
Time: Fri, 24 Jan 2020 09:18:18 GMT
Connecting to host ping6.online.net, port 5207
Cookie: 3tum6c5ubybuz4xpqqnrobgrhryo3rb6ibgm
[ 5] local 2a01:e0a:x port 39148 connected to 2001:bc8:1::40 port 5207
Starting Test: protocol: UDP, 1 streams, 1428 byte blocks, omitting 0 seconds, 10 second test, tos 0
[ ID] Interval Transfer Bitrate Total Datagrams
[ 5] 0.00-1.00 sec 67.3 MBytes 565 Mbits/sec 49421
[ 5] 1.00-2.00 sec 67.4 MBytes 565 Mbits/sec 49456
[ 5] 2.00-3.00 sec 67.4 MBytes 565 Mbits/sec 49459
[ 5] 3.00-4.00 sec 67.4 MBytes 565 Mbits/sec 49457
[ 5] 4.00-5.00 sec 67.4 MBytes 565 Mbits/sec 49455
[ 5] 5.00-6.00 sec 67.4 MBytes 565 Mbits/sec 49459
[ 5] 6.00-7.00 sec 67.4 MBytes 565 Mbits/sec 49456
[ 5] 7.00-8.00 sec 67.4 MBytes 565 Mbits/sec 49459
[ 5] 8.00-9.00 sec 67.4 MBytes 565 Mbits/sec 49457
[ 5] 9.00-10.00 sec 67.4 MBytes 565 Mbits/sec 49456
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval Transfer Bitrate Jitter Lost/Total Datagrams
[ 5] 0.00-10.00 sec 673 MBytes 565 Mbits/sec 0.000 ms 0/494535 (0%) sender
[ 5] 0.00-10.00 sec 643 MBytes 539 Mbits/sec 0.022 ms 22619/494533 (4.6%) receiver
CPU Utilization: local/sender 19.2% (5.3%u/13.8%s), remote/receiver 9.2% (1.5%u/7.7%s)
Server output:
iperf 3.1.3
Linux ping 4.15.0-47-generic #50-Ubuntu SMP Wed Mar 13 10:44:52 UTC 2019 x86_64
-----------------------------------------------------------
Server listening on 5207
-----------------------------------------------------------
Time: Fri, 24 Jan 2020 09:18:18 GMT
Accepted connection from 2a01:e0a:x, port 50928
Cookie: 3tum6c5ubybuz4xpqqnrobgrhryo3rb6ibgm
[ 9] local 2001:bc8:1::40 port 5207 connected to 2a01:e0a:x port 39148
Starting Test: protocol: UDP, 1 streams, 1428 byte blocks, omitting 0 seconds, 10 second test
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 9] 0.00-2.00 sec 128 MBytes 536 Mbits/sec 0.025 ms 4780/98577 (4.8%)
[ 9] 2.00-4.00 sec 129 MBytes 540 Mbits/sec 0.056 ms 4347/98924 (4.4%)
[ 9] 4.00-6.00 sec 129 MBytes 540 Mbits/sec 0.077 ms 4359/98913 (4.4%)
[ 9] 6.00-8.00 sec 129 MBytes 541 Mbits/sec 0.035 ms 4203/98897 (4.2%)
[ 9] 8.00-10.00 sec 128 MBytes 537 Mbits/sec 0.076 ms 4925/98928 (5%)
[ 9] 10.00-10.01 sec 403 KBytes 561 Mbits/sec 0.022 ms 5/294 (1.7%)
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 9] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec 0.022 ms 22619/494533 (4.6%)
CPU Utilization: local/receiver 9.2% (1.5%u/7.7%s), remote/sender 1.5% (0.1%u/1.4%s)
iperf Done.
Bilan: environ 4.6% de perte.
Du coup je me demande si c'est dût à une saturation ou si ce ne serait pas un problème de fiabilité en emmission uniquement sur l'ONT.
PS: Toujours zero erreur sur les interfaces ethernet.