[OpenWrt-Devel,RFC] lantiq: SMP interrupts and ethernet driver backport from vanilla v5
diff mbox series

Message ID 97e9b305-b22f-18e3-f472-ab6a11b681a3@gmail.com
State Superseded
Headers show
Series
  • [OpenWrt-Devel,RFC] lantiq: SMP interrupts and ethernet driver backport from vanilla v5
Related show

Commit Message

Petr Cvek Jan. 30, 2019, 10:38 a.m. UTC
Hello,

I discovered the lantiq xrx200 lacks support for interrupts on secondary
VPE, and I've managed to add this functionality to the kernel, the
second icu controller lives on base address 0x1f880300 and works in the
same way as first. Tested with 4.14.93 kernel, untested patches in the
attachment or on openwrt forum:

https://forum.openwrt.org/t/xrx200-irq-balancing-between-vpes/29732/11

My second submission is a backported xrx200 ethernet driver from vanilla
kernel v5 patched with switch and phy functions. Using kernel napi
polling seems to highly increase the throughput of the network.

Trying to initially increase the throughput of the network I've found
there is an inefficiently setting of DMA burst size. My patch sets this
value to a higher value.

These two patches were tested with 4.14.93 kernel too, there is forum
thread:

https://forum.openwrt.org/t/how-can-we-make-the-lantiq-xrx200-devices-faster/9724/30

RFC for any parallel development info (next version of ethernet driver
will be based on vanilla kernel version?), ideas, testing ...

best regards,
Petr Cvek

Comments

Mathias Kresin Jan. 31, 2019, 8:30 p.m. UTC | #1
30/01/2019 11:38, Petr Cvek:
> Hello,
> 
> I discovered the lantiq xrx200 lacks support for interrupts on secondary
> VPE, and I've managed to add this functionality to the kernel, the
> second icu controller lives on base address 0x1f880300 and works in the
> same way as first. Tested with 4.14.93 kernel, untested patches in the
> attachment or on openwrt forum:
> 
> https://forum.openwrt.org/t/xrx200-irq-balancing-between-vpes/29732/11
> 
> My second submission is a backported xrx200 ethernet driver from vanilla
> kernel v5 patched with switch and phy functions. Using kernel napi
> polling seems to highly increase the throughput of the network.
> 
> Trying to initially increase the throughput of the network I've found
> there is an inefficiently setting of DMA burst size. My patch sets this
> value to a higher value.
> 
> These two patches were tested with 4.14.93 kernel too, there is forum
> thread:
> 
> https://forum.openwrt.org/t/how-can-we-make-the-lantiq-xrx200-devices-faster/9724/30
> 
> RFC for any parallel development info (next version of ethernet driver
> will be based on vanilla kernel version?), ideas, testing ...
> 
> best regards,
> Petr Cvek

Hey Petr,

first of all, the patches don't apply as they are:

is: ./a/arch/mips/lantiq/irq.c
expected: a/arch/mips/lantiq/irq.c

For an official submission, a commit message is a must have. But even 
for testing it would be nice to have a commit message explaining what a 
patch is proposed to do. Otherwise it is kind of hard to provide any 
comments.

Furthermore, it would be very helpful if the source of the changes is 
mentioned. At least parts of the code seem to be from intel/lantiq UGW 7.x.

The backport of the vanilla eth driver breaks Ethernet completely on my 
board. I dropped it during my testing.

Since we're all busy, providing some numbers about the seen improvement 
would might raise more interest. Ideally, you provide the numbers per 
patch, to see if a specific patch really changes something.

I gave the patches a quick try in conjunction with the irqbalance 
package (to not move driver irqs from one core/vpe to another by hand). 
I saw an improvement in throughput on my BT HomeHub 5a while doing iperf 
from 5Ghz wireless to a lan client.

The bandwidth was UP: 195 Mbits/s, DOWN: 137 Mbit/s with the patches 
applied, while it was UP: 152 Mbit/s, DOWN: 95,5 MBit/s without. It's 
more than the all time max of 180MBit, I measured a long time ago in a 
test setup I can't remember.

But I only consider wireless benchmarks in a shielded/isolated 
environment as reliable anyway. It's good to know, but benchmarking the 
ethernet (nat/routing) should be more reliable. As we speak of 
benchmarking the ethernet, it would be interesting to see if enabling 
flow offloading improves the situation even further.

Of course, the 5GHz wireless bandwidth is still less than the 385 
Mbits/s I benchmarked with the BT firmware in the tests setup I can't 
remember. Nevertheless, it's promising.

Mathias
Hauke Mehrtens Feb. 1, 2019, 9:51 a.m. UTC | #2
On 1/31/19 9:30 PM, Mathias Kresin wrote:
> 30/01/2019 11:38, Petr Cvek:
>> Hello,
>>
>> I discovered the lantiq xrx200 lacks support for interrupts on secondary
>> VPE, and I've managed to add this functionality to the kernel, the
>> second icu controller lives on base address 0x1f880300 and works in the
>> same way as first. Tested with 4.14.93 kernel, untested patches in the
>> attachment or on openwrt forum:
>>
>> https://forum.openwrt.org/t/xrx200-irq-balancing-between-vpes/29732/11
>>
>> My second submission is a backported xrx200 ethernet driver from vanilla
>> kernel v5 patched with switch and phy functions. Using kernel napi
>> polling seems to highly increase the throughput of the network.
>>
>> Trying to initially increase the throughput of the network I've found
>> there is an inefficiently setting of DMA burst size. My patch sets this
>> value to a higher value.
>>
>> These two patches were tested with 4.14.93 kernel too, there is forum
>> thread:
>>
>> https://forum.openwrt.org/t/how-can-we-make-the-lantiq-xrx200-devices-faster/9724/30
>>
>>
>> RFC for any parallel development info (next version of ethernet driver
>> will be based on vanilla kernel version?), ideas, testing ...
>>
>> best regards,
>> Petr Cvek
> 
> Hey Petr,
> 
> first of all, the patches don't apply as they are:
> 
> is: ./a/arch/mips/lantiq/irq.c
> expected: a/arch/mips/lantiq/irq.c
> 
> For an official submission, a commit message is a must have. But even
> for testing it would be nice to have a commit message explaining what a
> patch is proposed to do. Otherwise it is kind of hard to provide any
> comments.
> 
> Furthermore, it would be very helpful if the source of the changes is
> mentioned. At least parts of the code seem to be from intel/lantiq UGW 7.x.
> 
> The backport of the vanilla eth driver breaks Ethernet completely on my
> board. I dropped it during my testing.
> 
> Since we're all busy, providing some numbers about the seen improvement
> would might raise more interest. Ideally, you provide the numbers per
> patch, to see if a specific patch really changes something.
> 
> I gave the patches a quick try in conjunction with the irqbalance
> package (to not move driver irqs from one core/vpe to another by hand).
> I saw an improvement in throughput on my BT HomeHub 5a while doing iperf
> from 5Ghz wireless to a lan client.
> 
> The bandwidth was UP: 195 Mbits/s, DOWN: 137 Mbit/s with the patches
> applied, while it was UP: 152 Mbit/s, DOWN: 95,5 MBit/s without. It's
> more than the all time max of 180MBit, I measured a long time ago in a
> test setup I can't remember.
> 
> But I only consider wireless benchmarks in a shielded/isolated
> environment as reliable anyway. It's good to know, but benchmarking the
> ethernet (nat/routing) should be more reliable. As we speak of
> benchmarking the ethernet, it would be interesting to see if enabling
> flow offloading improves the situation even further.
> 
> Of course, the 5GHz wireless bandwidth is still less than the 385
> Mbits/s I benchmarked with the BT firmware in the tests setup I can't
> remember. Nevertheless, it's promising.
> 
> Mathias

Hi Petr,

I am also interested in benchmarks with only one of the patches to know
which patch gives us which improvement. The IRQ controller patch needs
some improvements to get into mainline Linux kernel and I would look
into it if it creates some improvement.
Are the IRQs on the 2. VPE used automatically or do you use it with irq
balanced?
Could you please provide the output of "cat /proc/interrupts"

I used vanilla upstream kernel without the OpenWrt patches and only got
about 60MBit/s NAT performance, but I think about 300MBit/s software
forwarding performance. We should probably make use for scattered DMA in
the driver too. I plan to use this new driver + a DSA switch driver in
OpenWrt, but we still need a good configuration migration script.

Hauke
Petr Cvek Feb. 1, 2019, 11:36 a.m. UTC | #3
Dne 01. 02. 19 v 10:51 Hauke Mehrtens napsal(a):> On 1/31/19 9:30 PM,
Mathias Kresin wrote:
>> 30/01/2019 11:38, Petr Cvek:
>>>

Hi,

thank you both for the answer and sorry for "./" in the patches I
usually do only git patching :-D. The patches are really RFC only. For
example I would like to know if a separate node is the best way for SMP
irq controller (ICU). The second set of the registers could be just
appended at the end of icu0 registers.

Origin of patches: well I was able to find second ICU just by dumping
iomem space and looking for patterns (which is enough to make a clean
implementation), but I was lazy to write it (again, done it once for
some FPGA) myself so I've copied part of the code from this repo:

https://github.com/paldier/K3C-merlin/blob/master/release/src-lantiq/linux/linux-3.10.104/arch/mips/lantiq/irq.c

The probable address of second ICU was confirmed by grepping the GPL
source codes from my modem's vendor (tplink td-W9980)

https://static.tp-link.com/resources/gpl/GPL_TD-W9980.tar.gz

The burst flag is basically the same value as in "etop" code path. The
warning about 8 word burst size is again from tplink source blob (btw I
think the DMA_2W_BURST flag in 4.14.9x is actually 4 word burst, but I
didn't confirmed it yet).

> I am also interested in benchmarks with only one of the patches to know
> which patch gives us which improvement. The IRQ controller patch needs
> some improvements to get into mainline Linux kernel and I would look
> into it if it creates some improvement.

Thats gonna be a bit of a problem. My TD-W9980 has sadly a wave300 5G
wifi driver, so I cannot test on it as it is broken and crashing the
system (I've managed only make a few scans). For 2.4G wifi, I have only
150Mbps usb dongles, which are slow even without local interferences. My
VDSL has only 22:2 which is OK even with vendor's firmware.

My only option for a benchmarking is the ethernet which is (with the
vanilla openwrt driver) extremely slow. My backport increased the TX
speed of the modem from about 4.5 MiByte/s to about 7.5 MiByte/s (TCP
netcat pipe, ACKs on RX FIFO). Gonna try iperf tomorrow. The driver
works even with NFS rootfs over it. Sometimes a kernel warning about
timeout is printed, but the system works afterwards and this is only a
RFC stage. Probably some spinlock is missing or irq gets acked at the
wrong place. It _will_ be fixed.

What is interesting is my observation of long frames (4000-6000) which
are sometimes coming from lantiq (observed in wireshark). My server is
sending only classic ~1500 frames and I know the lantiq driver is
limited to them too (+ tested in ip link set eth0 mtu 3000 -> error).

> Are the IRQs on the 2. VPE used automatically or do you use it with irq
> balanced?
> Could you please provide the output of "cat /proc/interrupts"
> 
The interupts are used automatically, but the distribution is quite
random. I don't have irqbalance package compiled.

# cat /proc/interrupts
           CPU0       CPU1
  7:      31309      31096      MIPS   7  timer
  8:        586        607      MIPS   0  IPI call
  9:       5991      10371      MIPS   1  IPI resched
 22:      14762          1       icu  22  spi_rx
 23:       2496          1       icu  23  spi_tx
 24:          0          0       icu  24  spi_err
 62:          0          0       icu  62  1e101000.usb, dwc2_hsotg:usb1
 63:          0        192       icu  63  mei_cpe
 72:      11133          0       icu  72  vrx200_rx
 73:          0      13833       icu  73  vrx200_tx
 91:          0         81       icu  91  1e106000.usb, dwc2_hsotg:usb2
112:        745          0       icu 112  asc_tx
113:          0        222       icu 113  asc_rx
114:          0          0       icu 114  asc_err
126:          0          0       icu 126  gptu
127:          0          0       icu 127  gptu
128:          0          0       icu 128  gptu
129:          0          0       icu 129  gptu
130:          0          0       icu 130  gptu
131:          0          0       icu 131  gptu
161:          0          0       icu 161  ifx_pcie_rc0
ERR:          1

(using napi polling decreases interrupt generation, so 11133 and 13833
values are not real number of packets transmitted, the vanilla driver
has more then twice as much as backported driver)

The affinity can be set in /proc/irq/$NUM, this can be used for testing
the improvements cause by patch (the burst width can be written on the
fly too).

> We should probably make use for scattered DMA in
> the driver too. 

I would like to try, but I don't have any vrx200 SoC TRM datasheets and
even with different kernel versions (from vendors) the picture is not
complete.

Petr
Petr Cvek Feb. 2, 2019, 10:28 a.m. UTC | #4
Hi Yaroslav,


Dne 01. 02. 19 v 16:31 Yaroslav Petrov napsal(a):
> Hi Petr,
>  
> I test it on vgv7510kw22 (100Mbit ports):
>  
> 1. The backport of the vanilla eth driver path doesnt work (interfaces
> are DOWN) -> no Network

As there is phy interface in openwrt version it is possible it is not compatible with your device I think I've had to change the iteration over phy OF nodes to fit these two variants together. Anyway that isn't a critical section, the critical section is xmit, poll and rx parts, which are really ineffective in openwrt version. 

> 2. ICU patch give is quite interesting result: If rx/tx are balanced
> betwin CPUs, I have c.a. 88Mbit/sec (max 65% sirq load) and c.a. 92Mbit
> without balancing (max 50% sirq load):

I have a theory about that I was fiddling with /proc/irq/72/smp_affinity and /proc/irq/73/smp_affinity and it seems there is a correlation with SMP affinity of IRQ and communicating process.

With this test:

host (server, receiving):
	nc -l -p 4321 | pv > /dev/null
lantiq (client, sending):
	cat /dev/zero | nc 10.0.0.1 4321

I can get in pv up to 9.3 MiByte/s when both irqs are on the same VPE. When IRQs are on different VPEs I can get about 8.3 MiByte/s. When I quickly switch both IRQ on the other VPE I get about 7.4 MiByte/s for few seconds until it reaches again 9.3 MiByte/s. That probably scheduler moving netcat process on the same VPE as interrupts are.

So it seems there is some overhead between two VPEs on sending data and receiving TCP handshakes. So the ethernet seems to be more effective to have both IRQ on the same VPE. But other peripherals could use this for the similar speedup. If all ethernet IRQs would be on one VPE and all wifi IRQs (+ wpa_supplicant) on the other, the wpa_supplicant should be faster in a similar fashion as netcat is faster there.

my iperf3 tests (iperf3 -s on lantiq): all 5 patches, vrx200_rx on CPU0, vrx200_tx on CPU1, no irqbalance, TD-W9980B (2x 1G native phy, 2x 1G external phy; lan 20m 5e UTP connected in port "lan 2" - on external phy), rootfs over NFS, no wifi, no DSL, no USB, fixed kernel warnings about full TX fifo in backported ethernet driver

iperf3 -c 10.0.0.80
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   354 MBytes   297 Mbits/sec  456             sender
[  4]   0.00-10.00  sec   353 MBytes   296 Mbits/sec                  receiver

iperf3 -c 10.0.0.80 -R
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   115 MBytes  96.5 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   115 MBytes  96.5 Mbits/sec                  receiver

iperf3 -c 10.0.0.80 -u -b 150M
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  715.205 ms  789/929 (85%)  
[  4] Sent 929 datagrams
... in lantiq console:
[  5]   0.00-10.00  sec  1.09 MBytes   917 Kbits/sec  715.205 ms  789/929 (85%)  receiver

iperf3 -c 10.0.0.80 -u -b 150M -R
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.157 ms  0/22887 (0%)  
[  4] Sent 22887 datagrams
... in lantiq console
[  5]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.000 ms  0/22887 (0%)  sender

iperf3 -c 10.0.0.80 -u -b 1000M
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.01 GBytes   865 Mbits/sec  0.284 ms  131600/132024 (1e+02%)  
[  4] Sent 132024 datagrams
... in lantiq console
[  5]   0.00-10.00  sec  3.31 MBytes  2.78 Mbits/sec  0.284 ms  131600/132024 (1e+02%)  receiver

iperf3 -c 10.0.0.80 -u -b 1000M -R
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   248 MBytes   208 Mbits/sec  0.022 ms  0/31752 (0%)  
[  4] Sent 31752 datagrams
... in lantiq console
[  5]   0.00-10.00  sec   248 MBytes   208 Mbits/sec  0.000 ms  0/31752 (0%)  sender

===========================

BTW before backporting the whole vanilla ethernet driver I've come to some optimizations in openwrt version

static int xrx200_poll_rx(struct napi_struct *napi, int budget)
...
        if (complete || !rx) {
                napi_complete(&ch->napi);
                ltq_dma_enable_irq(&ch->dma);
        }

if changed to:

        if (complete || !rx) {
                if (napi_complete_done(&ch->napi, rx)) {
	                ltq_dma_enable_irq(&ch->dma);
                }
        }

will reduce irq load (irq will generate only after work completion)

Another place at:

static void xrx200_tx_housekeeping(unsigned long ptr)
...
        for (i = 0; i < XRX200_MAX_DEV && ch->devs[i]; i++)
                netif_wake_queue(ch->devs[i]);

any tasklet will try to wake both queues (the second one wasn't even used in my device!). Reducing the driver to only a single TX queue increased the TX bitrate.

(IMO there is a timeout problem with the vanilla driver, where xrx200_start_xmit() can stop the queue if all descriptors are filled, but there is no queue waking up in xrx200_tx_housekeeping().


best regards
Petr
Petr Cvek Feb. 3, 2019, 8:44 a.m. UTC | #5
I did an exhaustive ethernet measuring. Parameters: no wifi, no running
dsl connection, 1 cable (in 1G port with external phy), no USB, almost
vanilla openwrt (changes for rootfs on NFS, kernel command line and fix
for uwc2 USB).

run.sh
A script which runs and logs measurements into a file named by its first
parameter (or just the unix epoch time). You need to run "iperf3 -s" on
lantiq manually.

*_a and *_b files
Main iperf3 measurements. It seems the schedulers migrates processes
between VPEs (in every configuration). There are sometimes differences
of ~20Mbit/s. To isolate that one would probably have to compile and use
cgroups.

*_netcat
Running netcat pipe with pipeview in server/client and TCP/UDP mode.
More useful to measure the changes of the process affinity.

vanilla*
Default (slowest) openwrt code.

backported*
Ethernet driver with full napi polling, used from vanilla kernel v5.
Newest patch in the attachment too.

dma_burst*
The change in size of DMA burst, from default to (probably) 4 words.

smp_icu_different_vpes*
ICU with SMP interrupts support. Forcing the IRQ SMP affinity to
different VPE for TX and RX interrupt. Process jumping between VPE
should have the smallest impact here.

smp_icu_same_vpe*
Both TX and RX interrupts are on the same VPE (forced on CPU0). Probably
the biggest impact from process jumping between VPEs (not checked).

everything*
SMP ICU, DMA burst and "backported" ethernet driver together.


Notes:
1) The backported driver seems to not working on some machines (I would
assume everything different from 4x 1G ports). You can still patch the
polling and interrupt routines to match the vanilla kernel. A help why
it doesn't boot would be appreciated (are your machine using multiple
eth%d interfaces, how does dmesg look like, ...).

2) The vanilla openwrt driver declares TX2 interrupt and HW. There is no
traffic on this interrupt (on DMA channel probably too?). Does anybody
have some documentation how this work? Are there more DMA interfaces
from/to which send the data?

3) The second ICU devicetree node doesn't need to be deleted for
uniprocessor ICU usage.


Feel free to make your own tests and sorry for hardcoded IPs :-D

Petr

Dne 30. 01. 19 v 11:38 Petr Cvek napsal(a):
> Hello,
> 
> I discovered the lantiq xrx200 lacks support for interrupts on secondary
> VPE, and I've managed to add this functionality to the kernel, the
> second icu controller lives on base address 0x1f880300 and works in the
> same way as first. Tested with 4.14.93 kernel, untested patches in the
> attachment or on openwrt forum:
> 
> https://forum.openwrt.org/t/xrx200-irq-balancing-between-vpes/29732/11
> 
> My second submission is a backported xrx200 ethernet driver from vanilla
> kernel v5 patched with switch and phy functions. Using kernel napi
> polling seems to highly increase the throughput of the network.
> 
> Trying to initially increase the throughput of the network I've found
> there is an inefficiently setting of DMA burst size. My patch sets this
> value to a higher value.
> 
> These two patches were tested with 4.14.93 kernel too, there is forum
> thread:
> 
> https://forum.openwrt.org/t/how-can-we-make-the-lantiq-xrx200-devices-faster/9724/30
> 
> RFC for any parallel development info (next version of ethernet driver
> will be based on vanilla kernel version?), ideas, testing ...
> 
> best regards,
> Petr Cvek
>
+ : ':::::::[' configuration backported ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 58278 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  29.8 MBytes   250 Mbits/sec   63   65.0 KBytes       
[  4]   1.00-2.00   sec  31.3 MBytes   263 Mbits/sec   88    120 KBytes       
[  4]   2.00-3.00   sec  25.0 MBytes   210 Mbits/sec   46   66.5 KBytes       
[  4]   3.00-4.00   sec  31.4 MBytes   264 Mbits/sec   51    115 KBytes       
[  4]   4.00-5.00   sec  32.2 MBytes   270 Mbits/sec   65    120 KBytes       
[  4]   5.00-6.00   sec  31.4 MBytes   264 Mbits/sec  101   84.8 KBytes       
[  4]   6.00-7.00   sec  32.0 MBytes   268 Mbits/sec   73    115 KBytes       
[  4]   7.00-8.00   sec  17.0 MBytes   143 Mbits/sec   45   89.1 KBytes       
[  4]   8.00-9.00   sec  26.3 MBytes   221 Mbits/sec   55   72.1 KBytes       
[  4]   9.00-10.00  sec  30.3 MBytes   254 Mbits/sec   91   99.0 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   287 MBytes   241 Mbits/sec  678             sender
[  4]   0.00-10.00  sec   286 MBytes   240 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 58320 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  10.9 MBytes  91.2 Mbits/sec                  
[  4]   1.00-2.00   sec  13.9 MBytes   117 Mbits/sec                  
[  4]   2.00-3.00   sec  13.9 MBytes   117 Mbits/sec                  
[  4]   3.00-4.00   sec  13.9 MBytes   116 Mbits/sec                  
[  4]   4.00-5.00   sec  13.9 MBytes   117 Mbits/sec                  
[  4]   5.00-6.00   sec  13.9 MBytes   116 Mbits/sec                  
[  4]   6.00-7.00   sec  13.9 MBytes   116 Mbits/sec                  
[  4]   7.00-8.00   sec  13.9 MBytes   117 Mbits/sec                  
[  4]   8.00-9.00   sec  13.9 MBytes   117 Mbits/sec                  
[  4]   9.00-10.00  sec  13.9 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   136 MBytes   114 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   136 MBytes   114 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 48963 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.5 MBytes   138 Mbits/sec  2109  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2285  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   3.00-4.00   sec  17.8 MBytes   150 Mbits/sec  2282  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2293  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   9.00-10.00  sec  17.8 MBytes   150 Mbits/sec  2284  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  6.571 ms  1024/1248 (82%)  
[  4] Sent 1248 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 42721 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  17.9 MBytes   150 Mbits/sec  0.123 ms  0/2288 (0%)  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  0.046 ms  0/2289 (0%)  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  0.046 ms  0/2289 (0%)  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  0.070 ms  0/2288 (0%)  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  0.115 ms  0/2289 (0%)  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  0.124 ms  0/2289 (0%)  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  0.090 ms  0/2289 (0%)  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  0.065 ms  0/2289 (0%)  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  0.049 ms  0/2289 (0%)  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  0.103 ms  0/2288 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.103 ms  0/22887 (0%)  
[  4] Sent 22887 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 35527 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  59.4 MBytes   498 Mbits/sec  7598  
[  4]   1.00-2.00   sec  58.3 MBytes   489 Mbits/sec  7457  
[  4]   2.00-3.00   sec  59.6 MBytes   500 Mbits/sec  7630  
[  4]   3.00-4.00   sec  60.2 MBytes   505 Mbits/sec  7707  
[  4]   4.00-5.00   sec  56.8 MBytes   476 Mbits/sec  7267  
[  4]   5.00-6.00   sec  58.0 MBytes   487 Mbits/sec  7423  
[  4]   6.00-7.00   sec  61.6 MBytes   517 Mbits/sec  7890  
[  4]   7.00-8.00   sec  59.8 MBytes   502 Mbits/sec  7660  
[  4]   8.00-9.00   sec  57.6 MBytes   483 Mbits/sec  7377  
[  4]   9.00-10.00  sec  62.5 MBytes   524 Mbits/sec  7997  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   594 MBytes   498 Mbits/sec  0.585 ms  64644/64919 (1e+02%)  
[  4] Sent 64919 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 44608 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  21.4 MBytes   180 Mbits/sec  0.115 ms  0/2745 (0%)  
[  4]   1.00-2.00   sec  21.3 MBytes   179 Mbits/sec  0.070 ms  0/2729 (0%)  
[  4]   2.00-3.00   sec  21.4 MBytes   179 Mbits/sec  0.043 ms  0/2735 (0%)  
[  4]   3.00-4.00   sec  21.4 MBytes   179 Mbits/sec  0.066 ms  0/2735 (0%)  
[  4]   4.00-5.00   sec  21.4 MBytes   180 Mbits/sec  0.092 ms  0/2740 (0%)  
[  4]   5.00-6.00   sec  21.4 MBytes   180 Mbits/sec  0.060 ms  0/2742 (0%)  
[  4]   6.00-7.00   sec  21.4 MBytes   179 Mbits/sec  0.046 ms  0/2733 (0%)  
[  4]   7.00-8.00   sec  21.7 MBytes   182 Mbits/sec  0.073 ms  0/2782 (0%)  
[  4]   8.00-9.00   sec  21.7 MBytes   182 Mbits/sec  0.064 ms  0/2782 (0%)  
[  4]   9.00-10.00  sec  21.8 MBytes   183 Mbits/sec  0.103 ms  0/2787 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   215 MBytes   180 Mbits/sec  0.094 ms  0/27512 (0%)  
[  4] Sent 27512 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60591 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  99.3 MBytes   833 Mbits/sec  12708  
[  4]   1.00-2.00   sec   103 MBytes   861 Mbits/sec  13134  
[  4]   2.00-3.00   sec   103 MBytes   865 Mbits/sec  13203  
[  4]   3.00-4.00   sec   103 MBytes   868 Mbits/sec  13243  
[  4]   4.00-5.00   sec   103 MBytes   864 Mbits/sec  13178  
[  4]   5.00-6.00   sec   103 MBytes   863 Mbits/sec  13169  
[  4]   6.00-7.00   sec   102 MBytes   854 Mbits/sec  13034  
[  4]   7.00-8.00   sec  99.3 MBytes   833 Mbits/sec  12707  
[  4]   8.00-9.00   sec   100 MBytes   842 Mbits/sec  12848  
[  4]   9.00-10.00  sec   103 MBytes   862 Mbits/sec  13160  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1019 MBytes   854 Mbits/sec  5.860 ms  66222/66448 (1e+02%)  
[  4] Sent 66448 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 53976 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  20.9 MBytes   176 Mbits/sec  0.033 ms  0/2679 (0%)  
[  4]   1.00-2.00   sec  21.0 MBytes   176 Mbits/sec  0.070 ms  0/2690 (0%)  
[  4]   2.00-3.00   sec  21.4 MBytes   180 Mbits/sec  0.120 ms  0/2744 (0%)  
[  4]   3.00-4.00   sec  21.4 MBytes   180 Mbits/sec  0.060 ms  0/2745 (0%)  
[  4]   4.00-5.00   sec  21.5 MBytes   180 Mbits/sec  0.090 ms  0/2747 (0%)  
[  4]   5.00-6.00   sec  21.4 MBytes   180 Mbits/sec  0.089 ms  0/2743 (0%)  
[  4]   6.00-7.00   sec  21.4 MBytes   180 Mbits/sec  0.087 ms  0/2744 (0%)  
[  4]   7.00-8.00   sec  21.4 MBytes   180 Mbits/sec  0.089 ms  0/2740 (0%)  
[  4]   8.00-9.00   sec  21.4 MBytes   180 Mbits/sec  0.065 ms  0/2742 (0%)  
[  4]   9.00-10.00  sec  21.4 MBytes   180 Mbits/sec  0.077 ms  0/2745 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   213 MBytes   179 Mbits/sec  0.083 ms  0/27321 (0%)  
[  4] Sent 27321 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 58616 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 58618 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 58620 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  19.8 MBytes   166 Mbits/sec  137   22.6 KBytes       
[  6]   0.00-1.00   sec  7.10 MBytes  59.5 Mbits/sec  177   35.4 KBytes       
[  9]   0.00-1.00   sec  7.72 MBytes  64.8 Mbits/sec  117   67.9 KBytes       
[SUM]   0.00-1.00   sec  34.6 MBytes   290 Mbits/sec  431             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  8.26 MBytes  69.3 Mbits/sec  112   21.2 KBytes       
[  6]   1.00-2.00   sec  6.90 MBytes  57.9 Mbits/sec  151   35.4 KBytes       
[  9]   1.00-2.00   sec  17.5 MBytes   146 Mbits/sec   93   17.0 KBytes       
[SUM]   1.00-2.00   sec  32.6 MBytes   274 Mbits/sec  356             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  10.2 MBytes  85.5 Mbits/sec  110   9.90 KBytes       
[  6]   2.00-3.00   sec  9.01 MBytes  75.6 Mbits/sec  139   49.5 KBytes       
[  9]   2.00-3.00   sec  13.3 MBytes   112 Mbits/sec  105   36.8 KBytes       
[SUM]   2.00-3.00   sec  32.5 MBytes   273 Mbits/sec  354             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  10.3 MBytes  86.0 Mbits/sec   87   59.4 KBytes       
[  6]   3.00-4.00   sec  12.4 MBytes   104 Mbits/sec  107   43.8 KBytes       
[  9]   3.00-4.00   sec  9.94 MBytes  83.4 Mbits/sec  130   4.24 KBytes       
[SUM]   3.00-4.00   sec  32.6 MBytes   273 Mbits/sec  324             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  21.8 MBytes   183 Mbits/sec   79   99.0 KBytes       
[  6]   4.00-5.00   sec  6.09 MBytes  51.1 Mbits/sec  171   22.6 KBytes       
[  9]   4.00-5.00   sec  5.90 MBytes  49.5 Mbits/sec  150   21.2 KBytes       
[SUM]   4.00-5.00   sec  33.8 MBytes   284 Mbits/sec  400             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  10.6 MBytes  88.6 Mbits/sec  126   14.1 KBytes       
[  6]   5.00-6.00   sec  9.07 MBytes  76.1 Mbits/sec  117   12.7 KBytes       
[  9]   5.00-6.00   sec  12.2 MBytes   102 Mbits/sec  119   77.8 KBytes       
[SUM]   5.00-6.00   sec  31.8 MBytes   267 Mbits/sec  362             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  7.02 MBytes  58.9 Mbits/sec  150   32.5 KBytes       
[  6]   6.00-7.00   sec  16.5 MBytes   138 Mbits/sec  123   46.7 KBytes       
[  9]   6.00-7.00   sec  9.76 MBytes  81.9 Mbits/sec  126   31.1 KBytes       
[SUM]   6.00-7.00   sec  33.2 MBytes   279 Mbits/sec  399             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  15.2 MBytes   128 Mbits/sec  112   43.8 KBytes       
[  6]   7.00-8.00   sec  9.07 MBytes  76.1 Mbits/sec  109   15.6 KBytes       
[  9]   7.00-8.00   sec  7.21 MBytes  60.5 Mbits/sec  138   5.66 KBytes       
[SUM]   7.00-8.00   sec  31.5 MBytes   264 Mbits/sec  359             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  11.7 MBytes  98.5 Mbits/sec  141   25.5 KBytes       
[  6]   8.00-9.00   sec  12.9 MBytes   108 Mbits/sec  109   22.6 KBytes       
[  9]   8.00-9.00   sec  7.58 MBytes  63.6 Mbits/sec  105   38.2 KBytes       
[SUM]   8.00-9.00   sec  32.3 MBytes   271 Mbits/sec  355             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  9.51 MBytes  79.8 Mbits/sec  132   22.6 KBytes       
[  6]   9.00-10.00  sec  7.77 MBytes  65.2 Mbits/sec  157   17.0 KBytes       
[  9]   9.00-10.00  sec  14.1 MBytes   118 Mbits/sec   80   72.1 KBytes       
[SUM]   9.00-10.00  sec  31.4 MBytes   263 Mbits/sec  369             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   124 MBytes   104 Mbits/sec  1186             sender
[  4]   0.00-10.00  sec   124 MBytes   104 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  96.8 MBytes  81.2 Mbits/sec  1360             sender
[  6]   0.00-10.00  sec  96.2 MBytes  80.7 Mbits/sec                  receiver
[  9]   0.00-10.00  sec   105 MBytes  88.2 Mbits/sec  1163             sender
[  9]   0.00-10.00  sec   105 MBytes  87.7 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   326 MBytes   274 Mbits/sec  3709             sender
[SUM]   0.00-10.00  sec   324 MBytes   272 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 58660 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 58662 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 58664 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.88 MBytes  32.5 Mbits/sec                  
[  6]   0.00-1.00   sec  3.88 MBytes  32.5 Mbits/sec                  
[  9]   0.00-1.00   sec  2.54 MBytes  21.3 Mbits/sec                  
[SUM]   0.00-1.00   sec  10.3 MBytes  86.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.88 MBytes  32.5 Mbits/sec                  
[  6]   1.00-2.00   sec  3.88 MBytes  32.5 Mbits/sec                  
[  9]   1.00-2.00   sec  3.96 MBytes  33.2 Mbits/sec                  
[SUM]   1.00-2.00   sec  11.7 MBytes  98.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  4.75 MBytes  39.8 Mbits/sec                  
[  6]   2.00-3.00   sec  4.75 MBytes  39.8 Mbits/sec                  
[  9]   2.00-3.00   sec  4.66 MBytes  39.1 Mbits/sec                  
[SUM]   2.00-3.00   sec  14.2 MBytes   119 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  4.72 MBytes  39.6 Mbits/sec                  
[  6]   3.00-4.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  9]   3.00-4.00   sec  4.72 MBytes  39.6 Mbits/sec                  
[SUM]   3.00-4.00   sec  14.1 MBytes   118 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  4.66 MBytes  39.1 Mbits/sec                  
[  6]   4.00-5.00   sec  4.75 MBytes  39.8 Mbits/sec                  
[  9]   4.00-5.00   sec  4.63 MBytes  38.9 Mbits/sec                  
[SUM]   4.00-5.00   sec  14.0 MBytes   118 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  4.65 MBytes  39.0 Mbits/sec                  
[  6]   5.00-6.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  9]   5.00-6.00   sec  4.74 MBytes  39.8 Mbits/sec                  
[SUM]   5.00-6.00   sec  14.0 MBytes   118 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  4.73 MBytes  39.6 Mbits/sec                  
[  6]   6.00-7.00   sec  4.65 MBytes  39.0 Mbits/sec                  
[  9]   6.00-7.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[SUM]   6.00-7.00   sec  14.0 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  6]   7.00-8.00   sec  4.72 MBytes  39.6 Mbits/sec                  
[  9]   7.00-8.00   sec  4.65 MBytes  39.0 Mbits/sec                  
[SUM]   7.00-8.00   sec  14.0 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  4.74 MBytes  39.7 Mbits/sec                  
[  6]   8.00-9.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  9]   8.00-9.00   sec  4.73 MBytes  39.7 Mbits/sec                  
[SUM]   8.00-9.00   sec  14.1 MBytes   118 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  6.26 MBytes  52.5 Mbits/sec                  
[  6]   9.00-10.00  sec  6.67 MBytes  55.9 Mbits/sec                  
[  9]   9.00-10.00  sec  6.28 MBytes  52.7 Mbits/sec                  
[SUM]   9.00-10.00  sec  19.2 MBytes   161 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  47.2 MBytes  39.6 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  47.2 MBytes  39.6 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  47.6 MBytes  39.9 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  47.6 MBytes  39.9 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  45.7 MBytes  38.3 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  45.7 MBytes  38.3 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   140 MBytes   118 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   140 MBytes   118 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 34650 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 33110 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 42782 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  35.9 MBytes   301 Mbits/sec  4600  
[  6]   0.00-1.00   sec  35.9 MBytes   301 Mbits/sec  4600  
[  9]   0.00-1.00   sec  35.9 MBytes   301 Mbits/sec  4600  
[SUM]   0.00-1.00   sec   108 MBytes   904 Mbits/sec  13800  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.3 MBytes   313 Mbits/sec  4770  
[  6]   1.00-2.00   sec  37.3 MBytes   313 Mbits/sec  4770  
[  9]   1.00-2.00   sec  37.3 MBytes   313 Mbits/sec  4770  
[SUM]   1.00-2.00   sec   112 MBytes   938 Mbits/sec  14310  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.3 MBytes   313 Mbits/sec  4769  
[  6]   2.00-3.00   sec  37.3 MBytes   313 Mbits/sec  4769  
[  9]   2.00-3.00   sec  37.3 MBytes   313 Mbits/sec  4769  
[SUM]   2.00-3.00   sec   112 MBytes   938 Mbits/sec  14307  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  36.4 MBytes   306 Mbits/sec  4664  
[  6]   3.00-4.00   sec  36.4 MBytes   306 Mbits/sec  4664  
[  9]   3.00-4.00   sec  36.4 MBytes   306 Mbits/sec  4664  
[SUM]   3.00-4.00   sec   109 MBytes   917 Mbits/sec  13992  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  36.3 MBytes   305 Mbits/sec  4651  
[  6]   4.00-5.00   sec  36.3 MBytes   305 Mbits/sec  4651  
[  9]   4.00-5.00   sec  36.3 MBytes   305 Mbits/sec  4651  
[SUM]   4.00-5.00   sec   109 MBytes   914 Mbits/sec  13953  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  6]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  9]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[SUM]   5.00-6.00   sec   113 MBytes   944 Mbits/sec  14403  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.6 MBytes   315 Mbits/sec  4807  
[  6]   6.00-7.00   sec  37.6 MBytes   315 Mbits/sec  4807  
[  9]   6.00-7.00   sec  37.6 MBytes   315 Mbits/sec  4807  
[SUM]   6.00-7.00   sec   113 MBytes   945 Mbits/sec  14421  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  6]   7.00-8.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  9]   7.00-8.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[SUM]   7.00-8.00   sec   112 MBytes   943 Mbits/sec  14382  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  36.8 MBytes   309 Mbits/sec  4713  
[  6]   8.00-9.00   sec  36.8 MBytes   309 Mbits/sec  4713  
[  9]   8.00-9.00   sec  36.8 MBytes   309 Mbits/sec  4713  
[SUM]   8.00-9.00   sec   110 MBytes   927 Mbits/sec  14139  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.3 MBytes   313 Mbits/sec  4776  
[  6]   9.00-10.00  sec  37.3 MBytes   313 Mbits/sec  4776  
[  9]   9.00-10.00  sec  37.3 MBytes   313 Mbits/sec  4776  
[SUM]   9.00-10.00  sec   112 MBytes   939 Mbits/sec  14328  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   370 MBytes   310 Mbits/sec  6268.805 ms  43911/44027 (1e+02%)  
[  4] Sent 44027 datagrams
[  6]   0.00-10.00  sec   370 MBytes   310 Mbits/sec  10504.518 ms  43905/44013 (1e+02%)  
[  6] Sent 44013 datagrams
[  9]   0.00-10.00  sec   370 MBytes   310 Mbits/sec  29500.167 ms  43888/43980 (1e+02%)  
[  9] Sent 43980 datagrams
[SUM]   0.00-10.00  sec  1.08 GBytes   931 Mbits/sec  15424.497 ms  131704/132020 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 53205 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 43466 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60853 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  7.60 MBytes  63.8 Mbits/sec  0.063 ms  0/973 (0%)  
[  6]   0.00-1.00   sec  7.60 MBytes  63.8 Mbits/sec  0.079 ms  0/973 (0%)  
[  9]   0.00-1.00   sec  7.59 MBytes  63.6 Mbits/sec  0.080 ms  0/971 (0%)  
[SUM]   0.00-1.00   sec  22.8 MBytes   191 Mbits/sec  0.074 ms  0/2917 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.41 MBytes  62.1 Mbits/sec  0.056 ms  0/948 (0%)  
[  6]   1.00-2.00   sec  7.41 MBytes  62.1 Mbits/sec  0.071 ms  0/948 (0%)  
[  9]   1.00-2.00   sec  7.41 MBytes  62.2 Mbits/sec  0.093 ms  0/949 (0%)  
[SUM]   1.00-2.00   sec  22.2 MBytes   186 Mbits/sec  0.074 ms  0/2845 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.33 MBytes  61.5 Mbits/sec  0.038 ms  0/938 (0%)  
[  6]   2.00-3.00   sec  7.33 MBytes  61.5 Mbits/sec  0.063 ms  0/938 (0%)  
[  9]   2.00-3.00   sec  7.33 MBytes  61.5 Mbits/sec  0.104 ms  0/938 (0%)  
[SUM]   2.00-3.00   sec  22.0 MBytes   184 Mbits/sec  0.069 ms  0/2814 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  7.46 MBytes  62.6 Mbits/sec  0.070 ms  0/955 (0%)  
[  6]   3.00-4.00   sec  7.46 MBytes  62.6 Mbits/sec  0.063 ms  0/955 (0%)  
[  9]   3.00-4.00   sec  7.45 MBytes  62.5 Mbits/sec  0.102 ms  0/954 (0%)  
[SUM]   3.00-4.00   sec  22.4 MBytes   188 Mbits/sec  0.078 ms  0/2864 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  7.45 MBytes  62.5 Mbits/sec  0.070 ms  0/953 (0%)  
[  6]   4.00-5.00   sec  7.45 MBytes  62.5 Mbits/sec  0.083 ms  0/953 (0%)  
[  9]   4.00-5.00   sec  7.45 MBytes  62.5 Mbits/sec  0.129 ms  0/954 (0%)  
[SUM]   4.00-5.00   sec  22.3 MBytes   187 Mbits/sec  0.094 ms  0/2860 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  7.48 MBytes  62.8 Mbits/sec  0.030 ms  0/958 (0%)  
[  6]   5.00-6.00   sec  7.48 MBytes  62.8 Mbits/sec  0.062 ms  0/958 (0%)  
[  9]   5.00-6.00   sec  7.48 MBytes  62.7 Mbits/sec  0.112 ms  0/957 (0%)  
[SUM]   5.00-6.00   sec  22.4 MBytes   188 Mbits/sec  0.068 ms  0/2873 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  7.54 MBytes  63.2 Mbits/sec  0.033 ms  0/965 (0%)  
[  6]   6.00-7.00   sec  7.54 MBytes  63.2 Mbits/sec  0.086 ms  0/965 (0%)  
[  9]   6.00-7.00   sec  7.55 MBytes  63.3 Mbits/sec  0.130 ms  0/966 (0%)  
[SUM]   6.00-7.00   sec  22.6 MBytes   190 Mbits/sec  0.083 ms  0/2896 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  7.64 MBytes  64.1 Mbits/sec  0.043 ms  0/978 (0%)  
[  6]   7.00-8.00   sec  7.64 MBytes  64.1 Mbits/sec  0.112 ms  0/978 (0%)  
[  9]   7.00-8.00   sec  7.63 MBytes  64.0 Mbits/sec  0.082 ms  0/977 (0%)  
[SUM]   7.00-8.00   sec  22.9 MBytes   192 Mbits/sec  0.079 ms  0/2933 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  7.53 MBytes  63.2 Mbits/sec  0.054 ms  0/964 (0%)  
[  6]   8.00-9.00   sec  7.53 MBytes  63.2 Mbits/sec  0.075 ms  0/964 (0%)  
[  9]   8.00-9.00   sec  7.54 MBytes  63.2 Mbits/sec  0.116 ms  0/965 (0%)  
[SUM]   8.00-9.00   sec  22.6 MBytes   190 Mbits/sec  0.081 ms  0/2893 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  7.43 MBytes  62.3 Mbits/sec  0.058 ms  0/951 (0%)  
[  6]   9.00-10.00  sec  7.43 MBytes  62.3 Mbits/sec  0.043 ms  0/951 (0%)  
[  9]   9.00-10.00  sec  7.43 MBytes  62.3 Mbits/sec  0.074 ms  0/951 (0%)  
[SUM]   9.00-10.00  sec  22.3 MBytes   187 Mbits/sec  0.058 ms  0/2853 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  74.9 MBytes  62.8 Mbits/sec  0.056 ms  0/9584 (0%)  
[  4] Sent 9584 datagrams
[  6]   0.00-10.00  sec  74.9 MBytes  62.8 Mbits/sec  0.052 ms  0/9584 (0%)  
[  6] Sent 9584 datagrams
[  9]   0.00-10.00  sec  74.9 MBytes  62.8 Mbits/sec  0.073 ms  0/9583 (0%)  
[  9] Sent 9583 datagrams
[SUM]   0.00-10.00  sec   225 MBytes   188 Mbits/sec  0.061 ms  0/28751 (0%)  

iperf Done.
+ : ':::::::[' configuration backported ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60042 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  30.1 MBytes   252 Mbits/sec   64    122 KBytes       
[  4]   1.00-2.00   sec  32.1 MBytes   269 Mbits/sec  101    100 KBytes       
[  4]   2.00-3.00   sec  32.3 MBytes   271 Mbits/sec  102   89.1 KBytes       
[  4]   3.00-4.00   sec  32.2 MBytes   270 Mbits/sec   68    113 KBytes       
[  4]   4.00-5.00   sec  32.1 MBytes   270 Mbits/sec   95   73.5 KBytes       
[  4]   5.00-6.00   sec  32.1 MBytes   269 Mbits/sec   42    116 KBytes       
[  4]   6.00-7.00   sec  31.8 MBytes   266 Mbits/sec   74   99.0 KBytes       
[  4]   7.00-8.00   sec  31.9 MBytes   268 Mbits/sec   67    132 KBytes       
[  4]   8.00-9.00   sec  31.3 MBytes   262 Mbits/sec   87   82.0 KBytes       
[  4]   9.00-10.00  sec  31.4 MBytes   264 Mbits/sec   78    126 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   317 MBytes   266 Mbits/sec  778             sender
[  4]   0.00-10.00  sec   316 MBytes   265 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60046 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  11.7 MBytes  98.0 Mbits/sec                  
[  4]   1.00-2.00   sec  13.9 MBytes   117 Mbits/sec                  
[  4]   2.00-3.00   sec  13.7 MBytes   115 Mbits/sec                  
[  4]   3.00-4.00   sec  14.0 MBytes   117 Mbits/sec                  
[  4]   4.00-5.00   sec  13.9 MBytes   117 Mbits/sec                  
[  4]   5.00-6.00   sec  14.0 MBytes   117 Mbits/sec                  
[  4]   6.00-7.00   sec  13.9 MBytes   116 Mbits/sec                  
[  4]   7.00-8.00   sec  13.9 MBytes   116 Mbits/sec                  
[  4]   8.00-9.00   sec  13.9 MBytes   116 Mbits/sec                  
[  4]   9.00-10.00  sec  14.0 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   138 MBytes   116 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   138 MBytes   116 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 38500 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   137 Mbits/sec  2096  
[  4]   1.00-2.00   sec  18.0 MBytes   151 Mbits/sec  2304  
[  4]   2.00-3.00   sec  17.8 MBytes   149 Mbits/sec  2278  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2295  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2294  
[  4]   6.00-7.00   sec  18.0 MBytes   151 Mbits/sec  2304  
[  4]   7.00-8.00   sec  17.7 MBytes   148 Mbits/sec  2260  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2294  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2293  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  64.491 ms  852/1039 (82%)  
[  4] Sent 1039 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 39969 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  17.9 MBytes   150 Mbits/sec  0.064 ms  0/2287 (0%)  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  0.038 ms  0/2289 (0%)  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  0.064 ms  0/2289 (0%)  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  0.065 ms  0/2289 (0%)  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  0.043 ms  0/2288 (0%)  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  0.039 ms  0/2289 (0%)  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  0.034 ms  0/2289 (0%)  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  0.057 ms  0/2289 (0%)  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  0.132 ms  0/2289 (0%)  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  0.148 ms  0/2289 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.141 ms  0/22888 (0%)  
[  4] Sent 22888 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 38768 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  56.0 MBytes   470 Mbits/sec  7174  
[  4]   1.00-2.00   sec  58.3 MBytes   489 Mbits/sec  7458  
[  4]   2.00-3.00   sec  59.8 MBytes   501 Mbits/sec  7649  
[  4]   3.00-4.00   sec  59.2 MBytes   497 Mbits/sec  7578  
[  4]   4.00-5.00   sec  59.0 MBytes   495 Mbits/sec  7554  
[  4]   5.00-6.00   sec  64.2 MBytes   539 Mbits/sec  8218  
[  4]   6.00-7.00   sec  60.5 MBytes   507 Mbits/sec  7740  
[  4]   7.00-8.00   sec  57.6 MBytes   483 Mbits/sec  7375  
[  4]   8.00-9.00   sec  60.6 MBytes   508 Mbits/sec  7755  
[  4]   9.00-10.00  sec  55.5 MBytes   466 Mbits/sec  7110  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   591 MBytes   496 Mbits/sec  0.504 ms  64740/65050 (1e+02%)  
[  4] Sent 65050 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 44942 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  21.7 MBytes   182 Mbits/sec  0.093 ms  0/2775 (0%)  
[  4]   1.00-2.00   sec  21.6 MBytes   181 Mbits/sec  0.082 ms  0/2764 (0%)  
[  4]   2.00-3.00   sec  21.5 MBytes   181 Mbits/sec  0.084 ms  0/2758 (0%)  
[  4]   3.00-4.00   sec  21.6 MBytes   181 Mbits/sec  0.066 ms  0/2768 (0%)  
[  4]   4.00-5.00   sec  21.6 MBytes   181 Mbits/sec  0.066 ms  0/2769 (0%)  
[  4]   5.00-6.00   sec  21.6 MBytes   181 Mbits/sec  0.077 ms  0/2767 (0%)  
[  4]   6.00-7.00   sec  21.6 MBytes   181 Mbits/sec  0.059 ms  0/2767 (0%)  
[  4]   7.00-8.00   sec  21.6 MBytes   181 Mbits/sec  0.053 ms  0/2765 (0%)  
[  4]   8.00-9.00   sec  21.6 MBytes   181 Mbits/sec  0.112 ms  0/2760 (0%)  
[  4]   9.00-10.00  sec  21.6 MBytes   182 Mbits/sec  0.086 ms  0/2771 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   216 MBytes   181 Mbits/sec  0.081 ms  0/27665 (0%)  
[  4] Sent 27665 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 49947 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec   102 MBytes   855 Mbits/sec  13052  
[  4]   1.00-2.00   sec   103 MBytes   863 Mbits/sec  13176  
[  4]   2.00-3.00   sec   103 MBytes   863 Mbits/sec  13170  
[  4]   3.00-4.00   sec   103 MBytes   862 Mbits/sec  13157  
[  4]   4.00-5.00   sec   103 MBytes   862 Mbits/sec  13150  
[  4]   5.00-6.00   sec   103 MBytes   861 Mbits/sec  13137  
[  4]   6.00-7.00   sec   103 MBytes   863 Mbits/sec  13172  
[  4]   7.00-8.00   sec   103 MBytes   864 Mbits/sec  13178  
[  4]   8.00-9.00   sec   103 MBytes   862 Mbits/sec  13157  
[  4]   9.00-10.00  sec   103 MBytes   862 Mbits/sec  13155  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.00 GBytes   862 Mbits/sec  0.366 ms  131125/131479 (1e+02%)  
[  4] Sent 131479 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 53316 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  21.7 MBytes   182 Mbits/sec  0.141 ms  0/2773 (0%)  
[  4]   1.00-2.00   sec  21.3 MBytes   179 Mbits/sec  0.088 ms  0/2730 (0%)  
[  4]   2.00-3.00   sec  21.3 MBytes   179 Mbits/sec  0.049 ms  0/2727 (0%)  
[  4]   3.00-4.00   sec  21.4 MBytes   179 Mbits/sec  0.074 ms  0/2738 (0%)  
[  4]   4.00-5.00   sec  21.4 MBytes   180 Mbits/sec  0.099 ms  0/2741 (0%)  
[  4]   5.00-6.00   sec  21.4 MBytes   180 Mbits/sec  0.074 ms  0/2743 (0%)  
[  4]   6.00-7.00   sec  21.4 MBytes   180 Mbits/sec  0.067 ms  0/2741 (0%)  
[  4]   7.00-8.00   sec  21.4 MBytes   179 Mbits/sec  0.076 ms  0/2738 (0%)  
[  4]   8.00-9.00   sec  21.4 MBytes   180 Mbits/sec  0.085 ms  0/2739 (0%)  
[  4]   9.00-10.00  sec  21.4 MBytes   180 Mbits/sec  0.058 ms  0/2742 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   214 MBytes   180 Mbits/sec  0.060 ms  0/27413 (0%)  
[  4] Sent 27413 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60090 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60092 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60094 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  10.4 MBytes  87.4 Mbits/sec  115   35.4 KBytes       
[  6]   0.00-1.00   sec  13.3 MBytes   112 Mbits/sec   85   63.6 KBytes       
[  9]   0.00-1.00   sec  9.56 MBytes  80.1 Mbits/sec  108   5.66 KBytes       
[SUM]   0.00-1.00   sec  33.3 MBytes   279 Mbits/sec  308             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  8.70 MBytes  73.0 Mbits/sec  128   46.7 KBytes       
[  6]   1.00-2.00   sec  12.6 MBytes   105 Mbits/sec  109    102 KBytes       
[  9]   1.00-2.00   sec  12.1 MBytes   101 Mbits/sec   73   11.3 KBytes       
[SUM]   1.00-2.00   sec  33.3 MBytes   279 Mbits/sec  310             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  9.01 MBytes  75.6 Mbits/sec  168   58.0 KBytes       
[  6]   2.00-3.00   sec  16.0 MBytes   134 Mbits/sec  149   25.5 KBytes       
[  9]   2.00-3.00   sec  7.52 MBytes  63.1 Mbits/sec  108   17.0 KBytes       
[SUM]   2.00-3.00   sec  32.6 MBytes   273 Mbits/sec  425             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  11.6 MBytes  96.9 Mbits/sec  120   39.6 KBytes       
[  6]   3.00-4.00   sec  9.26 MBytes  77.7 Mbits/sec  132   24.0 KBytes       
[  9]   3.00-4.00   sec  12.3 MBytes   103 Mbits/sec  153   17.0 KBytes       
[SUM]   3.00-4.00   sec  33.1 MBytes   278 Mbits/sec  405             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  9.32 MBytes  78.2 Mbits/sec  165   15.6 KBytes       
[  6]   4.00-5.00   sec  9.01 MBytes  75.6 Mbits/sec  142   7.07 KBytes       
[  9]   4.00-5.00   sec  13.3 MBytes   112 Mbits/sec   76   65.0 KBytes       
[SUM]   4.00-5.00   sec  31.6 MBytes   265 Mbits/sec  383             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  10.1 MBytes  84.4 Mbits/sec  123   45.2 KBytes       
[  6]   5.00-6.00   sec  9.57 MBytes  80.3 Mbits/sec  126   11.3 KBytes       
[  9]   5.00-6.00   sec  12.4 MBytes   104 Mbits/sec  108   19.8 KBytes       
[SUM]   5.00-6.00   sec  32.0 MBytes   268 Mbits/sec  357             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  10.4 MBytes  87.0 Mbits/sec  146   24.0 KBytes       
[  6]   6.00-7.00   sec  7.33 MBytes  61.5 Mbits/sec  119   45.2 KBytes       
[  9]   6.00-7.00   sec  14.2 MBytes   119 Mbits/sec   92   50.9 KBytes       
[SUM]   6.00-7.00   sec  31.9 MBytes   268 Mbits/sec  357             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  9.38 MBytes  78.8 Mbits/sec  128   21.2 KBytes       
[  6]   7.00-8.00   sec  10.5 MBytes  88.2 Mbits/sec  112   7.07 KBytes       
[  9]   7.00-8.00   sec  11.5 MBytes  96.5 Mbits/sec  103   56.6 KBytes       
[SUM]   7.00-8.00   sec  31.4 MBytes   263 Mbits/sec  343             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  9.13 MBytes  76.6 Mbits/sec  132   25.5 KBytes       
[  6]   8.00-9.00   sec  9.51 MBytes  79.8 Mbits/sec  108   45.2 KBytes       
[  9]   8.00-9.00   sec  13.0 MBytes   109 Mbits/sec   93   66.5 KBytes       
[SUM]   8.00-9.00   sec  31.6 MBytes   265 Mbits/sec  333             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  15.3 MBytes   129 Mbits/sec   94   19.8 KBytes       
[  6]   9.00-10.00  sec  10.4 MBytes  87.0 Mbits/sec  135   77.8 KBytes       
[  9]   9.00-10.00  sec  7.33 MBytes  61.5 Mbits/sec  156   9.90 KBytes       
[SUM]   9.00-10.00  sec  33.1 MBytes   277 Mbits/sec  385             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   103 MBytes  86.7 Mbits/sec  1319             sender
[  4]   0.00-10.00  sec   103 MBytes  86.1 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   107 MBytes  90.1 Mbits/sec  1217             sender
[  6]   0.00-10.00  sec   107 MBytes  89.6 Mbits/sec                  receiver
[  9]   0.00-10.00  sec   113 MBytes  94.9 Mbits/sec  1070             sender
[  9]   0.00-10.00  sec   113 MBytes  94.4 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   324 MBytes   272 Mbits/sec  3606             sender
[SUM]   0.00-10.00  sec   322 MBytes   270 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60114 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60116 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60118 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  5.07 MBytes  42.5 Mbits/sec                  
[  6]   0.00-1.00   sec  4.90 MBytes  41.1 Mbits/sec                  
[  9]   0.00-1.00   sec  3.74 MBytes  31.4 Mbits/sec                  
[SUM]   0.00-1.00   sec  13.7 MBytes   115 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  6]   1.00-2.00   sec  4.69 MBytes  39.4 Mbits/sec                  
[  9]   1.00-2.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[SUM]   1.00-2.00   sec  13.9 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  6]   2.00-3.00   sec  4.67 MBytes  39.2 Mbits/sec                  
[  9]   2.00-3.00   sec  4.63 MBytes  38.8 Mbits/sec                  
[SUM]   2.00-3.00   sec  13.9 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  4.64 MBytes  38.9 Mbits/sec                  
[  6]   3.00-4.00   sec  4.67 MBytes  39.2 Mbits/sec                  
[  9]   3.00-4.00   sec  4.79 MBytes  40.2 Mbits/sec                  
[SUM]   3.00-4.00   sec  14.1 MBytes   118 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  4.72 MBytes  39.6 Mbits/sec                  
[  6]   4.00-5.00   sec  4.63 MBytes  38.9 Mbits/sec                  
[  9]   4.00-5.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[SUM]   4.00-5.00   sec  14.0 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  6]   5.00-6.00   sec  4.74 MBytes  39.8 Mbits/sec                  
[  9]   5.00-6.00   sec  4.63 MBytes  38.9 Mbits/sec                  
[SUM]   5.00-6.00   sec  14.0 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  4.63 MBytes  38.9 Mbits/sec                  
[  6]   6.00-7.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  9]   6.00-7.00   sec  4.74 MBytes  39.8 Mbits/sec                  
[SUM]   6.00-7.00   sec  14.0 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  4.63 MBytes  38.9 Mbits/sec                  
[  6]   7.00-8.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  9]   7.00-8.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[SUM]   7.00-8.00   sec  13.9 MBytes   116 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  4.67 MBytes  39.2 Mbits/sec                  
[  6]   8.00-9.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[  9]   8.00-9.00   sec  4.62 MBytes  38.8 Mbits/sec                  
[SUM]   8.00-9.00   sec  13.9 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  4.03 MBytes  33.8 Mbits/sec                  
[  6]   9.00-10.00  sec  4.00 MBytes  33.5 Mbits/sec                  
[  9]   9.00-10.00  sec  4.00 MBytes  33.5 Mbits/sec                  
[SUM]   9.00-10.00  sec  12.0 MBytes   101 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  46.7 MBytes  39.2 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  46.7 MBytes  39.2 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  46.7 MBytes  39.1 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  46.7 MBytes  39.1 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  45.5 MBytes  38.2 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  45.5 MBytes  38.2 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   139 MBytes   116 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   139 MBytes   116 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 34530 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 48193 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 34271 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  37.1 MBytes   312 Mbits/sec  4754  
[  6]   0.00-1.00   sec  37.1 MBytes   312 Mbits/sec  4754  
[  9]   0.00-1.00   sec  37.1 MBytes   312 Mbits/sec  4754  
[SUM]   0.00-1.00   sec   111 MBytes   935 Mbits/sec  14262  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.4 MBytes   314 Mbits/sec  4789  
[  6]   1.00-2.00   sec  37.4 MBytes   314 Mbits/sec  4789  
[  9]   1.00-2.00   sec  37.4 MBytes   314 Mbits/sec  4789  
[SUM]   1.00-2.00   sec   112 MBytes   942 Mbits/sec  14367  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[  6]   2.00-3.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[  9]   2.00-3.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[SUM]   2.00-3.00   sec   112 MBytes   940 Mbits/sec  14349  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  37.3 MBytes   313 Mbits/sec  4777  
[  6]   3.00-4.00   sec  37.3 MBytes   313 Mbits/sec  4777  
[  9]   3.00-4.00   sec  37.3 MBytes   313 Mbits/sec  4777  
[SUM]   3.00-4.00   sec   112 MBytes   939 Mbits/sec  14331  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.2 MBytes   312 Mbits/sec  4768  
[  6]   4.00-5.00   sec  37.2 MBytes   312 Mbits/sec  4768  
[  9]   4.00-5.00   sec  37.2 MBytes   312 Mbits/sec  4768  
[SUM]   4.00-5.00   sec   112 MBytes   937 Mbits/sec  14304  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.3 MBytes   313 Mbits/sec  4774  
[  6]   5.00-6.00   sec  37.3 MBytes   313 Mbits/sec  4774  
[  9]   5.00-6.00   sec  37.3 MBytes   313 Mbits/sec  4774  
[SUM]   5.00-6.00   sec   112 MBytes   939 Mbits/sec  14322  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.3 MBytes   313 Mbits/sec  4774  
[  6]   6.00-7.00   sec  37.3 MBytes   313 Mbits/sec  4774  
[  9]   6.00-7.00   sec  37.3 MBytes   313 Mbits/sec  4774  
[SUM]   6.00-7.00   sec   112 MBytes   939 Mbits/sec  14322  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.3 MBytes   313 Mbits/sec  4776  
[  6]   7.00-8.00   sec  37.3 MBytes   313 Mbits/sec  4776  
[  9]   7.00-8.00   sec  37.3 MBytes   313 Mbits/sec  4776  
[SUM]   7.00-8.00   sec   112 MBytes   939 Mbits/sec  14328  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.2 MBytes   312 Mbits/sec  4762  
[  6]   8.00-9.00   sec  37.2 MBytes   312 Mbits/sec  4762  
[  9]   8.00-9.00   sec  37.2 MBytes   312 Mbits/sec  4762  
[SUM]   8.00-9.00   sec   112 MBytes   936 Mbits/sec  14286  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.3 MBytes   313 Mbits/sec  4769  
[  6]   9.00-10.00  sec  37.3 MBytes   313 Mbits/sec  4769  
[  9]   9.00-10.00  sec  37.3 MBytes   313 Mbits/sec  4769  
[SUM]   9.00-10.00  sec   112 MBytes   938 Mbits/sec  14307  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  20028.983 ms  43944/44042 (1e+02%)  
[  4] Sent 44042 datagrams
[  6]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  11952.071 ms  43933/44039 (1e+02%)  
[  6] Sent 44039 datagrams
[  9]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  9232.969 ms  43931/44041 (1e+02%)  
[  9] Sent 44041 datagrams
[SUM]   0.00-10.00  sec  1.09 GBytes   938 Mbits/sec  13738.008 ms  131808/132122 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 44496 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 54951 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 58397 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  7.46 MBytes  62.5 Mbits/sec  0.046 ms  0/955 (0%)  
[  6]   0.00-1.00   sec  7.46 MBytes  62.5 Mbits/sec  0.100 ms  0/955 (0%)  
[  9]   0.00-1.00   sec  7.46 MBytes  62.5 Mbits/sec  0.178 ms  0/955 (0%)  
[SUM]   0.00-1.00   sec  22.4 MBytes   188 Mbits/sec  0.108 ms  0/2865 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.47 MBytes  62.7 Mbits/sec  0.048 ms  0/956 (0%)  
[  6]   1.00-2.00   sec  7.47 MBytes  62.7 Mbits/sec  0.106 ms  0/956 (0%)  
[  9]   1.00-2.00   sec  7.46 MBytes  62.7 Mbits/sec  0.108 ms  0/955 (0%)  
[SUM]   1.00-2.00   sec  22.4 MBytes   188 Mbits/sec  0.088 ms  0/2867 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.48 MBytes  62.8 Mbits/sec  0.051 ms  0/958 (0%)  
[  6]   2.00-3.00   sec  7.48 MBytes  62.7 Mbits/sec  0.100 ms  0/957 (0%)  
[  9]   2.00-3.00   sec  7.48 MBytes  62.8 Mbits/sec  0.082 ms  0/958 (0%)  
[SUM]   2.00-3.00   sec  22.4 MBytes   188 Mbits/sec  0.078 ms  0/2873 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  7.48 MBytes  62.8 Mbits/sec  0.048 ms  0/958 (0%)  
[  6]   3.00-4.00   sec  7.49 MBytes  62.8 Mbits/sec  0.073 ms  0/959 (0%)  
[  9]   3.00-4.00   sec  7.48 MBytes  62.8 Mbits/sec  0.109 ms  0/958 (0%)  
[SUM]   3.00-4.00   sec  22.5 MBytes   188 Mbits/sec  0.077 ms  0/2875 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  7.55 MBytes  63.3 Mbits/sec  0.061 ms  0/966 (0%)  
[  6]   4.00-5.00   sec  7.55 MBytes  63.3 Mbits/sec  0.054 ms  0/966 (0%)  
[  9]   4.00-5.00   sec  7.55 MBytes  63.4 Mbits/sec  0.108 ms  0/967 (0%)  
[SUM]   4.00-5.00   sec  22.6 MBytes   190 Mbits/sec  0.074 ms  0/2899 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  7.57 MBytes  63.5 Mbits/sec  0.078 ms  0/969 (0%)  
[  6]   5.00-6.00   sec  7.57 MBytes  63.5 Mbits/sec  0.127 ms  0/969 (0%)  
[  9]   5.00-6.00   sec  7.56 MBytes  63.4 Mbits/sec  0.094 ms  0/968 (0%)  
[SUM]   5.00-6.00   sec  22.7 MBytes   190 Mbits/sec  0.100 ms  0/2906 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  7.59 MBytes  63.6 Mbits/sec  0.053 ms  0/971 (0%)  
[  6]   6.00-7.00   sec  7.59 MBytes  63.6 Mbits/sec  0.053 ms  0/971 (0%)  
[  9]   6.00-7.00   sec  7.59 MBytes  63.6 Mbits/sec  0.102 ms  0/971 (0%)  
[SUM]   6.00-7.00   sec  22.8 MBytes   191 Mbits/sec  0.069 ms  0/2913 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  7.61 MBytes  63.8 Mbits/sec  0.123 ms  0/974 (0%)  
[  6]   7.00-8.00   sec  7.61 MBytes  63.8 Mbits/sec  0.147 ms  0/974 (0%)  
[  9]   7.00-8.00   sec  7.62 MBytes  63.8 Mbits/sec  0.121 ms  0/975 (0%)  
[SUM]   7.00-8.00   sec  22.8 MBytes   191 Mbits/sec  0.130 ms  0/2923 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  7.48 MBytes  62.9 Mbits/sec  0.023 ms  0/958 (0%)  
[  6]   8.00-9.00   sec  7.48 MBytes  62.9 Mbits/sec  0.061 ms  0/958 (0%)  
[  9]   8.00-9.00   sec  7.48 MBytes  62.8 Mbits/sec  0.073 ms  0/957 (0%)  
[SUM]   8.00-9.00   sec  22.4 MBytes   189 Mbits/sec  0.052 ms  0/2873 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  7.52 MBytes  63.0 Mbits/sec  0.028 ms  0/962 (0%)  
[  6]   9.00-10.00  sec  7.52 MBytes  63.0 Mbits/sec  0.106 ms  0/962 (0%)  
[  9]   9.00-10.00  sec  7.52 MBytes  63.1 Mbits/sec  0.085 ms  0/963 (0%)  
[SUM]   9.00-10.00  sec  22.6 MBytes   189 Mbits/sec  0.073 ms  0/2887 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  75.2 MBytes  63.1 Mbits/sec  0.044 ms  0/9628 (0%)  
[  4] Sent 9628 datagrams
[  6]   0.00-10.00  sec  75.2 MBytes  63.1 Mbits/sec  0.120 ms  0/9628 (0%)  
[  6] Sent 9628 datagrams
[  9]   0.00-10.00  sec  75.2 MBytes  63.1 Mbits/sec  0.089 ms  0/9628 (0%)  
[  9] Sent 9628 datagrams
[SUM]   0.00-10.00  sec   226 MBytes   189 Mbits/sec  0.085 ms  0/28884 (0%)  

iperf Done.
UDP lantiq->host
@host:		# nc -u -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc -u 10.0.0.1 4321
464MiB 0:00:27 [  20MiB/s]

TCP lantiq->host
@host:		# nc -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc 10.0.0.1 4321
104MiB 0:00:17 [6,89MiB/s] or 130MiB 0:00:20 [8,72MiB/s]

UDP host->lantiq
@lantiq:	# nc -u -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc -u 10.0.0.80 4321
2,16GiB 0:00:25 [91,4MiB/s] or 2,33GiB 0:00:27 [82,4MiB/s]

TCP host->lantiq
@lantiq:	# nc -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc 10.0.0.80 4321
878MiB 0:00:33 [23,9MiB/s] or 1,1GiB 0:00:41 [30,8MiB/s]
+ : ':::::::[' configuration dma_burst ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 51328 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  26.8 MBytes   225 Mbits/sec   53   46.7 KBytes       
[  4]   1.00-2.00   sec  29.2 MBytes   245 Mbits/sec   64   55.1 KBytes       
[  4]   2.00-3.00   sec  29.3 MBytes   246 Mbits/sec   56   73.5 KBytes       
[  4]   3.00-4.00   sec  29.3 MBytes   246 Mbits/sec   59   80.6 KBytes       
[  4]   4.00-5.00   sec  29.1 MBytes   245 Mbits/sec   38   79.2 KBytes       
[  4]   5.00-6.00   sec  29.2 MBytes   245 Mbits/sec   40   49.5 KBytes       
[  4]   6.00-7.00   sec  29.4 MBytes   247 Mbits/sec   45   56.6 KBytes       
[  4]   7.00-8.00   sec  29.5 MBytes   247 Mbits/sec   34   69.3 KBytes       
[  4]   8.00-9.00   sec  29.3 MBytes   246 Mbits/sec   39   72.1 KBytes       
[  4]   9.00-10.00  sec  29.1 MBytes   244 Mbits/sec   46   56.6 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   290 MBytes   243 Mbits/sec  474             sender
[  4]   0.00-10.00  sec   290 MBytes   243 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 51336 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  9.33 MBytes  78.3 Mbits/sec                  
[  4]   1.00-2.00   sec  9.44 MBytes  79.2 Mbits/sec                  
[  4]   2.00-3.00   sec  9.46 MBytes  79.3 Mbits/sec                  
[  4]   3.00-4.00   sec  9.35 MBytes  78.5 Mbits/sec                  
[  4]   4.00-5.00   sec  9.74 MBytes  81.7 Mbits/sec                  
[  4]   5.00-6.00   sec  9.65 MBytes  81.0 Mbits/sec                  
[  4]   6.00-7.00   sec  9.65 MBytes  80.9 Mbits/sec                  
[  4]   7.00-8.00   sec  9.61 MBytes  80.6 Mbits/sec                  
[  4]   8.00-9.00   sec  9.62 MBytes  80.7 Mbits/sec                  
[  4]   9.00-10.00  sec  9.75 MBytes  81.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  96.3 MBytes  80.8 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  96.3 MBytes  80.8 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 37966 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   138 Mbits/sec  2101  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2293  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2285  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2286  
[  4]   8.00-9.00   sec  17.9 MBytes   151 Mbits/sec  2297  
[  4]   9.00-10.00  sec  17.8 MBytes   149 Mbits/sec  2280  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  14022.161 ms  874/977 (89%)  
[  4] Sent 977 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 36365 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  17.9 MBytes   150 Mbits/sec  0.114 ms  0/2287 (0%)  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  0.105 ms  0/2289 (0%)  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  0.109 ms  0/2289 (0%)  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  0.127 ms  0/2289 (0%)  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  0.102 ms  0/2289 (0%)  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  0.106 ms  0/2287 (0%)  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  0.097 ms  0/2289 (0%)  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  0.093 ms  0/2290 (0%)  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  0.108 ms  0/2289 (0%)  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  0.084 ms  0/2289 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.084 ms  0/22887 (0%)  
[  4] Sent 22887 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60036 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  59.4 MBytes   498 Mbits/sec  7604  
[  4]   1.00-2.00   sec  58.5 MBytes   491 Mbits/sec  7494  
[  4]   2.00-3.00   sec  60.3 MBytes   505 Mbits/sec  7713  
[  4]   3.00-4.00   sec  59.7 MBytes   501 Mbits/sec  7641  
[  4]   4.00-5.00   sec  59.5 MBytes   499 Mbits/sec  7614  
[  4]   5.00-6.00   sec  60.2 MBytes   505 Mbits/sec  7708  
[  4]   6.00-7.00   sec  58.9 MBytes   494 Mbits/sec  7541  
[  4]   7.00-8.00   sec  59.0 MBytes   495 Mbits/sec  7554  
[  4]   8.00-9.00   sec  56.8 MBytes   477 Mbits/sec  7275  
[  4]   9.00-10.00  sec  58.7 MBytes   492 Mbits/sec  7510  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   591 MBytes   496 Mbits/sec  14957.240 ms  64540/64642 (1e+02%)  
[  4] Sent 64642 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 45064 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  21.4 MBytes   179 Mbits/sec  0.118 ms  0/2738 (0%)  
[  4]   1.00-2.00   sec  21.3 MBytes   179 Mbits/sec  0.126 ms  0/2732 (0%)  
[  4]   2.00-3.00   sec  21.5 MBytes   180 Mbits/sec  0.141 ms  0/2752 (0%)  
[  4]   3.00-4.00   sec  21.6 MBytes   181 Mbits/sec  0.149 ms  0/2760 (0%)  
[  4]   4.00-5.00   sec  21.6 MBytes   181 Mbits/sec  0.130 ms  0/2763 (0%)  
[  4]   5.00-6.00   sec  21.5 MBytes   180 Mbits/sec  0.132 ms  0/2751 (0%)  
[  4]   6.00-7.00   sec  21.5 MBytes   181 Mbits/sec  0.106 ms  0/2758 (0%)  
[  4]   7.00-8.00   sec  21.5 MBytes   181 Mbits/sec  0.117 ms  0/2757 (0%)  
[  4]   8.00-9.00   sec  21.5 MBytes   180 Mbits/sec  0.137 ms  0/2754 (0%)  
[  4]   9.00-10.00  sec  21.4 MBytes   180 Mbits/sec  0.128 ms  0/2745 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   215 MBytes   180 Mbits/sec  0.130 ms  0/27512 (0%)  
[  4] Sent 27512 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 40069 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  94.9 MBytes   796 Mbits/sec  12149  
[  4]   1.00-2.00   sec   104 MBytes   876 Mbits/sec  13361  
[  4]   2.00-3.00   sec   104 MBytes   876 Mbits/sec  13371  
[  4]   3.00-4.00   sec   104 MBytes   876 Mbits/sec  13360  
[  4]   4.00-5.00   sec   104 MBytes   875 Mbits/sec  13352  
[  4]   5.00-6.00   sec   104 MBytes   876 Mbits/sec  13363  
[  4]   6.00-7.00   sec   105 MBytes   877 Mbits/sec  13382  
[  4]   7.00-8.00   sec   104 MBytes   875 Mbits/sec  13346  
[  4]   8.00-9.00   sec   104 MBytes   876 Mbits/sec  13369  
[  4]   9.00-10.00  sec   104 MBytes   875 Mbits/sec  13346  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.01 GBytes   868 Mbits/sec  428870.708 ms  131807/131857 (1e+02%)  
[  4] Sent 131857 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 58654 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  21.6 MBytes   181 Mbits/sec  0.142 ms  0/2763 (0%)  
[  4]   1.00-2.00   sec  21.4 MBytes   179 Mbits/sec  0.326 ms  0/2738 (0%)  
[  4]   2.00-3.00   sec  21.3 MBytes   179 Mbits/sec  0.139 ms  0/2731 (0%)  
[  4]   3.00-4.00   sec  21.5 MBytes   180 Mbits/sec  0.118 ms  0/2753 (0%)  
[  4]   4.00-5.00   sec  21.6 MBytes   181 Mbits/sec  0.162 ms  0/2759 (0%)  
[  4]   5.00-6.00   sec  21.4 MBytes   180 Mbits/sec  0.121 ms  0/2741 (0%)  
[  4]   6.00-7.00   sec  21.2 MBytes   178 Mbits/sec  0.131 ms  0/2717 (0%)  
[  4]   7.00-8.00   sec  21.3 MBytes   179 Mbits/sec  0.141 ms  0/2725 (0%)  
[  4]   8.00-9.00   sec  20.7 MBytes   174 Mbits/sec  0.121 ms  0/2651 (0%)  
[  4]   9.00-10.00  sec  20.7 MBytes   174 Mbits/sec  0.136 ms  0/2653 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   213 MBytes   178 Mbits/sec  0.143 ms  0/27233 (0%)  
[  4] Sent 27233 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 51468 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 51470 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 51472 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  10.4 MBytes  87.6 Mbits/sec  102   28.3 KBytes       
[  6]   0.00-1.00   sec  10.4 MBytes  87.1 Mbits/sec   81   55.1 KBytes       
[  9]   0.00-1.00   sec  9.20 MBytes  77.2 Mbits/sec   99   19.8 KBytes       
[SUM]   0.00-1.00   sec  30.0 MBytes   252 Mbits/sec  282             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.52 MBytes  63.1 Mbits/sec  144   49.5 KBytes       
[  6]   1.00-2.00   sec  13.3 MBytes   112 Mbits/sec  102   38.2 KBytes       
[  9]   1.00-2.00   sec  9.13 MBytes  76.6 Mbits/sec   88   14.1 KBytes       
[SUM]   1.00-2.00   sec  30.0 MBytes   251 Mbits/sec  334             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  11.0 MBytes  92.3 Mbits/sec   95   21.2 KBytes       
[  6]   2.00-3.00   sec  11.9 MBytes  99.6 Mbits/sec   80   35.4 KBytes       
[  9]   2.00-3.00   sec  7.21 MBytes  60.5 Mbits/sec  100   28.3 KBytes       
[SUM]   2.00-3.00   sec  30.1 MBytes   252 Mbits/sec  275             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  10.1 MBytes  84.5 Mbits/sec  120   73.5 KBytes       
[  6]   3.00-4.00   sec  12.3 MBytes   103 Mbits/sec   74   80.6 KBytes       
[  9]   3.00-4.00   sec  5.72 MBytes  48.0 Mbits/sec  100   46.7 KBytes       
[SUM]   3.00-4.00   sec  28.1 MBytes   236 Mbits/sec  294             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  9.01 MBytes  75.6 Mbits/sec  130   48.1 KBytes       
[  6]   4.00-5.00   sec  8.33 MBytes  69.9 Mbits/sec   89   41.0 KBytes       
[  9]   4.00-5.00   sec  11.3 MBytes  94.9 Mbits/sec  101   55.1 KBytes       
[SUM]   4.00-5.00   sec  28.6 MBytes   240 Mbits/sec  320             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  11.6 MBytes  97.0 Mbits/sec  105   22.6 KBytes       
[  6]   5.00-6.00   sec  10.3 MBytes  86.5 Mbits/sec   88   39.6 KBytes       
[  9]   5.00-6.00   sec  7.21 MBytes  60.5 Mbits/sec   94   42.4 KBytes       
[SUM]   5.00-6.00   sec  29.1 MBytes   244 Mbits/sec  287             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  9.32 MBytes  78.2 Mbits/sec  122   32.5 KBytes       
[  6]   6.00-7.00   sec  8.76 MBytes  73.5 Mbits/sec  119   29.7 KBytes       
[  9]   6.00-7.00   sec  10.3 MBytes  86.0 Mbits/sec   89   45.2 KBytes       
[SUM]   6.00-7.00   sec  28.3 MBytes   238 Mbits/sec  330             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  10.1 MBytes  84.5 Mbits/sec  110   39.6 KBytes       
[  6]   7.00-8.00   sec  8.45 MBytes  70.9 Mbits/sec  121   26.9 KBytes       
[  9]   7.00-8.00   sec  10.0 MBytes  83.9 Mbits/sec   86   52.3 KBytes       
[SUM]   7.00-8.00   sec  28.5 MBytes   239 Mbits/sec  317             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  11.8 MBytes  99.0 Mbits/sec   82   56.6 KBytes       
[  6]   8.00-9.00   sec  8.76 MBytes  73.5 Mbits/sec  120   15.6 KBytes       
[  9]   8.00-9.00   sec  9.01 MBytes  75.6 Mbits/sec  132   41.0 KBytes       
[SUM]   8.00-9.00   sec  29.6 MBytes   248 Mbits/sec  334             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  11.7 MBytes  98.5 Mbits/sec   93   15.6 KBytes       
[  6]   9.00-10.00  sec  10.9 MBytes  91.7 Mbits/sec   89   33.9 KBytes       
[  9]   9.00-10.00  sec  6.15 MBytes  51.6 Mbits/sec   90   43.8 KBytes       
[SUM]   9.00-10.00  sec  28.8 MBytes   242 Mbits/sec  272             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   103 MBytes  86.0 Mbits/sec  1103             sender
[  4]   0.00-10.00  sec   102 MBytes  85.5 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   103 MBytes  86.7 Mbits/sec  963             sender
[  6]   0.00-10.00  sec   103 MBytes  86.2 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  85.2 MBytes  71.5 Mbits/sec  979             sender
[  9]   0.00-10.00  sec  84.6 MBytes  71.0 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   291 MBytes   244 Mbits/sec  3045             sender
[SUM]   0.00-10.00  sec   289 MBytes   243 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 51476 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 51478 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 51480 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.52 MBytes  29.5 Mbits/sec                  
[  6]   0.00-1.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   0.00-1.00   sec  2.25 MBytes  18.9 Mbits/sec                  
[SUM]   0.00-1.00   sec  9.27 MBytes  77.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  4.10 MBytes  34.4 Mbits/sec                  
[  6]   1.00-2.00   sec  4.10 MBytes  34.4 Mbits/sec                  
[  9]   1.00-2.00   sec  3.90 MBytes  32.7 Mbits/sec                  
[SUM]   1.00-2.00   sec  12.1 MBytes   102 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  4.69 MBytes  39.3 Mbits/sec                  
[  6]   2.00-3.00   sec  4.52 MBytes  37.9 Mbits/sec                  
[  9]   2.00-3.00   sec  4.76 MBytes  39.9 Mbits/sec                  
[SUM]   2.00-3.00   sec  14.0 MBytes   117 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  5.45 MBytes  45.7 Mbits/sec                  
[  6]   3.00-4.00   sec  3.90 MBytes  32.7 Mbits/sec                  
[  9]   3.00-4.00   sec  5.79 MBytes  48.6 Mbits/sec                  
[SUM]   3.00-4.00   sec  15.1 MBytes   127 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  2.65 MBytes  22.2 Mbits/sec                  
[  6]   4.00-5.00   sec  2.75 MBytes  23.1 Mbits/sec                  
[  9]   4.00-5.00   sec  2.67 MBytes  22.4 Mbits/sec                  
[SUM]   4.00-5.00   sec  8.07 MBytes  67.7 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  2.88 MBytes  24.1 Mbits/sec                  
[  6]   5.00-6.00   sec  2.77 MBytes  23.2 Mbits/sec                  
[  9]   5.00-6.00   sec  2.81 MBytes  23.6 Mbits/sec                  
[SUM]   5.00-6.00   sec  8.46 MBytes  70.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.00 MBytes  25.2 Mbits/sec                  
[  6]   6.00-7.00   sec  3.11 MBytes  26.1 Mbits/sec                  
[  9]   6.00-7.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[SUM]   6.00-7.00   sec  9.24 MBytes  77.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   7.00-8.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   7.00-8.00   sec  3.02 MBytes  25.3 Mbits/sec                  
[SUM]   7.00-8.00   sec  9.26 MBytes  77.7 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   8.00-9.00   sec  3.08 MBytes  25.8 Mbits/sec                  
[  9]   8.00-9.00   sec  3.11 MBytes  26.1 Mbits/sec                  
[SUM]   8.00-9.00   sec  9.31 MBytes  78.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   9.00-10.00  sec  3.08 MBytes  25.9 Mbits/sec                  
[  9]   9.00-10.00  sec  3.12 MBytes  26.2 Mbits/sec                  
[SUM]   9.00-10.00  sec  9.33 MBytes  78.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  36.1 MBytes  30.3 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  36.1 MBytes  30.3 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  34.4 MBytes  28.8 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  34.4 MBytes  28.8 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  35.0 MBytes  29.4 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  35.0 MBytes  29.4 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   106 MBytes  88.5 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   106 MBytes  88.5 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 42354 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 55345 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 55865 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  38.0 MBytes   318 Mbits/sec  4860  
[  6]   0.00-1.00   sec  38.0 MBytes   318 Mbits/sec  4860  
[  9]   0.00-1.00   sec  38.0 MBytes   318 Mbits/sec  4860  
[SUM]   0.00-1.00   sec   114 MBytes   955 Mbits/sec  14580  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.8 MBytes   317 Mbits/sec  4843  
[  6]   1.00-2.00   sec  37.8 MBytes   317 Mbits/sec  4843  
[  9]   1.00-2.00   sec  37.8 MBytes   317 Mbits/sec  4843  
[SUM]   1.00-2.00   sec   114 MBytes   952 Mbits/sec  14529  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec  4848  
[  6]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec  4848  
[  9]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec  4848  
[SUM]   2.00-3.00   sec   114 MBytes   953 Mbits/sec  14544  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec  4857  
[  6]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec  4857  
[  9]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec  4857  
[SUM]   3.00-4.00   sec   114 MBytes   955 Mbits/sec  14571  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.9 MBytes   318 Mbits/sec  4855  
[  6]   4.00-5.00   sec  37.9 MBytes   318 Mbits/sec  4855  
[  9]   4.00-5.00   sec  37.9 MBytes   318 Mbits/sec  4855  
[SUM]   4.00-5.00   sec   114 MBytes   955 Mbits/sec  14565  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.9 MBytes   318 Mbits/sec  4852  
[  6]   5.00-6.00   sec  37.9 MBytes   318 Mbits/sec  4852  
[  9]   5.00-6.00   sec  37.9 MBytes   318 Mbits/sec  4852  
[SUM]   5.00-6.00   sec   114 MBytes   954 Mbits/sec  14556  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.5 MBytes   314 Mbits/sec  4797  
[  6]   6.00-7.00   sec  37.5 MBytes   314 Mbits/sec  4797  
[  9]   6.00-7.00   sec  37.5 MBytes   314 Mbits/sec  4797  
[SUM]   6.00-7.00   sec   112 MBytes   943 Mbits/sec  14391  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.7 MBytes   317 Mbits/sec  4831  
[  6]   7.00-8.00   sec  37.7 MBytes   317 Mbits/sec  4831  
[  9]   7.00-8.00   sec  37.7 MBytes   317 Mbits/sec  4831  
[SUM]   7.00-8.00   sec   113 MBytes   950 Mbits/sec  14493  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.9 MBytes   318 Mbits/sec  4852  
[  6]   8.00-9.00   sec  37.9 MBytes   318 Mbits/sec  4852  
[  9]   8.00-9.00   sec  37.9 MBytes   318 Mbits/sec  4852  
[SUM]   8.00-9.00   sec   114 MBytes   954 Mbits/sec  14556  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.7 MBytes   316 Mbits/sec  4820  
[  6]   9.00-10.00  sec  37.7 MBytes   316 Mbits/sec  4820  
[  9]   9.00-10.00  sec  37.7 MBytes   316 Mbits/sec  4820  
[SUM]   9.00-10.00  sec   113 MBytes   948 Mbits/sec  14460  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   378 MBytes   317 Mbits/sec  7338208.376 ms  21969/21975 (1e+02%)  
[  4] Sent 21975 datagrams
[  6]   0.00-10.00  sec   378 MBytes   317 Mbits/sec  7338208.412 ms  43791/43797 (1e+02%)  
[  6] Sent 43797 datagrams
[  9]   0.00-10.00  sec   378 MBytes   317 Mbits/sec  7827422.262 ms  43757/43762 (1e+02%)  
[  9] Sent 43762 datagrams
[SUM]   0.00-10.00  sec  1.11 GBytes   952 Mbits/sec  7501279.683 ms  109517/109534 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 53764 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 46397 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 35402 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  7.23 MBytes  60.7 Mbits/sec  0.114 ms  0/926 (0%)  
[  6]   0.00-1.00   sec  7.23 MBytes  60.7 Mbits/sec  0.074 ms  0/926 (0%)  
[  9]   0.00-1.00   sec  7.23 MBytes  60.6 Mbits/sec  0.084 ms  0/925 (0%)  
[SUM]   0.00-1.00   sec  21.7 MBytes   182 Mbits/sec  0.090 ms  0/2777 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.24 MBytes  60.8 Mbits/sec  0.092 ms  0/927 (0%)  
[  6]   1.00-2.00   sec  7.24 MBytes  60.8 Mbits/sec  0.047 ms  0/927 (0%)  
[  9]   1.00-2.00   sec  7.23 MBytes  60.7 Mbits/sec  0.079 ms  0/926 (0%)  
[SUM]   1.00-2.00   sec  21.7 MBytes   182 Mbits/sec  0.073 ms  0/2780 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.20 MBytes  60.4 Mbits/sec  0.081 ms  0/922 (0%)  
[  6]   2.00-3.00   sec  7.20 MBytes  60.4 Mbits/sec  0.071 ms  0/922 (0%)  
[  9]   2.00-3.00   sec  7.20 MBytes  60.4 Mbits/sec  0.102 ms  0/922 (0%)  
[SUM]   2.00-3.00   sec  21.6 MBytes   181 Mbits/sec  0.085 ms  0/2766 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  7.22 MBytes  60.6 Mbits/sec  0.106 ms  0/924 (0%)  
[  6]   3.00-4.00   sec  7.21 MBytes  60.5 Mbits/sec  0.077 ms  0/923 (0%)  
[  9]   3.00-4.00   sec  7.22 MBytes  60.6 Mbits/sec  0.088 ms  0/924 (0%)  
[SUM]   3.00-4.00   sec  21.6 MBytes   182 Mbits/sec  0.090 ms  0/2771 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  7.21 MBytes  60.5 Mbits/sec  0.074 ms  0/923 (0%)  
[  6]   4.00-5.00   sec  7.22 MBytes  60.6 Mbits/sec  0.051 ms  0/924 (0%)  
[  9]   4.00-5.00   sec  7.22 MBytes  60.6 Mbits/sec  0.110 ms  0/924 (0%)  
[SUM]   4.00-5.00   sec  21.6 MBytes   182 Mbits/sec  0.078 ms  0/2771 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  7.18 MBytes  60.2 Mbits/sec  0.064 ms  0/919 (0%)  
[  6]   5.00-6.00   sec  7.18 MBytes  60.2 Mbits/sec  0.080 ms  0/919 (0%)  
[  9]   5.00-6.00   sec  7.17 MBytes  60.2 Mbits/sec  0.105 ms  0/918 (0%)  
[SUM]   5.00-6.00   sec  21.5 MBytes   181 Mbits/sec  0.083 ms  0/2756 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  7.26 MBytes  60.9 Mbits/sec  0.112 ms  0/929 (0%)  
[  6]   6.00-7.00   sec  7.26 MBytes  60.9 Mbits/sec  0.096 ms  0/929 (0%)  
[  9]   6.00-7.00   sec  7.26 MBytes  60.9 Mbits/sec  0.142 ms  0/929 (0%)  
[SUM]   6.00-7.00   sec  21.8 MBytes   183 Mbits/sec  0.116 ms  0/2787 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  7.40 MBytes  62.1 Mbits/sec  0.134 ms  0/947 (0%)  
[  6]   7.00-8.00   sec  7.39 MBytes  62.0 Mbits/sec  0.104 ms  0/946 (0%)  
[  9]   7.00-8.00   sec  7.40 MBytes  62.1 Mbits/sec  0.119 ms  0/947 (0%)  
[SUM]   7.00-8.00   sec  22.2 MBytes   186 Mbits/sec  0.119 ms  0/2840 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  7.49 MBytes  62.8 Mbits/sec  0.090 ms  0/959 (0%)  
[  6]   8.00-9.00   sec  7.49 MBytes  62.8 Mbits/sec  0.067 ms  0/959 (0%)  
[  9]   8.00-9.00   sec  7.49 MBytes  62.8 Mbits/sec  0.087 ms  0/959 (0%)  
[SUM]   8.00-9.00   sec  22.5 MBytes   189 Mbits/sec  0.082 ms  0/2877 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  7.48 MBytes  62.8 Mbits/sec  0.115 ms  0/958 (0%)  
[  6]   9.00-10.00  sec  7.49 MBytes  62.8 Mbits/sec  0.072 ms  0/959 (0%)  
[  9]   9.00-10.00  sec  7.48 MBytes  62.8 Mbits/sec  0.085 ms  0/958 (0%)  
[SUM]   9.00-10.00  sec  22.5 MBytes   188 Mbits/sec  0.091 ms  0/2875 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  72.9 MBytes  61.2 Mbits/sec  0.115 ms  0/9335 (0%)  
[  4] Sent 9335 datagrams
[  6]   0.00-10.00  sec  72.9 MBytes  61.2 Mbits/sec  0.068 ms  0/9335 (0%)  
[  6] Sent 9335 datagrams
[  9]   0.00-10.00  sec  72.9 MBytes  61.2 Mbits/sec  0.077 ms  0/9334 (0%)  
[  9] Sent 9334 datagrams
[SUM]   0.00-10.00  sec   219 MBytes   184 Mbits/sec  0.087 ms  0/28004 (0%)  

iperf Done.
+ : ':::::::[' configuration dma_burst ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 51286 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  29.4 MBytes   247 Mbits/sec   44   50.9 KBytes       
[  4]   1.00-2.00   sec  24.4 MBytes   204 Mbits/sec   21   66.5 KBytes       
[  4]   2.00-3.00   sec  22.0 MBytes   185 Mbits/sec   12   74.9 KBytes       
[  4]   3.00-4.00   sec  22.4 MBytes   188 Mbits/sec   19   84.8 KBytes       
[  4]   4.00-5.00   sec  29.1 MBytes   244 Mbits/sec   51   76.4 KBytes       
[  4]   5.00-6.00   sec  29.3 MBytes   246 Mbits/sec   69   66.5 KBytes       
[  4]   6.00-7.00   sec  29.5 MBytes   248 Mbits/sec   62   67.9 KBytes       
[  4]   7.00-8.00   sec  29.4 MBytes   247 Mbits/sec   44   43.8 KBytes       
[  4]   8.00-9.00   sec  25.0 MBytes   210 Mbits/sec   29   91.9 KBytes       
[  4]   9.00-10.00  sec  22.3 MBytes   187 Mbits/sec   35   73.5 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   263 MBytes   220 Mbits/sec  386             sender
[  4]   0.00-10.00  sec   262 MBytes   220 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 51290 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  10.1 MBytes  85.1 Mbits/sec                  
[  4]   1.00-2.00   sec  12.5 MBytes   104 Mbits/sec                  
[  4]   2.00-3.00   sec  12.3 MBytes   103 Mbits/sec                  
[  4]   3.00-4.00   sec  12.3 MBytes   104 Mbits/sec                  
[  4]   4.00-5.00   sec  11.8 MBytes  99.1 Mbits/sec                  
[  4]   5.00-6.00   sec  9.43 MBytes  79.1 Mbits/sec                  
[  4]   6.00-7.00   sec  9.77 MBytes  81.9 Mbits/sec                  
[  4]   7.00-8.00   sec  12.2 MBytes   102 Mbits/sec                  
[  4]   8.00-9.00   sec  12.3 MBytes   103 Mbits/sec                  
[  4]   9.00-10.00  sec  12.3 MBytes   103 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   115 MBytes  96.9 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   115 MBytes  96.9 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 59591 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   138 Mbits/sec  2102  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2290  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2290  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2285  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  239921.081 ms  783/842 (93%)  
[  4] Sent 842 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 54088 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  17.9 MBytes   150 Mbits/sec  0.120 ms  0/2287 (0%)  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  0.124 ms  0/2290 (0%)  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  0.104 ms  0/2288 (0%)  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  0.129 ms  0/2289 (0%)  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  0.105 ms  0/2289 (0%)  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  0.127 ms  0/2288 (0%)  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  0.112 ms  0/2289 (0%)  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  0.112 ms  0/2289 (0%)  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  0.103 ms  0/2289 (0%)  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  0.116 ms  0/2289 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.126 ms  0/22888 (0%)  
[  4] Sent 22888 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 56755 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  58.9 MBytes   494 Mbits/sec  7545  
[  4]   1.00-2.00   sec  59.9 MBytes   503 Mbits/sec  7668  
[  4]   2.00-3.00   sec  58.7 MBytes   493 Mbits/sec  7518  
[  4]   3.00-4.00   sec  60.5 MBytes   508 Mbits/sec  7749  
[  4]   4.00-5.00   sec  59.0 MBytes   495 Mbits/sec  7547  
[  4]   5.00-6.00   sec  60.4 MBytes   506 Mbits/sec  7725  
[  4]   6.00-7.00   sec  58.5 MBytes   490 Mbits/sec  7483  
[  4]   7.00-8.00   sec  60.6 MBytes   508 Mbits/sec  7757  
[  4]   8.00-9.00   sec  58.5 MBytes   491 Mbits/sec  7492  
[  4]   9.00-10.00  sec  60.7 MBytes   509 Mbits/sec  7773  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   596 MBytes   500 Mbits/sec  39379.596 ms  64391/64478 (1e+02%)  
[  4] Sent 64478 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 50608 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  21.7 MBytes   182 Mbits/sec  0.117 ms  0/2778 (0%)  
[  4]   1.00-2.00   sec  21.8 MBytes   183 Mbits/sec  0.123 ms  0/2788 (0%)  
[  4]   2.00-3.00   sec  21.8 MBytes   183 Mbits/sec  0.143 ms  0/2786 (0%)  
[  4]   3.00-4.00   sec  21.6 MBytes   182 Mbits/sec  0.137 ms  0/2771 (0%)  
[  4]   4.00-5.00   sec  21.7 MBytes   182 Mbits/sec  0.124 ms  0/2775 (0%)  
[  4]   5.00-6.00   sec  21.8 MBytes   183 Mbits/sec  0.122 ms  0/2788 (0%)  
[  4]   6.00-7.00   sec  21.6 MBytes   181 Mbits/sec  0.119 ms  0/2762 (0%)  
[  4]   7.00-8.00   sec  21.0 MBytes   176 Mbits/sec  0.104 ms  0/2693 (0%)  
[  4]   8.00-9.00   sec  21.0 MBytes   176 Mbits/sec  0.133 ms  0/2685 (0%)  
[  4]   9.00-10.00  sec  20.9 MBytes   175 Mbits/sec  0.105 ms  0/2674 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   215 MBytes   180 Mbits/sec  0.101 ms  0/27502 (0%)  
[  4] Sent 27502 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 36118 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec   103 MBytes   865 Mbits/sec  13203  
[  4]   1.00-2.00   sec   103 MBytes   866 Mbits/sec  13221  
[  4]   2.00-3.00   sec   103 MBytes   864 Mbits/sec  13190  
[  4]   3.00-4.00   sec   103 MBytes   865 Mbits/sec  13198  
[  4]   4.00-5.00   sec   103 MBytes   866 Mbits/sec  13218  
[  4]   5.00-6.00   sec   103 MBytes   865 Mbits/sec  13205  
[  4]   6.00-7.00   sec   103 MBytes   866 Mbits/sec  13207  
[  4]   7.00-8.00   sec   103 MBytes   865 Mbits/sec  13195  
[  4]   8.00-9.00   sec   103 MBytes   866 Mbits/sec  13207  
[  4]   9.00-10.00  sec   103 MBytes   867 Mbits/sec  13228  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.01 GBytes   866 Mbits/sec  0.747 ms  131275/131557 (1e+02%)  
[  4] Sent 131557 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 56991 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  24.4 MBytes   205 Mbits/sec  0.124 ms  0/3128 (0%)  
[  4]   1.00-2.00   sec  24.4 MBytes   204 Mbits/sec  0.129 ms  0/3118 (0%)  
[  4]   2.00-3.00   sec  24.3 MBytes   204 Mbits/sec  0.140 ms  0/3112 (0%)  
[  4]   3.00-4.00   sec  24.2 MBytes   203 Mbits/sec  0.139 ms  0/3103 (0%)  
[  4]   4.00-5.00   sec  24.3 MBytes   203 Mbits/sec  0.109 ms  0/3105 (0%)  
[  4]   5.00-6.00   sec  24.4 MBytes   204 Mbits/sec  0.142 ms  0/3117 (0%)  
[  4]   6.00-7.00   sec  24.3 MBytes   204 Mbits/sec  0.136 ms  0/3113 (0%)  
[  4]   7.00-8.00   sec  24.4 MBytes   205 Mbits/sec  0.113 ms  0/3125 (0%)  
[  4]   8.00-9.00   sec  24.3 MBytes   204 Mbits/sec  0.117 ms  0/3108 (0%)  
[  4]   9.00-10.00  sec  24.2 MBytes   203 Mbits/sec  0.130 ms  0/3101 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   243 MBytes   204 Mbits/sec  0.129 ms  0/31132 (0%)  
[  4] Sent 31132 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 51306 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 51308 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 51310 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  11.9 MBytes  99.6 Mbits/sec   80   25.5 KBytes       
[  6]   0.00-1.00   sec  10.2 MBytes  85.4 Mbits/sec   67   46.7 KBytes       
[  9]   0.00-1.00   sec  7.27 MBytes  60.9 Mbits/sec   99   15.6 KBytes       
[SUM]   0.00-1.00   sec  29.3 MBytes   246 Mbits/sec  246             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  12.1 MBytes   101 Mbits/sec   76   60.8 KBytes       
[  6]   1.00-2.00   sec  8.33 MBytes  69.8 Mbits/sec   94   17.0 KBytes       
[  9]   1.00-2.00   sec  8.58 MBytes  71.9 Mbits/sec  103   17.0 KBytes       
[SUM]   1.00-2.00   sec  29.0 MBytes   243 Mbits/sec  273             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  15.8 MBytes   133 Mbits/sec   80   43.8 KBytes       
[  6]   2.00-3.00   sec  6.52 MBytes  54.8 Mbits/sec   95   28.3 KBytes       
[  9]   2.00-3.00   sec  7.21 MBytes  60.5 Mbits/sec  114   46.7 KBytes       
[SUM]   2.00-3.00   sec  29.6 MBytes   248 Mbits/sec  289             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  11.4 MBytes  95.9 Mbits/sec   71   35.4 KBytes       
[  6]   3.00-4.00   sec  9.20 MBytes  77.2 Mbits/sec   96   24.0 KBytes       
[  9]   3.00-4.00   sec  8.95 MBytes  75.1 Mbits/sec  130   12.7 KBytes       
[SUM]   3.00-4.00   sec  29.6 MBytes   248 Mbits/sec  297             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  17.0 MBytes   143 Mbits/sec   76   9.90 KBytes       
[  6]   4.00-5.00   sec  7.95 MBytes  66.7 Mbits/sec  109   29.7 KBytes       
[  9]   4.00-5.00   sec  4.72 MBytes  39.6 Mbits/sec   82   32.5 KBytes       
[SUM]   4.00-5.00   sec  29.7 MBytes   249 Mbits/sec  267             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  10.6 MBytes  89.1 Mbits/sec  133   36.8 KBytes       
[  6]   5.00-6.00   sec  8.20 MBytes  68.8 Mbits/sec  105   62.2 KBytes       
[  9]   5.00-6.00   sec  9.32 MBytes  78.2 Mbits/sec  100   41.0 KBytes       
[SUM]   5.00-6.00   sec  28.2 MBytes   236 Mbits/sec  338             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  10.1 MBytes  84.4 Mbits/sec  105   49.5 KBytes       
[  6]   6.00-7.00   sec  9.88 MBytes  82.9 Mbits/sec  101   19.8 KBytes       
[  9]   6.00-7.00   sec  9.94 MBytes  83.4 Mbits/sec   93   41.0 KBytes       
[SUM]   6.00-7.00   sec  29.9 MBytes   251 Mbits/sec  299             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  11.1 MBytes  93.3 Mbits/sec   93   39.6 KBytes       
[  6]   7.00-8.00   sec  9.45 MBytes  79.3 Mbits/sec  127   7.07 KBytes       
[  9]   7.00-8.00   sec  9.26 MBytes  77.7 Mbits/sec   88   59.4 KBytes       
[SUM]   7.00-8.00   sec  29.8 MBytes   250 Mbits/sec  308             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  13.7 MBytes   115 Mbits/sec   93   8.48 KBytes       
[  6]   8.00-9.00   sec  6.46 MBytes  54.2 Mbits/sec  116   17.0 KBytes       
[  9]   8.00-9.00   sec  9.69 MBytes  81.3 Mbits/sec  104   72.1 KBytes       
[SUM]   8.00-9.00   sec  29.8 MBytes   250 Mbits/sec  313             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  10.9 MBytes  91.8 Mbits/sec   70   46.7 KBytes       
[  6]   9.00-10.00  sec  7.95 MBytes  66.7 Mbits/sec   98   41.0 KBytes       
[  9]   9.00-10.00  sec  10.4 MBytes  87.6 Mbits/sec   91   32.5 KBytes       
[SUM]   9.00-10.00  sec  29.3 MBytes   246 Mbits/sec  259             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   125 MBytes   105 Mbits/sec  877             sender
[  4]   0.00-10.00  sec   124 MBytes   104 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  84.1 MBytes  70.6 Mbits/sec  1008             sender
[  6]   0.00-10.00  sec  83.5 MBytes  70.1 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  85.4 MBytes  71.6 Mbits/sec  1004             sender
[  9]   0.00-10.00  sec  84.8 MBytes  71.2 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   294 MBytes   247 Mbits/sec  2889             sender
[SUM]   0.00-10.00  sec   292 MBytes   245 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 51314 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 51316 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 51318 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.53 MBytes  29.6 Mbits/sec                  
[  6]   0.00-1.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   0.00-1.00   sec  2.25 MBytes  18.9 Mbits/sec                  
[SUM]   0.00-1.00   sec  9.28 MBytes  77.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.11 MBytes  26.1 Mbits/sec                  
[  6]   1.00-2.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   1.00-2.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[SUM]   1.00-2.00   sec  9.36 MBytes  78.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.11 MBytes  26.1 Mbits/sec                  
[  6]   2.00-3.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   2.00-3.00   sec  3.09 MBytes  25.9 Mbits/sec                  
[SUM]   2.00-3.00   sec  9.33 MBytes  78.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   3.00-4.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   3.00-4.00   sec  3.05 MBytes  25.6 Mbits/sec                  
[SUM]   3.00-4.00   sec  9.30 MBytes  78.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  3.13 MBytes  26.3 Mbits/sec                  
[  6]   4.00-5.00   sec  3.03 MBytes  25.4 Mbits/sec                  
[  9]   4.00-5.00   sec  3.21 MBytes  26.9 Mbits/sec                  
[SUM]   4.00-5.00   sec  9.37 MBytes  78.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   5.00-6.00   sec  3.09 MBytes  25.9 Mbits/sec                  
[  9]   5.00-6.00   sec  3.11 MBytes  26.1 Mbits/sec                  
[SUM]   5.00-6.00   sec  9.33 MBytes  78.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.05 MBytes  25.6 Mbits/sec                  
[  6]   6.00-7.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   6.00-7.00   sec  3.15 MBytes  26.4 Mbits/sec                  
[SUM]   6.00-7.00   sec  9.32 MBytes  78.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.38 MBytes  28.4 Mbits/sec                  
[  6]   7.00-8.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   7.00-8.00   sec  3.41 MBytes  28.6 Mbits/sec                  
[SUM]   7.00-8.00   sec  10.2 MBytes  85.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  4.12 MBytes  34.5 Mbits/sec                  
[  6]   8.00-9.00   sec  4.12 MBytes  34.6 Mbits/sec                  
[  9]   8.00-9.00   sec  4.02 MBytes  33.7 Mbits/sec                  
[SUM]   8.00-9.00   sec  12.3 MBytes   103 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  4.12 MBytes  34.6 Mbits/sec                  
[  6]   9.00-10.00  sec  4.05 MBytes  34.0 Mbits/sec                  
[  9]   9.00-10.00  sec  4.11 MBytes  34.4 Mbits/sec                  
[SUM]   9.00-10.00  sec  12.3 MBytes   103 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  34.7 MBytes  29.1 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  34.7 MBytes  29.1 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  34.6 MBytes  29.0 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  34.6 MBytes  29.0 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  33.5 MBytes  28.1 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  33.5 MBytes  28.1 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   103 MBytes  86.2 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   103 MBytes  86.2 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 40993 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 36104 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60932 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  37.9 MBytes   317 Mbits/sec  4845  
[  6]   0.00-1.00   sec  37.9 MBytes   317 Mbits/sec  4845  
[  9]   0.00-1.00   sec  37.9 MBytes   317 Mbits/sec  4845  
[SUM]   0.00-1.00   sec   114 MBytes   952 Mbits/sec  14535  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.8 MBytes   317 Mbits/sec  4841  
[  6]   1.00-2.00   sec  37.8 MBytes   317 Mbits/sec  4841  
[  9]   1.00-2.00   sec  37.8 MBytes   317 Mbits/sec  4841  
[SUM]   1.00-2.00   sec   113 MBytes   952 Mbits/sec  14523  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec  4854  
[  6]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec  4854  
[  9]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec  4854  
[SUM]   2.00-3.00   sec   114 MBytes   954 Mbits/sec  14562  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec  4851  
[  6]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec  4851  
[  9]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec  4851  
[SUM]   3.00-4.00   sec   114 MBytes   954 Mbits/sec  14553  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.9 MBytes   318 Mbits/sec  4847  
[  6]   4.00-5.00   sec  37.9 MBytes   318 Mbits/sec  4847  
[  9]   4.00-5.00   sec  37.9 MBytes   318 Mbits/sec  4847  
[SUM]   4.00-5.00   sec   114 MBytes   953 Mbits/sec  14541  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.7 MBytes   316 Mbits/sec  4821  
[  6]   5.00-6.00   sec  37.7 MBytes   316 Mbits/sec  4821  
[  9]   5.00-6.00   sec  37.7 MBytes   316 Mbits/sec  4821  
[SUM]   5.00-6.00   sec   113 MBytes   948 Mbits/sec  14463  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.8 MBytes   317 Mbits/sec  4844  
[  6]   6.00-7.00   sec  37.8 MBytes   317 Mbits/sec  4844  
[  9]   6.00-7.00   sec  37.8 MBytes   317 Mbits/sec  4844  
[SUM]   6.00-7.00   sec   114 MBytes   952 Mbits/sec  14532  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.8 MBytes   317 Mbits/sec  4839  
[  6]   7.00-8.00   sec  37.8 MBytes   317 Mbits/sec  4839  
[  9]   7.00-8.00   sec  37.8 MBytes   317 Mbits/sec  4839  
[SUM]   7.00-8.00   sec   113 MBytes   951 Mbits/sec  14517  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.8 MBytes   317 Mbits/sec  4840  
[  6]   8.00-9.00   sec  37.8 MBytes   317 Mbits/sec  4840  
[  9]   8.00-9.00   sec  37.8 MBytes   317 Mbits/sec  4840  
[SUM]   8.00-9.00   sec   113 MBytes   952 Mbits/sec  14520  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.9 MBytes   318 Mbits/sec  4848  
[  6]   9.00-10.00  sec  37.9 MBytes   318 Mbits/sec  4848  
[  9]   9.00-10.00  sec  37.9 MBytes   318 Mbits/sec  4848  
[SUM]   9.00-10.00  sec   114 MBytes   953 Mbits/sec  14544  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   378 MBytes   317 Mbits/sec  7827421.765 ms  99/104 (95%)  
[  4] Sent 104 datagrams
[  6]   0.00-10.00  sec   378 MBytes   317 Mbits/sec  7338208.061 ms  43808/43814 (1e+02%)  
[  6] Sent 43814 datagrams
[  9]   0.00-10.00  sec   378 MBytes   317 Mbits/sec  8905866.429 ms  0/3 (0%)  
[  9] Sent 3 datagrams
[SUM]   0.00-10.00  sec  1.11 GBytes   952 Mbits/sec  8023832.085 ms  43907/43921 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 38683 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 51240 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 35532 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  7.34 MBytes  61.6 Mbits/sec  0.080 ms  0/940 (0%)  
[  6]   0.00-1.00   sec  7.34 MBytes  61.6 Mbits/sec  0.073 ms  0/940 (0%)  
[  9]   0.00-1.00   sec  7.34 MBytes  61.5 Mbits/sec  0.125 ms  0/939 (0%)  
[SUM]   0.00-1.00   sec  22.0 MBytes   185 Mbits/sec  0.093 ms  0/2819 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.30 MBytes  61.3 Mbits/sec  0.092 ms  0/935 (0%)  
[  6]   1.00-2.00   sec  7.30 MBytes  61.3 Mbits/sec  0.078 ms  0/935 (0%)  
[  9]   1.00-2.00   sec  7.30 MBytes  61.3 Mbits/sec  0.093 ms  0/935 (0%)  
[SUM]   1.00-2.00   sec  21.9 MBytes   184 Mbits/sec  0.088 ms  0/2805 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.17 MBytes  60.2 Mbits/sec  0.104 ms  0/918 (0%)  
[  6]   2.00-3.00   sec  7.16 MBytes  60.1 Mbits/sec  0.080 ms  0/917 (0%)  
[  9]   2.00-3.00   sec  7.17 MBytes  60.2 Mbits/sec  0.091 ms  0/918 (0%)  
[SUM]   2.00-3.00   sec  21.5 MBytes   180 Mbits/sec  0.092 ms  0/2753 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  7.22 MBytes  60.6 Mbits/sec  0.097 ms  0/924 (0%)  
[  6]   3.00-4.00   sec  7.23 MBytes  60.6 Mbits/sec  0.048 ms  0/925 (0%)  
[  9]   3.00-4.00   sec  7.22 MBytes  60.6 Mbits/sec  0.070 ms  0/924 (0%)  
[SUM]   3.00-4.00   sec  21.7 MBytes   182 Mbits/sec  0.072 ms  0/2773 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  7.20 MBytes  60.4 Mbits/sec  0.114 ms  0/921 (0%)  
[  6]   4.00-5.00   sec  7.20 MBytes  60.4 Mbits/sec  0.086 ms  0/921 (0%)  
[  9]   4.00-5.00   sec  7.20 MBytes  60.4 Mbits/sec  0.107 ms  0/921 (0%)  
[SUM]   4.00-5.00   sec  21.6 MBytes   181 Mbits/sec  0.102 ms  0/2763 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  7.14 MBytes  59.9 Mbits/sec  0.102 ms  0/914 (0%)  
[  6]   5.00-6.00   sec  7.14 MBytes  59.9 Mbits/sec  0.079 ms  0/914 (0%)  
[  9]   5.00-6.00   sec  7.14 MBytes  59.9 Mbits/sec  0.095 ms  0/914 (0%)  
[SUM]   5.00-6.00   sec  21.4 MBytes   180 Mbits/sec  0.092 ms  0/2742 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  7.19 MBytes  60.3 Mbits/sec  0.156 ms  0/920 (0%)  
[  6]   6.00-7.00   sec  7.19 MBytes  60.3 Mbits/sec  0.079 ms  0/920 (0%)  
[  9]   6.00-7.00   sec  7.20 MBytes  60.4 Mbits/sec  0.151 ms  0/921 (0%)  
[SUM]   6.00-7.00   sec  21.6 MBytes   181 Mbits/sec  0.129 ms  0/2761 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  7.16 MBytes  60.1 Mbits/sec  0.107 ms  0/917 (0%)  
[  6]   7.00-8.00   sec  7.16 MBytes  60.1 Mbits/sec  0.045 ms  0/917 (0%)  
[  9]   7.00-8.00   sec  7.16 MBytes  60.1 Mbits/sec  0.096 ms  0/917 (0%)  
[SUM]   7.00-8.00   sec  21.5 MBytes   180 Mbits/sec  0.083 ms  0/2751 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  7.23 MBytes  60.7 Mbits/sec  0.123 ms  0/926 (0%)  
[  6]   8.00-9.00   sec  7.23 MBytes  60.7 Mbits/sec  0.083 ms  0/926 (0%)  
[  9]   8.00-9.00   sec  7.23 MBytes  60.6 Mbits/sec  0.127 ms  0/925 (0%)  
[SUM]   8.00-9.00   sec  21.7 MBytes   182 Mbits/sec  0.111 ms  0/2777 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  7.37 MBytes  61.8 Mbits/sec  0.094 ms  0/943 (0%)  
[  6]   9.00-10.00  sec  7.36 MBytes  61.7 Mbits/sec  0.084 ms  0/942 (0%)  
[  9]   9.00-10.00  sec  7.37 MBytes  61.8 Mbits/sec  0.119 ms  0/943 (0%)  
[SUM]   9.00-10.00  sec  22.1 MBytes   185 Mbits/sec  0.099 ms  0/2828 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  72.3 MBytes  60.7 Mbits/sec  0.094 ms  0/9258 (0%)  
[  4] Sent 9258 datagrams
[  6]   0.00-10.00  sec  72.3 MBytes  60.7 Mbits/sec  0.088 ms  0/9258 (0%)  
[  6] Sent 9258 datagrams
[  9]   0.00-10.00  sec  72.3 MBytes  60.7 Mbits/sec  0.119 ms  0/9258 (0%)  
[  9] Sent 9258 datagrams
[SUM]   0.00-10.00  sec   217 MBytes   182 Mbits/sec  0.100 ms  0/27774 (0%)  

iperf Done.
UDP lantiq->host
@host:		# nc -u -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc -u 10.0.0.1 4321
567MiB 0:00:41 [15,8MiB/s]

TCP lantiq->host
@host:		# nc -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc 10.0.0.1 4321
153MiB 0:00:27 [6,37MiB/s] or 177MiB 0:00:30 [8,03MiB/s]

UDP host->lantiq
@lantiq:	# nc -u -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc -u 10.0.0.80 4321
3,37GiB 0:00:31 [ 111MiB/s]

TCP host->lantiq
@lantiq:	# nc -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc 10.0.0.80 4321
16MiB 0:00:31 [19,1MiB/s] or 1,06GiB 0:00:49 [24,9MiB/s]
+ : ':::::::[' configuration everything ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60838 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  34.1 MBytes   286 Mbits/sec   35   55.1 KBytes       
[  4]   1.00-2.00   sec  26.8 MBytes   225 Mbits/sec   75   91.9 KBytes       
[  4]   2.00-3.00   sec  38.3 MBytes   322 Mbits/sec   30   67.9 KBytes       
[  4]   3.00-4.00   sec  27.3 MBytes   229 Mbits/sec   35   96.2 KBytes       
[  4]   4.00-5.00   sec  29.1 MBytes   244 Mbits/sec   51    139 KBytes       
[  4]   5.00-6.00   sec  34.2 MBytes   287 Mbits/sec   19    165 KBytes       
[  4]   6.00-7.00   sec  32.8 MBytes   275 Mbits/sec   48    182 KBytes       
[  4]   7.00-8.00   sec  30.4 MBytes   255 Mbits/sec   12   50.9 KBytes       
[  4]   8.00-9.00   sec  33.0 MBytes   277 Mbits/sec   58    123 KBytes       
[  4]   9.00-10.00  sec  26.8 MBytes   225 Mbits/sec   64    134 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   313 MBytes   262 Mbits/sec  427             sender
[  4]   0.00-10.00  sec   312 MBytes   262 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60852 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  10.5 MBytes  87.9 Mbits/sec                  
[  4]   1.00-2.00   sec  10.6 MBytes  88.6 Mbits/sec                  
[  4]   2.00-3.00   sec  10.6 MBytes  88.6 Mbits/sec                  
[  4]   3.00-4.00   sec  10.5 MBytes  87.9 Mbits/sec                  
[  4]   4.00-5.00   sec  10.5 MBytes  88.3 Mbits/sec                  
[  4]   5.00-6.00   sec  10.6 MBytes  89.3 Mbits/sec                  
[  4]   6.00-7.00   sec  10.5 MBytes  88.1 Mbits/sec                  
[  4]   7.00-8.00   sec  10.6 MBytes  89.1 Mbits/sec                  
[  4]   8.00-9.00   sec  10.6 MBytes  89.1 Mbits/sec                  
[  4]   9.00-10.00  sec  10.5 MBytes  87.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   107 MBytes  89.5 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   107 MBytes  89.5 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 52597 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   137 Mbits/sec  2096  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2293  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2290  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2287  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  5.154 ms  1056/1284 (82%)  
[  4] Sent 1284 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 37198 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  17.9 MBytes   150 Mbits/sec  0.042 ms  0/2287 (0%)  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  0.045 ms  0/2289 (0%)  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  0.038 ms  0/2290 (0%)  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  0.054 ms  0/2289 (0%)  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  0.027 ms  0/2288 (0%)  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  0.078 ms  0/2289 (0%)  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  0.044 ms  0/2288 (0%)  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  0.023 ms  0/2289 (0%)  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  0.058 ms  0/2289 (0%)  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  0.098 ms  0/2289 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.098 ms  0/22887 (0%)  
[  4] Sent 22887 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 55677 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  59.1 MBytes   496 Mbits/sec  7565  
[  4]   1.00-2.00   sec  59.1 MBytes   496 Mbits/sec  7567  
[  4]   2.00-3.00   sec  60.4 MBytes   507 Mbits/sec  7737  
[  4]   3.00-4.00   sec  59.2 MBytes   497 Mbits/sec  7580  
[  4]   4.00-5.00   sec  59.5 MBytes   499 Mbits/sec  7612  
[  4]   5.00-6.00   sec  59.0 MBytes   495 Mbits/sec  7547  
[  4]   6.00-7.00   sec  59.4 MBytes   498 Mbits/sec  7605  
[  4]   7.00-8.00   sec  60.4 MBytes   507 Mbits/sec  7737  
[  4]   8.00-9.00   sec  56.3 MBytes   473 Mbits/sec  7212  
[  4]   9.00-10.00  sec  60.0 MBytes   503 Mbits/sec  7678  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   592 MBytes   497 Mbits/sec  0.257 ms  64678/64986 (1e+02%)  
[  4] Sent 64986 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 52012 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  22.6 MBytes   190 Mbits/sec  0.204 ms  0/2895 (0%)  
[  4]   1.00-2.00   sec  22.7 MBytes   191 Mbits/sec  0.101 ms  0/2911 (0%)  
[  4]   2.00-3.00   sec  23.2 MBytes   195 Mbits/sec  0.098 ms  0/2976 (0%)  
[  4]   3.00-4.00   sec  23.2 MBytes   194 Mbits/sec  0.092 ms  0/2964 (0%)  
[  4]   4.00-5.00   sec  24.8 MBytes   208 Mbits/sec  0.084 ms  0/3180 (0%)  
[  4]   5.00-6.00   sec  24.6 MBytes   207 Mbits/sec  0.100 ms  0/3155 (0%)  
[  4]   6.00-7.00   sec  27.8 MBytes   233 Mbits/sec  0.107 ms  0/3560 (0%)  
[  4]   7.00-8.00   sec  27.7 MBytes   232 Mbits/sec  0.040 ms  0/3540 (0%)  
[  4]   8.00-9.00   sec  27.7 MBytes   232 Mbits/sec  0.112 ms  0/3543 (0%)  
[  4]   9.00-10.00  sec  27.7 MBytes   232 Mbits/sec  0.029 ms  0/3544 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   252 MBytes   211 Mbits/sec  0.034 ms  0/32269 (0%)  
[  4] Sent 32269 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 53409 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  92.1 MBytes   772 Mbits/sec  11783  
[  4]   1.00-2.00   sec   101 MBytes   845 Mbits/sec  12898  
[  4]   2.00-3.00   sec   102 MBytes   859 Mbits/sec  13108  
[  4]   3.00-4.00   sec   101 MBytes   847 Mbits/sec  12925  
[  4]   4.00-5.00   sec   102 MBytes   853 Mbits/sec  13011  
[  4]   5.00-6.00   sec   102 MBytes   853 Mbits/sec  13011  
[  4]   6.00-7.00   sec   101 MBytes   846 Mbits/sec  12914  
[  4]   7.00-8.00   sec   103 MBytes   867 Mbits/sec  13232  
[  4]   8.00-9.00   sec   102 MBytes   854 Mbits/sec  13036  
[  4]   9.00-10.00  sec   102 MBytes   853 Mbits/sec  13012  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1007 MBytes   845 Mbits/sec  0.367 ms  66211/66507 (1e+02%)  
[  4] Sent 66507 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 42788 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  22.9 MBytes   192 Mbits/sec  0.144 ms  0/2937 (0%)  
[  4]   1.00-2.00   sec  23.0 MBytes   193 Mbits/sec  0.139 ms  0/2942 (0%)  
[  4]   2.00-3.00   sec  27.8 MBytes   234 Mbits/sec  0.047 ms  0/3563 (0%)  
[  4]   3.00-4.00   sec  27.9 MBytes   234 Mbits/sec  0.144 ms  0/3568 (0%)  
[  4]   4.00-5.00   sec  27.9 MBytes   234 Mbits/sec  0.127 ms  0/3568 (0%)  
[  4]   5.00-6.00   sec  27.8 MBytes   234 Mbits/sec  0.028 ms  0/3563 (0%)  
[  4]   6.00-7.00   sec  27.7 MBytes   233 Mbits/sec  0.062 ms  0/3548 (0%)  
[  4]   7.00-8.00   sec  27.8 MBytes   233 Mbits/sec  0.049 ms  0/3558 (0%)  
[  4]   8.00-9.00   sec  27.8 MBytes   233 Mbits/sec  0.103 ms  0/3553 (0%)  
[  4]   9.00-10.00  sec  27.6 MBytes   232 Mbits/sec  0.144 ms  0/3539 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   268 MBytes   225 Mbits/sec  0.154 ms  0/34341 (0%)  
[  4] Sent 34341 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60930 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60932 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60934 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  8.17 MBytes  68.5 Mbits/sec  132   11.3 KBytes       
[  6]   0.00-1.00   sec  13.8 MBytes   116 Mbits/sec  124   24.0 KBytes       
[  9]   0.00-1.00   sec  10.5 MBytes  88.4 Mbits/sec  108   17.0 KBytes       
[SUM]   0.00-1.00   sec  32.5 MBytes   273 Mbits/sec  364             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  5.84 MBytes  49.0 Mbits/sec  129   21.2 KBytes       
[  6]   1.00-2.00   sec  19.1 MBytes   160 Mbits/sec  103   55.1 KBytes       
[  9]   1.00-2.00   sec  7.95 MBytes  66.7 Mbits/sec   82   24.0 KBytes       
[SUM]   1.00-2.00   sec  32.9 MBytes   276 Mbits/sec  314             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.15 MBytes  60.0 Mbits/sec  121   21.2 KBytes       
[  6]   2.00-3.00   sec  19.8 MBytes   166 Mbits/sec   89   69.3 KBytes       
[  9]   2.00-3.00   sec  5.03 MBytes  42.2 Mbits/sec  151   7.07 KBytes       
[SUM]   2.00-3.00   sec  31.9 MBytes   268 Mbits/sec  361             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  16.1 MBytes   135 Mbits/sec  132   12.7 KBytes       
[  6]   3.00-4.00   sec  6.96 MBytes  58.4 Mbits/sec  121   4.24 KBytes       
[  9]   3.00-4.00   sec  8.33 MBytes  69.8 Mbits/sec   95   43.8 KBytes       
[SUM]   3.00-4.00   sec  31.4 MBytes   263 Mbits/sec  348             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  8.08 MBytes  67.8 Mbits/sec  151   36.8 KBytes       
[  6]   4.00-5.00   sec  15.8 MBytes   133 Mbits/sec   89   70.7 KBytes       
[  9]   4.00-5.00   sec  7.15 MBytes  60.0 Mbits/sec  104   14.1 KBytes       
[SUM]   4.00-5.00   sec  31.1 MBytes   261 Mbits/sec  344             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  12.1 MBytes   102 Mbits/sec  168   18.4 KBytes       
[  6]   5.00-6.00   sec  7.33 MBytes  61.5 Mbits/sec  149   11.3 KBytes       
[  9]   5.00-6.00   sec  11.5 MBytes  96.4 Mbits/sec   83   58.0 KBytes       
[SUM]   5.00-6.00   sec  30.9 MBytes   260 Mbits/sec  400             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  10.9 MBytes  91.2 Mbits/sec  109   35.4 KBytes       
[  6]   6.00-7.00   sec  5.47 MBytes  45.9 Mbits/sec  105   17.0 KBytes       
[  9]   6.00-7.00   sec  14.6 MBytes   122 Mbits/sec  115   32.5 KBytes       
[SUM]   6.00-7.00   sec  30.9 MBytes   260 Mbits/sec  329             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  7.15 MBytes  60.0 Mbits/sec  177   12.7 KBytes       
[  6]   7.00-8.00   sec  4.60 MBytes  38.6 Mbits/sec  138   5.66 KBytes       
[  9]   7.00-8.00   sec  21.1 MBytes   177 Mbits/sec   75   46.7 KBytes       
[SUM]   7.00-8.00   sec  32.8 MBytes   275 Mbits/sec  390             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  20.8 MBytes   174 Mbits/sec   94   22.6 KBytes       
[  6]   8.00-9.00   sec  4.78 MBytes  40.1 Mbits/sec  117   21.2 KBytes       
[  9]   8.00-9.00   sec  6.77 MBytes  56.8 Mbits/sec   92   32.5 KBytes       
[SUM]   8.00-9.00   sec  32.3 MBytes   271 Mbits/sec  303             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  8.33 MBytes  69.9 Mbits/sec  179   2.83 KBytes       
[  6]   9.00-10.00  sec  18.4 MBytes   154 Mbits/sec   97   55.1 KBytes       
[  9]   9.00-10.00  sec  5.28 MBytes  44.3 Mbits/sec  121   5.66 KBytes       
[SUM]   9.00-10.00  sec  32.0 MBytes   268 Mbits/sec  397             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   105 MBytes  87.7 Mbits/sec  1392             sender
[  4]   0.00-10.00  sec   104 MBytes  87.2 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   116 MBytes  97.4 Mbits/sec  1132             sender
[  6]   0.00-10.00  sec   115 MBytes  96.7 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  98.2 MBytes  82.4 Mbits/sec  1026             sender
[  9]   0.00-10.00  sec  97.6 MBytes  81.9 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   319 MBytes   267 Mbits/sec  3550             sender
[SUM]   0.00-10.00  sec   317 MBytes   266 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60946 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60948 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60950 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  4.26 MBytes  35.8 Mbits/sec                  
[  6]   0.00-1.00   sec  4.27 MBytes  35.8 Mbits/sec                  
[  9]   0.00-1.00   sec  2.93 MBytes  24.6 Mbits/sec                  
[SUM]   0.00-1.00   sec  11.5 MBytes  96.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.72 MBytes  31.2 Mbits/sec                  
[  6]   1.00-2.00   sec  3.84 MBytes  32.2 Mbits/sec                  
[  9]   1.00-2.00   sec  3.83 MBytes  32.1 Mbits/sec                  
[SUM]   1.00-2.00   sec  11.4 MBytes  95.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.73 MBytes  31.3 Mbits/sec                  
[  6]   2.00-3.00   sec  3.60 MBytes  30.2 Mbits/sec                  
[  9]   2.00-3.00   sec  3.62 MBytes  30.4 Mbits/sec                  
[SUM]   2.00-3.00   sec  11.0 MBytes  91.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  6]   3.00-4.00   sec  3.62 MBytes  30.4 Mbits/sec                  
[  9]   3.00-4.00   sec  3.50 MBytes  29.3 Mbits/sec                  
[SUM]   3.00-4.00   sec  10.6 MBytes  89.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  3.52 MBytes  29.5 Mbits/sec                  
[  6]   4.00-5.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   4.00-5.00   sec  3.57 MBytes  30.0 Mbits/sec                  
[SUM]   4.00-5.00   sec  10.6 MBytes  88.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.60 MBytes  30.2 Mbits/sec                  
[  6]   5.00-6.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   5.00-6.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[SUM]   5.00-6.00   sec  10.6 MBytes  88.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.51 MBytes  29.4 Mbits/sec                  
[  6]   6.00-7.00   sec  3.56 MBytes  29.8 Mbits/sec                  
[  9]   6.00-7.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[SUM]   6.00-7.00   sec  10.6 MBytes  88.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  6]   7.00-8.00   sec  3.55 MBytes  29.8 Mbits/sec                  
[  9]   7.00-8.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[SUM]   7.00-8.00   sec  10.5 MBytes  88.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  6]   8.00-9.00   sec  3.49 MBytes  29.3 Mbits/sec                  
[  9]   8.00-9.00   sec  3.62 MBytes  30.3 Mbits/sec                  
[SUM]   8.00-9.00   sec  10.6 MBytes  89.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.53 MBytes  29.6 Mbits/sec                  
[  6]   9.00-10.00  sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   9.00-10.00  sec  3.51 MBytes  29.4 Mbits/sec                  
[SUM]   9.00-10.00  sec  10.5 MBytes  88.4 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  37.3 MBytes  31.3 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  37.3 MBytes  31.3 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  37.4 MBytes  31.4 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  37.4 MBytes  31.4 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  36.0 MBytes  30.2 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  36.0 MBytes  30.2 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   111 MBytes  92.9 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   111 MBytes  92.9 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 59012 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 48433 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 53544 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  37.2 MBytes   312 Mbits/sec  4757  
[  6]   0.00-1.00   sec  37.2 MBytes   312 Mbits/sec  4757  
[  9]   0.00-1.00   sec  37.2 MBytes   312 Mbits/sec  4757  
[SUM]   0.00-1.00   sec   111 MBytes   935 Mbits/sec  14271  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.2 MBytes   312 Mbits/sec  4760  
[  6]   1.00-2.00   sec  37.2 MBytes   312 Mbits/sec  4760  
[  9]   1.00-2.00   sec  37.2 MBytes   312 Mbits/sec  4760  
[SUM]   1.00-2.00   sec   112 MBytes   936 Mbits/sec  14280  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.2 MBytes   312 Mbits/sec  4767  
[  6]   2.00-3.00   sec  37.2 MBytes   312 Mbits/sec  4767  
[  9]   2.00-3.00   sec  37.2 MBytes   312 Mbits/sec  4767  
[SUM]   2.00-3.00   sec   112 MBytes   937 Mbits/sec  14301  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  36.4 MBytes   305 Mbits/sec  4653  
[  6]   3.00-4.00   sec  36.4 MBytes   305 Mbits/sec  4653  
[  9]   3.00-4.00   sec  36.4 MBytes   305 Mbits/sec  4653  
[SUM]   3.00-4.00   sec   109 MBytes   915 Mbits/sec  13959  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  36.8 MBytes   308 Mbits/sec  4705  
[  6]   4.00-5.00   sec  36.8 MBytes   308 Mbits/sec  4705  
[  9]   4.00-5.00   sec  36.8 MBytes   308 Mbits/sec  4705  
[SUM]   4.00-5.00   sec   110 MBytes   925 Mbits/sec  14115  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[  6]   5.00-6.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[  9]   5.00-6.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[SUM]   5.00-6.00   sec   112 MBytes   940 Mbits/sec  14349  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  36.8 MBytes   308 Mbits/sec  4706  
[  6]   6.00-7.00   sec  36.8 MBytes   308 Mbits/sec  4706  
[  9]   6.00-7.00   sec  36.8 MBytes   308 Mbits/sec  4706  
[SUM]   6.00-7.00   sec   110 MBytes   925 Mbits/sec  14118  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.1 MBytes   311 Mbits/sec  4748  
[  6]   7.00-8.00   sec  37.1 MBytes   311 Mbits/sec  4748  
[  9]   7.00-8.00   sec  37.1 MBytes   311 Mbits/sec  4748  
[SUM]   7.00-8.00   sec   111 MBytes   933 Mbits/sec  14244  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4795  
[  6]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4795  
[  9]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4795  
[SUM]   8.00-9.00   sec   112 MBytes   943 Mbits/sec  14385  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  36.4 MBytes   305 Mbits/sec  4657  
[  6]   9.00-10.00  sec  36.4 MBytes   305 Mbits/sec  4657  
[  9]   9.00-10.00  sec  36.4 MBytes   305 Mbits/sec  4657  
[SUM]   9.00-10.00  sec   109 MBytes   915 Mbits/sec  13971  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   370 MBytes   310 Mbits/sec  11560.586 ms  43885/43992 (1e+02%)  
[  4] Sent 43992 datagrams
[  6]   0.00-10.00  sec   370 MBytes   310 Mbits/sec  61901.202 ms  43881/43962 (1e+02%)  
[  6] Sent 43962 datagrams
[  9]   0.00-10.00  sec   370 MBytes   310 Mbits/sec  20664.430 ms  43892/43990 (1e+02%)  
[  9] Sent 43990 datagrams
[SUM]   0.00-10.00  sec  1.08 GBytes   931 Mbits/sec  31375.406 ms  131658/131944 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 40865 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 54355 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 45385 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  9.77 MBytes  82.0 Mbits/sec  0.086 ms  0/1251 (0%)  
[  6]   0.00-1.00   sec  9.77 MBytes  82.0 Mbits/sec  0.031 ms  0/1251 (0%)  
[  9]   0.00-1.00   sec  9.76 MBytes  81.9 Mbits/sec  0.081 ms  0/1249 (0%)  
[SUM]   0.00-1.00   sec  29.3 MBytes   246 Mbits/sec  0.066 ms  0/3751 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  9.76 MBytes  81.9 Mbits/sec  0.222 ms  0/1249 (0%)  
[  6]   1.00-2.00   sec  9.75 MBytes  81.8 Mbits/sec  0.248 ms  0/1248 (0%)  
[  9]   1.00-2.00   sec  9.76 MBytes  81.9 Mbits/sec  0.237 ms  0/1249 (0%)  
[SUM]   1.00-2.00   sec  29.3 MBytes   245 Mbits/sec  0.236 ms  0/3746 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  9.75 MBytes  81.8 Mbits/sec  0.049 ms  0/1248 (0%)  
[  6]   2.00-3.00   sec  9.76 MBytes  81.9 Mbits/sec  0.067 ms  0/1249 (0%)  
[  9]   2.00-3.00   sec  9.76 MBytes  81.9 Mbits/sec  0.047 ms  0/1249 (0%)  
[SUM]   2.00-3.00   sec  29.3 MBytes   245 Mbits/sec  0.054 ms  0/3746 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  9.77 MBytes  82.0 Mbits/sec  0.029 ms  0/1251 (0%)  
[  6]   3.00-4.00   sec  9.77 MBytes  82.0 Mbits/sec  0.037 ms  0/1251 (0%)  
[  9]   3.00-4.00   sec  9.77 MBytes  81.9 Mbits/sec  0.042 ms  0/1250 (0%)  
[SUM]   3.00-4.00   sec  29.3 MBytes   246 Mbits/sec  0.036 ms  0/3752 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  9.79 MBytes  82.1 Mbits/sec  0.075 ms  0/1253 (0%)  
[  6]   4.00-5.00   sec  9.79 MBytes  82.1 Mbits/sec  0.035 ms  0/1253 (0%)  
[  9]   4.00-5.00   sec  9.80 MBytes  82.2 Mbits/sec  0.051 ms  0/1254 (0%)  
[SUM]   4.00-5.00   sec  29.4 MBytes   246 Mbits/sec  0.054 ms  0/3760 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  9.71 MBytes  81.5 Mbits/sec  0.040 ms  0/1243 (0%)  
[  6]   5.00-6.00   sec  9.70 MBytes  81.4 Mbits/sec  0.052 ms  0/1242 (0%)  
[  9]   5.00-6.00   sec  9.70 MBytes  81.4 Mbits/sec  0.044 ms  0/1242 (0%)  
[SUM]   5.00-6.00   sec  29.1 MBytes   244 Mbits/sec  0.046 ms  0/3727 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  9.76 MBytes  81.9 Mbits/sec  0.081 ms  0/1249 (0%)  
[  6]   6.00-7.00   sec  9.77 MBytes  81.9 Mbits/sec  0.057 ms  0/1250 (0%)  
[  9]   6.00-7.00   sec  9.76 MBytes  81.9 Mbits/sec  0.079 ms  0/1249 (0%)  
[SUM]   6.00-7.00   sec  29.3 MBytes   246 Mbits/sec  0.072 ms  0/3748 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  9.75 MBytes  81.8 Mbits/sec  0.065 ms  0/1248 (0%)  
[  6]   7.00-8.00   sec  9.74 MBytes  81.7 Mbits/sec  0.066 ms  0/1247 (0%)  
[  9]   7.00-8.00   sec  9.75 MBytes  81.8 Mbits/sec  0.037 ms  0/1248 (0%)  
[SUM]   7.00-8.00   sec  29.2 MBytes   245 Mbits/sec  0.056 ms  0/3743 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  9.73 MBytes  81.7 Mbits/sec  0.071 ms  0/1246 (0%)  
[  6]   8.00-9.00   sec  9.74 MBytes  81.7 Mbits/sec  0.057 ms  0/1247 (0%)  
[  9]   8.00-9.00   sec  9.73 MBytes  81.7 Mbits/sec  0.052 ms  0/1246 (0%)  
[SUM]   8.00-9.00   sec  29.2 MBytes   245 Mbits/sec  0.060 ms  0/3739 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  9.75 MBytes  81.8 Mbits/sec  0.056 ms  0/1248 (0%)  
[  6]   9.00-10.00  sec  9.74 MBytes  81.7 Mbits/sec  0.083 ms  0/1247 (0%)  
[  9]   9.00-10.00  sec  9.75 MBytes  81.8 Mbits/sec  0.043 ms  0/1248 (0%)  
[SUM]   9.00-10.00  sec  29.2 MBytes   245 Mbits/sec  0.061 ms  0/3743 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  97.5 MBytes  81.8 Mbits/sec  0.056 ms  0/12486 (0%)  
[  4] Sent 12486 datagrams
[  6]   0.00-10.00  sec  97.5 MBytes  81.8 Mbits/sec  0.086 ms  0/12486 (0%)  
[  6] Sent 12486 datagrams
[  9]   0.00-10.00  sec  97.5 MBytes  81.8 Mbits/sec  0.041 ms  0/12485 (0%)  
[  9] Sent 12485 datagrams
[SUM]   0.00-10.00  sec   293 MBytes   245 Mbits/sec  0.061 ms  0/37457 (0%)  

iperf Done.
+ : ':::::::[' configuration everything ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60974 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  38.3 MBytes   321 Mbits/sec    4    163 KBytes       
[  4]   1.00-2.00   sec  37.3 MBytes   313 Mbits/sec   44    147 KBytes       
[  4]   2.00-3.00   sec  38.2 MBytes   320 Mbits/sec   45    214 KBytes       
[  4]   3.00-4.00   sec  35.7 MBytes   299 Mbits/sec   43    133 KBytes       
[  4]   4.00-5.00   sec  30.3 MBytes   254 Mbits/sec   96   82.0 KBytes       
[  4]   5.00-6.00   sec  19.6 MBytes   164 Mbits/sec   58    115 KBytes       
[  4]   6.00-7.00   sec  27.8 MBytes   234 Mbits/sec   31    144 KBytes       
[  4]   7.00-8.00   sec  28.8 MBytes   242 Mbits/sec   36   49.5 KBytes       
[  4]   8.00-9.00   sec  25.9 MBytes   217 Mbits/sec   92   93.3 KBytes       
[  4]   9.00-10.00  sec  35.9 MBytes   301 Mbits/sec    4    134 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   318 MBytes   267 Mbits/sec  453             sender
[  4]   0.00-10.00  sec   317 MBytes   266 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60978 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  10.6 MBytes  89.3 Mbits/sec                  
[  4]   1.00-2.00   sec  10.6 MBytes  88.9 Mbits/sec                  
[  4]   2.00-3.00   sec  10.5 MBytes  88.3 Mbits/sec                  
[  4]   3.00-4.00   sec  10.6 MBytes  89.3 Mbits/sec                  
[  4]   4.00-5.00   sec  10.6 MBytes  89.2 Mbits/sec                  
[  4]   5.00-6.00   sec  10.4 MBytes  87.6 Mbits/sec                  
[  4]   6.00-7.00   sec  10.7 MBytes  90.1 Mbits/sec                  
[  4]   7.00-8.00   sec  10.7 MBytes  89.6 Mbits/sec                  
[  4]   8.00-9.00   sec  10.7 MBytes  90.0 Mbits/sec                  
[  4]   9.00-10.00  sec  10.6 MBytes  89.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   107 MBytes  89.4 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   107 MBytes  89.4 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 59648 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   138 Mbits/sec  2105  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2290  
[  4]   2.00-3.00   sec  18.0 MBytes   151 Mbits/sec  2308  
[  4]   3.00-4.00   sec  17.7 MBytes   149 Mbits/sec  2267  
[  4]   4.00-5.00   sec  18.0 MBytes   151 Mbits/sec  2301  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2285  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2293  
[  4]   7.00-8.00   sec  17.8 MBytes   149 Mbits/sec  2274  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2291  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  0.947 ms  876/1134 (77%)  
[  4] Sent 1134 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 55359 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  17.9 MBytes   150 Mbits/sec  0.172 ms  0/2286 (0%)  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  0.109 ms  0/2290 (0%)  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  0.044 ms  0/2290 (0%)  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  0.044 ms  0/2289 (0%)  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  0.060 ms  0/2288 (0%)  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  0.106 ms  0/2289 (0%)  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  0.058 ms  0/2289 (0%)  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  0.070 ms  0/2288 (0%)  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  0.059 ms  0/2289 (0%)  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  0.093 ms  0/2289 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   179 MBytes   150 Mbits/sec  0.093 ms  0/22887 (0%)  
[  4] Sent 22887 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 32960 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  54.3 MBytes   456 Mbits/sec  6953  
[  4]   1.00-2.00   sec  60.5 MBytes   508 Mbits/sec  7748  
[  4]   2.00-3.00   sec  58.5 MBytes   490 Mbits/sec  7483  
[  4]   3.00-4.00   sec  60.6 MBytes   508 Mbits/sec  7754  
[  4]   4.00-5.00   sec  58.9 MBytes   494 Mbits/sec  7539  
[  4]   5.00-6.00   sec  60.8 MBytes   510 Mbits/sec  7777  
[  4]   6.00-7.00   sec  57.9 MBytes   486 Mbits/sec  7415  
[  4]   7.00-8.00   sec  59.6 MBytes   500 Mbits/sec  7628  
[  4]   8.00-9.00   sec  61.3 MBytes   514 Mbits/sec  7849  
[  4]   9.00-10.00  sec  58.2 MBytes   488 Mbits/sec  7451  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   591 MBytes   495 Mbits/sec  0.307 ms  64569/64890 (1e+02%)  
[  4] Sent 64890 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 36292 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  27.7 MBytes   232 Mbits/sec  0.061 ms  0/3546 (0%)  
[  4]   1.00-2.00   sec  27.9 MBytes   234 Mbits/sec  0.033 ms  0/3570 (0%)  
[  4]   2.00-3.00   sec  27.8 MBytes   233 Mbits/sec  0.052 ms  0/3563 (0%)  
[  4]   3.00-4.00   sec  27.7 MBytes   232 Mbits/sec  0.038 ms  0/3540 (0%)  
[  4]   4.00-5.00   sec  27.9 MBytes   234 Mbits/sec  0.020 ms  0/3567 (0%)  
[  4]   5.00-6.00   sec  27.9 MBytes   234 Mbits/sec  0.024 ms  0/3571 (0%)  
[  4]   6.00-7.00   sec  27.9 MBytes   234 Mbits/sec  0.041 ms  0/3571 (0%)  
[  4]   7.00-8.00   sec  27.8 MBytes   233 Mbits/sec  0.021 ms  0/3562 (0%)  
[  4]   8.00-9.00   sec  27.7 MBytes   233 Mbits/sec  0.019 ms  0/3551 (0%)  
[  4]   9.00-10.00  sec  27.8 MBytes   233 Mbits/sec  0.040 ms  0/3552 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   278 MBytes   233 Mbits/sec  0.041 ms  0/35594 (0%)  
[  4] Sent 35594 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 44464 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec   103 MBytes   861 Mbits/sec  13139  
[  4]   1.00-2.00   sec   103 MBytes   864 Mbits/sec  13176  
[  4]   2.00-3.00   sec   103 MBytes   865 Mbits/sec  13204  
[  4]   3.00-4.00   sec   104 MBytes   869 Mbits/sec  13257  
[  4]   4.00-5.00   sec   103 MBytes   866 Mbits/sec  13219  
[  4]   5.00-6.00   sec   103 MBytes   864 Mbits/sec  13184  
[  4]   6.00-7.00   sec   103 MBytes   867 Mbits/sec  13223  
[  4]   7.00-8.00   sec   103 MBytes   861 Mbits/sec  13143  
[  4]   8.00-9.00   sec   103 MBytes   868 Mbits/sec  13237  
[  4]   9.00-10.00  sec   103 MBytes   867 Mbits/sec  13229  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.01 GBytes   865 Mbits/sec  0.356 ms  131640/131963 (1e+02%)  
[  4] Sent 131963 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 53589 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  22.9 MBytes   192 Mbits/sec  0.090 ms  0/2930 (0%)  
[  4]   1.00-2.00   sec  22.8 MBytes   191 Mbits/sec  0.072 ms  0/2912 (0%)  
[  4]   2.00-3.00   sec  23.1 MBytes   194 Mbits/sec  0.127 ms  0/2963 (0%)  
[  4]   3.00-4.00   sec  22.8 MBytes   191 Mbits/sec  0.101 ms  0/2922 (0%)  
[  4]   4.00-5.00   sec  22.9 MBytes   192 Mbits/sec  0.081 ms  0/2927 (0%)  
[  4]   5.00-6.00   sec  22.9 MBytes   192 Mbits/sec  0.132 ms  0/2937 (0%)  
[  4]   6.00-7.00   sec  22.9 MBytes   192 Mbits/sec  0.120 ms  0/2937 (0%)  
[  4]   7.00-8.00   sec  22.9 MBytes   192 Mbits/sec  0.122 ms  0/2927 (0%)  
[  4]   8.00-9.00   sec  22.7 MBytes   191 Mbits/sec  0.083 ms  0/2911 (0%)  
[  4]   9.00-10.00  sec  23.1 MBytes   193 Mbits/sec  0.128 ms  0/2951 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   229 MBytes   192 Mbits/sec  0.121 ms  0/29318 (0%)  
[  4] Sent 29318 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 32886 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 32888 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 32890 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  7.95 MBytes  66.7 Mbits/sec  119   11.3 KBytes       
[  6]   0.00-1.00   sec  14.4 MBytes   121 Mbits/sec   92   22.6 KBytes       
[  9]   0.00-1.00   sec  10.4 MBytes  87.5 Mbits/sec  101   53.7 KBytes       
[SUM]   0.00-1.00   sec  32.8 MBytes   275 Mbits/sec  312             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  5.90 MBytes  49.5 Mbits/sec  109   25.5 KBytes       
[  6]   1.00-2.00   sec  12.6 MBytes   105 Mbits/sec   88   53.7 KBytes       
[  9]   1.00-2.00   sec  13.5 MBytes   114 Mbits/sec  114   17.0 KBytes       
[SUM]   1.00-2.00   sec  32.0 MBytes   268 Mbits/sec  311             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.39 MBytes  62.0 Mbits/sec  109   24.0 KBytes       
[  6]   2.00-3.00   sec  23.2 MBytes   195 Mbits/sec  100   32.5 KBytes       
[  9]   2.00-3.00   sec  3.11 MBytes  26.1 Mbits/sec   84   14.1 KBytes       
[SUM]   2.00-3.00   sec  33.7 MBytes   283 Mbits/sec  293             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  7.71 MBytes  64.6 Mbits/sec  109   56.6 KBytes       
[  6]   3.00-4.00   sec  13.7 MBytes   115 Mbits/sec   76   31.1 KBytes       
[  9]   3.00-4.00   sec  10.4 MBytes  87.1 Mbits/sec  129   35.4 KBytes       
[SUM]   3.00-4.00   sec  31.8 MBytes   267 Mbits/sec  314             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  9.94 MBytes  83.4 Mbits/sec  113   39.6 KBytes       
[  6]   4.00-5.00   sec  6.34 MBytes  53.2 Mbits/sec  143   52.3 KBytes       
[  9]   4.00-5.00   sec  16.1 MBytes   135 Mbits/sec   98   22.6 KBytes       
[SUM]   4.00-5.00   sec  32.4 MBytes   272 Mbits/sec  354             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  6.03 MBytes  50.6 Mbits/sec  158   15.6 KBytes       
[  6]   5.00-6.00   sec  23.9 MBytes   201 Mbits/sec  111   53.7 KBytes       
[  9]   5.00-6.00   sec  3.29 MBytes  27.6 Mbits/sec  118   9.90 KBytes       
[SUM]   5.00-6.00   sec  33.2 MBytes   279 Mbits/sec  387             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  10.8 MBytes  90.2 Mbits/sec  121   32.5 KBytes       
[  6]   6.00-7.00   sec  11.0 MBytes  92.3 Mbits/sec  160   12.7 KBytes       
[  9]   6.00-7.00   sec  10.7 MBytes  89.6 Mbits/sec   79   41.0 KBytes       
[SUM]   6.00-7.00   sec  32.4 MBytes   272 Mbits/sec  360             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  16.7 MBytes   140 Mbits/sec  142   38.2 KBytes       
[  6]   7.00-8.00   sec  5.10 MBytes  42.7 Mbits/sec  114   12.7 KBytes       
[  9]   7.00-8.00   sec  9.63 MBytes  80.8 Mbits/sec   85   18.4 KBytes       
[SUM]   7.00-8.00   sec  31.4 MBytes   263 Mbits/sec  341             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  20.3 MBytes   170 Mbits/sec  127   5.66 KBytes       
[  6]   8.00-9.00   sec  6.52 MBytes  54.7 Mbits/sec  123   39.6 KBytes       
[  9]   8.00-9.00   sec  5.90 MBytes  49.5 Mbits/sec  133   43.8 KBytes       
[SUM]   8.00-9.00   sec  32.7 MBytes   275 Mbits/sec  383             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  6.46 MBytes  54.2 Mbits/sec  116   17.0 KBytes       
[  6]   9.00-10.00  sec  13.5 MBytes   113 Mbits/sec  105   79.2 KBytes       
[  9]   9.00-10.00  sec  12.2 MBytes   103 Mbits/sec   94   11.3 KBytes       
[SUM]   9.00-10.00  sec  32.2 MBytes   270 Mbits/sec  315             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  99.1 MBytes  83.1 Mbits/sec  1223             sender
[  4]   0.00-10.00  sec  98.4 MBytes  82.5 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   130 MBytes   109 Mbits/sec  1112             sender
[  6]   0.00-10.00  sec   130 MBytes   109 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  95.3 MBytes  80.0 Mbits/sec  1035             sender
[  9]   0.00-10.00  sec  94.7 MBytes  79.4 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   325 MBytes   272 Mbits/sec  3370             sender
[SUM]   0.00-10.00  sec   323 MBytes   271 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 32922 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 32924 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 32926 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  4.00 MBytes  33.6 Mbits/sec                  
[  6]   0.00-1.00   sec  3.94 MBytes  33.1 Mbits/sec                  
[  9]   0.00-1.00   sec  2.62 MBytes  22.0 Mbits/sec                  
[SUM]   0.00-1.00   sec  10.6 MBytes  88.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  6]   1.00-2.00   sec  3.52 MBytes  29.5 Mbits/sec                  
[  9]   1.00-2.00   sec  3.51 MBytes  29.5 Mbits/sec                  
[SUM]   1.00-2.00   sec  10.5 MBytes  88.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  6]   2.00-3.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   2.00-3.00   sec  3.56 MBytes  29.8 Mbits/sec                  
[SUM]   2.00-3.00   sec  10.6 MBytes  88.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.52 MBytes  29.5 Mbits/sec                  
[  6]   3.00-4.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   3.00-4.00   sec  3.55 MBytes  29.8 Mbits/sec                  
[SUM]   3.00-4.00   sec  10.6 MBytes  88.7 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  3.55 MBytes  29.7 Mbits/sec                  
[  6]   4.00-5.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   4.00-5.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[SUM]   4.00-5.00   sec  10.5 MBytes  88.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.56 MBytes  29.9 Mbits/sec                  
[  6]   5.00-6.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   5.00-6.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[SUM]   5.00-6.00   sec  10.6 MBytes  88.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.56 MBytes  29.8 Mbits/sec                  
[  6]   6.00-7.00   sec  3.62 MBytes  30.4 Mbits/sec                  
[  9]   6.00-7.00   sec  3.55 MBytes  29.8 Mbits/sec                  
[SUM]   6.00-7.00   sec  10.7 MBytes  90.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.67 MBytes  30.8 Mbits/sec                  
[  6]   7.00-8.00   sec  3.62 MBytes  30.4 Mbits/sec                  
[  9]   7.00-8.00   sec  3.58 MBytes  30.1 Mbits/sec                  
[SUM]   7.00-8.00   sec  10.9 MBytes  91.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.53 MBytes  29.6 Mbits/sec                  
[  6]   8.00-9.00   sec  3.52 MBytes  29.6 Mbits/sec                  
[  9]   8.00-9.00   sec  3.50 MBytes  29.4 Mbits/sec                  
[SUM]   8.00-9.00   sec  10.6 MBytes  88.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.50 MBytes  29.4 Mbits/sec                  
[  6]   9.00-10.00  sec  3.60 MBytes  30.2 Mbits/sec                  
[  9]   9.00-10.00  sec  3.58 MBytes  30.0 Mbits/sec                  
[SUM]   9.00-10.00  sec  10.7 MBytes  89.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  36.2 MBytes  30.4 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  36.2 MBytes  30.4 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  36.2 MBytes  30.4 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  36.2 MBytes  30.4 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  34.8 MBytes  29.2 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  34.8 MBytes  29.2 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   107 MBytes  89.9 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   107 MBytes  89.9 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 33929 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 48224 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 59000 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  37.3 MBytes   313 Mbits/sec  4779  
[  6]   0.00-1.00   sec  37.3 MBytes   313 Mbits/sec  4779  
[  9]   0.00-1.00   sec  37.3 MBytes   313 Mbits/sec  4779  
[SUM]   0.00-1.00   sec   112 MBytes   940 Mbits/sec  14337  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.5 MBytes   314 Mbits/sec  4798  
[  6]   1.00-2.00   sec  37.5 MBytes   314 Mbits/sec  4798  
[  9]   1.00-2.00   sec  37.5 MBytes   314 Mbits/sec  4798  
[SUM]   1.00-2.00   sec   112 MBytes   943 Mbits/sec  14394  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.4 MBytes   314 Mbits/sec  4785  
[  6]   2.00-3.00   sec  37.4 MBytes   314 Mbits/sec  4785  
[  9]   2.00-3.00   sec  37.4 MBytes   314 Mbits/sec  4785  
[SUM]   2.00-3.00   sec   112 MBytes   941 Mbits/sec  14355  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  36.5 MBytes   306 Mbits/sec  4667  
[  6]   3.00-4.00   sec  36.5 MBytes   306 Mbits/sec  4667  
[  9]   3.00-4.00   sec  36.5 MBytes   306 Mbits/sec  4667  
[SUM]   3.00-4.00   sec   109 MBytes   918 Mbits/sec  14001  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4789  
[  6]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4789  
[  9]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4789  
[SUM]   4.00-5.00   sec   112 MBytes   942 Mbits/sec  14367  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4799  
[  6]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4799  
[  9]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4799  
[SUM]   5.00-6.00   sec   112 MBytes   944 Mbits/sec  14397  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.5 MBytes   315 Mbits/sec  4805  
[  6]   6.00-7.00   sec  37.5 MBytes   315 Mbits/sec  4805  
[  9]   6.00-7.00   sec  37.5 MBytes   315 Mbits/sec  4805  
[SUM]   6.00-7.00   sec   113 MBytes   945 Mbits/sec  14415  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.5 MBytes   314 Mbits/sec  4797  
[  6]   7.00-8.00   sec  37.5 MBytes   314 Mbits/sec  4797  
[  9]   7.00-8.00   sec  37.5 MBytes   314 Mbits/sec  4797  
[SUM]   7.00-8.00   sec   112 MBytes   943 Mbits/sec  14391  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.4 MBytes   314 Mbits/sec  4788  
[  6]   8.00-9.00   sec  37.4 MBytes   314 Mbits/sec  4788  
[  9]   8.00-9.00   sec  37.4 MBytes   314 Mbits/sec  4788  
[SUM]   8.00-9.00   sec   112 MBytes   941 Mbits/sec  14364  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.4 MBytes   314 Mbits/sec  4788  
[  6]   9.00-10.00  sec  37.4 MBytes   314 Mbits/sec  4788  
[  9]   9.00-10.00  sec  37.4 MBytes   314 Mbits/sec  4788  
[SUM]   9.00-10.00  sec   112 MBytes   941 Mbits/sec  14364  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  14029.974 ms  43922/44026 (1e+02%)  
[  4] Sent 44026 datagrams
[  6]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  34629.518 ms  43938/44028 (1e+02%)  
[  6] Sent 44028 datagrams
[  9]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  19373.377 ms  43925/44024 (1e+02%)  
[  9] Sent 44024 datagrams
[SUM]   0.00-10.00  sec  1.09 GBytes   940 Mbits/sec  22677.623 ms  131785/132078 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 59494 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 59987 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 37065 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  9.70 MBytes  81.4 Mbits/sec  0.056 ms  0/1242 (0%)  
[  6]   0.00-1.00   sec  9.70 MBytes  81.4 Mbits/sec  0.030 ms  0/1242 (0%)  
[  9]   0.00-1.00   sec  9.69 MBytes  81.3 Mbits/sec  0.028 ms  0/1240 (0%)  
[SUM]   0.00-1.00   sec  29.1 MBytes   244 Mbits/sec  0.038 ms  0/3724 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  9.71 MBytes  81.5 Mbits/sec  0.114 ms  0/1243 (0%)  
[  6]   1.00-2.00   sec  9.71 MBytes  81.5 Mbits/sec  0.046 ms  0/1243 (0%)  
[  9]   1.00-2.00   sec  9.71 MBytes  81.5 Mbits/sec  0.037 ms  0/1243 (0%)  
[SUM]   1.00-2.00   sec  29.1 MBytes   244 Mbits/sec  0.066 ms  0/3729 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  9.70 MBytes  81.4 Mbits/sec  0.054 ms  0/1242 (0%)  
[  6]   2.00-3.00   sec  9.70 MBytes  81.4 Mbits/sec  0.064 ms  0/1242 (0%)  
[  9]   2.00-3.00   sec  9.71 MBytes  81.5 Mbits/sec  0.042 ms  0/1243 (0%)  
[SUM]   2.00-3.00   sec  29.1 MBytes   244 Mbits/sec  0.053 ms  0/3727 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  9.74 MBytes  81.7 Mbits/sec  0.061 ms  0/1247 (0%)  
[  6]   3.00-4.00   sec  9.73 MBytes  81.7 Mbits/sec  0.016 ms  0/1246 (0%)  
[  9]   3.00-4.00   sec  9.73 MBytes  81.7 Mbits/sec  0.070 ms  0/1246 (0%)  
[SUM]   3.00-4.00   sec  29.2 MBytes   245 Mbits/sec  0.049 ms  0/3739 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  9.75 MBytes  81.8 Mbits/sec  0.065 ms  0/1248 (0%)  
[  6]   4.00-5.00   sec  9.76 MBytes  81.9 Mbits/sec  0.018 ms  0/1249 (0%)  
[  9]   4.00-5.00   sec  9.75 MBytes  81.8 Mbits/sec  0.049 ms  0/1248 (0%)  
[SUM]   4.00-5.00   sec  29.3 MBytes   245 Mbits/sec  0.044 ms  0/3745 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  9.73 MBytes  81.7 Mbits/sec  0.062 ms  0/1246 (0%)  
[  6]   5.00-6.00   sec  9.73 MBytes  81.7 Mbits/sec  0.031 ms  0/1246 (0%)  
[  9]   5.00-6.00   sec  9.74 MBytes  81.7 Mbits/sec  0.069 ms  0/1247 (0%)  
[SUM]   5.00-6.00   sec  29.2 MBytes   245 Mbits/sec  0.054 ms  0/3739 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  9.73 MBytes  81.7 Mbits/sec  0.071 ms  0/1246 (0%)  
[  6]   6.00-7.00   sec  9.73 MBytes  81.7 Mbits/sec  0.048 ms  0/1246 (0%)  
[  9]   6.00-7.00   sec  9.73 MBytes  81.6 Mbits/sec  0.051 ms  0/1245 (0%)  
[SUM]   6.00-7.00   sec  29.2 MBytes   245 Mbits/sec  0.057 ms  0/3737 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  9.73 MBytes  81.6 Mbits/sec  0.079 ms  0/1245 (0%)  
[  6]   7.00-8.00   sec  9.73 MBytes  81.6 Mbits/sec  0.091 ms  0/1245 (0%)  
[  9]   7.00-8.00   sec  9.73 MBytes  81.7 Mbits/sec  0.052 ms  0/1246 (0%)  
[SUM]   7.00-8.00   sec  29.2 MBytes   245 Mbits/sec  0.074 ms  0/3736 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  9.73 MBytes  81.6 Mbits/sec  0.038 ms  0/1245 (0%)  
[  6]   8.00-9.00   sec  9.73 MBytes  81.6 Mbits/sec  0.036 ms  0/1245 (0%)  
[  9]   8.00-9.00   sec  9.73 MBytes  81.6 Mbits/sec  0.032 ms  0/1245 (0%)  
[SUM]   8.00-9.00   sec  29.2 MBytes   245 Mbits/sec  0.035 ms  0/3735 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  9.73 MBytes  81.7 Mbits/sec  0.062 ms  0/1246 (0%)  
[  6]   9.00-10.00  sec  9.73 MBytes  81.7 Mbits/sec  0.060 ms  0/1246 (0%)  
[  9]   9.00-10.00  sec  9.73 MBytes  81.6 Mbits/sec  0.061 ms  0/1245 (0%)  
[SUM]   9.00-10.00  sec  29.2 MBytes   245 Mbits/sec  0.061 ms  0/3737 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  97.3 MBytes  81.6 Mbits/sec  0.062 ms  0/12450 (0%)  
[  4] Sent 12450 datagrams
[  6]   0.00-10.00  sec  97.3 MBytes  81.6 Mbits/sec  0.060 ms  0/12450 (0%)  
[  6] Sent 12450 datagrams
[  9]   0.00-10.00  sec  97.3 MBytes  81.6 Mbits/sec  0.058 ms  0/12449 (0%)  
[  9] Sent 12449 datagrams
[SUM]   0.00-10.00  sec   292 MBytes   245 Mbits/sec  0.060 ms  0/37349 (0%)  

iperf Done.
UDP lantiq->host
@host:		# nc -u -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc -u 10.0.0.1 4321
573MiB 0:00:32 [17,4MiB/s] or 385MiB 0:00:22 [21,2MiB/s]

TCP lantiq->host
@host:		# nc -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc 10.0.0.1 4321
280MiB 0:00:39 [7,96MiB/s] or 207MiB 0:00:30 [8,27MiB/s]

UDP host->lantiq
@lantiq:	# nc -u -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc -u 10.0.0.80 4321
2,03GiB 0:00:23 [86,5MiB/s] to 3,36GiB 0:00:38 [98,8MiB/s]

TCP host->lantiq
@lantiq:	# nc -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc 10.0.0.80 4321
694MiB 0:00:25 [25,9MiB/s] or 556MiB 0:00:20 [30,8MiB/s]
+ : ':::::::[' configuration smp_icu_different_vpes ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60300 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  20.9 MBytes   175 Mbits/sec   28   73.5 KBytes       
[  4]   1.00-2.00   sec  20.1 MBytes   169 Mbits/sec   31   62.2 KBytes       
[  4]   2.00-3.00   sec  20.5 MBytes   172 Mbits/sec   28   50.9 KBytes       
[  4]   3.00-4.00   sec  20.7 MBytes   173 Mbits/sec   31   45.2 KBytes       
[  4]   4.00-5.00   sec  20.6 MBytes   173 Mbits/sec   29   42.4 KBytes       
[  4]   5.00-6.00   sec  20.6 MBytes   173 Mbits/sec   24   70.7 KBytes       
[  4]   6.00-7.00   sec  20.7 MBytes   174 Mbits/sec   27   65.0 KBytes       
[  4]   7.00-8.00   sec  20.7 MBytes   174 Mbits/sec   33   56.6 KBytes       
[  4]   8.00-9.00   sec  20.6 MBytes   173 Mbits/sec   34   41.0 KBytes       
[  4]   9.00-10.00  sec  20.8 MBytes   174 Mbits/sec   29   70.7 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   206 MBytes   173 Mbits/sec  294             sender
[  4]   0.00-10.00  sec   206 MBytes   173 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60318 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  10.3 MBytes  86.6 Mbits/sec                  
[  4]   1.00-2.00   sec  10.3 MBytes  86.7 Mbits/sec                  
[  4]   2.00-3.00   sec  10.2 MBytes  85.9 Mbits/sec                  
[  4]   3.00-4.00   sec  10.3 MBytes  86.3 Mbits/sec                  
[  4]   4.00-5.00   sec  10.2 MBytes  85.7 Mbits/sec                  
[  4]   5.00-6.00   sec  10.2 MBytes  85.9 Mbits/sec                  
[  4]   6.00-7.00   sec  10.2 MBytes  85.7 Mbits/sec                  
[  4]   7.00-8.00   sec  10.2 MBytes  85.6 Mbits/sec                  
[  4]   8.00-9.00   sec  10.2 MBytes  85.6 Mbits/sec                  
[  4]   9.00-10.00  sec  10.3 MBytes  86.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   103 MBytes  86.3 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   103 MBytes  86.3 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 53228 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.5 MBytes   138 Mbits/sec  2113  
[  4]   1.00-2.00   sec  17.8 MBytes   150 Mbits/sec  2282  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2286  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2294  
[  4]   4.00-5.00   sec  17.8 MBytes   150 Mbits/sec  2283  
[  4]   5.00-6.00   sec  18.0 MBytes   151 Mbits/sec  2302  
[  4]   6.00-7.00   sec  17.8 MBytes   149 Mbits/sec  2276  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2287  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2290  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2291  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  31933.098 ms  1335/1426 (94%)  
[  4] Sent 1426 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 48506 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.3 MBytes   128 Mbits/sec  0.134 ms  0/1955 (0%)  
[  4]   1.00-2.00   sec  14.4 MBytes   121 Mbits/sec  0.085 ms  0/1841 (0%)  
[  4]   2.00-3.00   sec  14.4 MBytes   121 Mbits/sec  0.095 ms  0/1843 (0%)  
[  4]   3.00-4.00   sec  14.5 MBytes   122 Mbits/sec  0.073 ms  0/1855 (0%)  
[  4]   4.00-5.00   sec  14.5 MBytes   122 Mbits/sec  0.090 ms  0/1856 (0%)  
[  4]   5.00-6.00   sec  14.5 MBytes   122 Mbits/sec  0.105 ms  0/1854 (0%)  
[  4]   6.00-7.00   sec  14.4 MBytes   121 Mbits/sec  0.088 ms  0/1849 (0%)  
[  4]   7.00-8.00   sec  14.4 MBytes   121 Mbits/sec  0.081 ms  0/1843 (0%)  
[  4]   8.00-9.00   sec  14.4 MBytes   121 Mbits/sec  0.096 ms  0/1847 (0%)  
[  4]   9.00-10.00  sec  14.5 MBytes   122 Mbits/sec  0.071 ms  0/1854 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   145 MBytes   122 Mbits/sec  0.091 ms  0/18605 (0%)  
[  4] Sent 18605 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 43155 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  58.9 MBytes   494 Mbits/sec  7533  
[  4]   1.00-2.00   sec  58.7 MBytes   493 Mbits/sec  7516  
[  4]   2.00-3.00   sec  60.5 MBytes   507 Mbits/sec  7744  
[  4]   3.00-4.00   sec  58.0 MBytes   486 Mbits/sec  7422  
[  4]   4.00-5.00   sec  59.5 MBytes   499 Mbits/sec  7620  
[  4]   5.00-6.00   sec  59.0 MBytes   495 Mbits/sec  7548  
[  4]   6.00-7.00   sec  62.1 MBytes   521 Mbits/sec  7945  
[  4]   7.00-8.00   sec  59.3 MBytes   497 Mbits/sec  7590  
[  4]   8.00-9.00   sec  59.8 MBytes   501 Mbits/sec  7649  
[  4]   9.00-10.00  sec  58.8 MBytes   493 Mbits/sec  7527  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   594 MBytes   499 Mbits/sec  1111211.249 ms  64867/64903 (1e+02%)  
[  4] Sent 64903 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 57156 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  14.4 MBytes   121 Mbits/sec  0.088 ms  0/1847 (0%)  
[  4]   1.00-2.00   sec  14.3 MBytes   120 Mbits/sec  0.100 ms  0/1836 (0%)  
[  4]   2.00-3.00   sec  14.3 MBytes   120 Mbits/sec  0.093 ms  0/1834 (0%)  
[  4]   3.00-4.00   sec  14.4 MBytes   121 Mbits/sec  0.105 ms  0/1849 (0%)  
[  4]   4.00-5.00   sec  14.5 MBytes   121 Mbits/sec  0.141 ms  0/1850 (0%)  
[  4]   5.00-6.00   sec  14.5 MBytes   121 Mbits/sec  0.143 ms  0/1850 (0%)  
[  4]   6.00-7.00   sec  14.4 MBytes   121 Mbits/sec  0.148 ms  0/1849 (0%)  
[  4]   7.00-8.00   sec  14.4 MBytes   120 Mbits/sec  0.082 ms  0/1837 (0%)  
[  4]   8.00-9.00   sec  14.4 MBytes   121 Mbits/sec  0.113 ms  0/1840 (0%)  
[  4]   9.00-10.00  sec  14.5 MBytes   121 Mbits/sec  0.115 ms  0/1851 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   144 MBytes   121 Mbits/sec  0.109 ms  0/18449 (0%)  
[  4] Sent 18449 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 32896 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  91.8 MBytes   770 Mbits/sec  11745  
[  4]   1.00-2.00   sec   102 MBytes   856 Mbits/sec  13069  
[  4]   2.00-3.00   sec   103 MBytes   863 Mbits/sec  13176  
[  4]   3.00-4.00   sec   103 MBytes   863 Mbits/sec  13174  
[  4]   4.00-5.00   sec   103 MBytes   864 Mbits/sec  13189  
[  4]   5.00-6.00   sec   103 MBytes   862 Mbits/sec  13155  
[  4]   6.00-7.00   sec   103 MBytes   864 Mbits/sec  13189  
[  4]   7.00-8.00   sec   102 MBytes   855 Mbits/sec  13054  
[  4]   8.00-9.00   sec   103 MBytes   863 Mbits/sec  13162  
[  4]   9.00-10.00  sec   103 MBytes   864 Mbits/sec  13189  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1016 MBytes   853 Mbits/sec  480201.336 ms  66629/66678 (1e+02%)  
[  4] Sent 66678 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 44719 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.4 MBytes   129 Mbits/sec  0.054 ms  0/1969 (0%)  
[  4]   1.00-2.00   sec  15.4 MBytes   129 Mbits/sec  0.116 ms  0/1977 (0%)  
[  4]   2.00-3.00   sec  15.5 MBytes   131 Mbits/sec  0.057 ms  0/1990 (0%)  
[  4]   3.00-4.00   sec  15.6 MBytes   131 Mbits/sec  0.096 ms  0/1992 (0%)  
[  4]   4.00-5.00   sec  15.6 MBytes   131 Mbits/sec  0.090 ms  0/1993 (0%)  
[  4]   5.00-6.00   sec  15.5 MBytes   130 Mbits/sec  0.081 ms  0/1982 (0%)  
[  4]   6.00-7.00   sec  15.4 MBytes   129 Mbits/sec  0.070 ms  0/1969 (0%)  
[  4]   7.00-8.00   sec  15.5 MBytes   130 Mbits/sec  0.080 ms  0/1981 (0%)  
[  4]   8.00-9.00   sec  15.6 MBytes   130 Mbits/sec  0.114 ms  0/1991 (0%)  
[  4]   9.00-10.00  sec  15.5 MBytes   130 Mbits/sec  0.063 ms  0/1989 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   155 MBytes   130 Mbits/sec  0.073 ms  0/19837 (0%)  
[  4] Sent 19837 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60340 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60342 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60344 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  7.16 MBytes  60.0 Mbits/sec   84   22.6 KBytes       
[  6]   0.00-1.00   sec  8.23 MBytes  69.0 Mbits/sec   80   35.4 KBytes       
[  9]   0.00-1.00   sec  5.88 MBytes  49.3 Mbits/sec  105   14.1 KBytes       
[SUM]   0.00-1.00   sec  21.3 MBytes   178 Mbits/sec  269             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.21 MBytes  60.5 Mbits/sec   67   24.0 KBytes       
[  6]   1.00-2.00   sec  6.77 MBytes  56.8 Mbits/sec   73   12.7 KBytes       
[  9]   1.00-2.00   sec  6.59 MBytes  55.2 Mbits/sec   68   36.8 KBytes       
[SUM]   1.00-2.00   sec  20.6 MBytes   173 Mbits/sec  208             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.27 MBytes  61.0 Mbits/sec   63   21.2 KBytes       
[  6]   2.00-3.00   sec  6.52 MBytes  54.7 Mbits/sec   73   19.8 KBytes       
[  9]   2.00-3.00   sec  6.71 MBytes  56.3 Mbits/sec   72   35.4 KBytes       
[SUM]   2.00-3.00   sec  20.5 MBytes   172 Mbits/sec  208             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  7.15 MBytes  59.9 Mbits/sec   91   25.5 KBytes       
[  6]   3.00-4.00   sec  7.46 MBytes  62.6 Mbits/sec   50   29.7 KBytes       
[  9]   3.00-4.00   sec  5.78 MBytes  48.5 Mbits/sec   73   14.1 KBytes       
[SUM]   3.00-4.00   sec  20.4 MBytes   171 Mbits/sec  214             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  6.96 MBytes  58.4 Mbits/sec   69   17.0 KBytes       
[  6]   4.00-5.00   sec  7.46 MBytes  62.6 Mbits/sec   61   12.7 KBytes       
[  9]   4.00-5.00   sec  5.90 MBytes  49.5 Mbits/sec   64   18.4 KBytes       
[SUM]   4.00-5.00   sec  20.3 MBytes   170 Mbits/sec  194             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  5.97 MBytes  50.0 Mbits/sec   83   11.3 KBytes       
[  6]   5.00-6.00   sec  8.02 MBytes  67.2 Mbits/sec   70   11.3 KBytes       
[  9]   5.00-6.00   sec  6.46 MBytes  54.2 Mbits/sec   92   25.5 KBytes       
[SUM]   5.00-6.00   sec  20.4 MBytes   171 Mbits/sec  245             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  6.34 MBytes  53.2 Mbits/sec   80   19.8 KBytes       
[  6]   6.00-7.00   sec  7.46 MBytes  62.5 Mbits/sec   67   33.9 KBytes       
[  9]   6.00-7.00   sec  6.77 MBytes  56.8 Mbits/sec   65   22.6 KBytes       
[SUM]   6.00-7.00   sec  20.6 MBytes   173 Mbits/sec  212             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  9.26 MBytes  77.7 Mbits/sec   66   41.0 KBytes       
[  6]   7.00-8.00   sec  5.34 MBytes  44.8 Mbits/sec   76   22.6 KBytes       
[  9]   7.00-8.00   sec  5.84 MBytes  49.0 Mbits/sec   75   7.07 KBytes       
[SUM]   7.00-8.00   sec  20.4 MBytes   172 Mbits/sec  217             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  6.65 MBytes  55.8 Mbits/sec   77   21.2 KBytes       
[  6]   8.00-9.00   sec  6.52 MBytes  54.7 Mbits/sec   65   22.6 KBytes       
[  9]   8.00-9.00   sec  7.39 MBytes  62.0 Mbits/sec   64   22.6 KBytes       
[SUM]   8.00-9.00   sec  20.6 MBytes   173 Mbits/sec  206             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  6.84 MBytes  57.4 Mbits/sec   67   19.8 KBytes       
[  6]   9.00-10.00  sec  7.02 MBytes  58.9 Mbits/sec   74   21.2 KBytes       
[  9]   9.00-10.00  sec  6.40 MBytes  53.7 Mbits/sec   99   9.90 KBytes       
[SUM]   9.00-10.00  sec  20.3 MBytes   170 Mbits/sec  240             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  70.8 MBytes  59.4 Mbits/sec  747             sender
[  4]   0.00-10.00  sec  70.4 MBytes  59.1 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  70.8 MBytes  59.4 Mbits/sec  689             sender
[  6]   0.00-10.00  sec  70.5 MBytes  59.2 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  63.7 MBytes  53.5 Mbits/sec  777             sender
[  9]   0.00-10.00  sec  63.4 MBytes  53.2 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   205 MBytes   172 Mbits/sec  2213             sender
[SUM]   0.00-10.00  sec   204 MBytes   171 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60352 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60354 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60356 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.88 MBytes  32.5 Mbits/sec                  
[  6]   0.00-1.00   sec  3.88 MBytes  32.5 Mbits/sec                  
[  9]   0.00-1.00   sec  2.56 MBytes  21.5 Mbits/sec                  
[SUM]   0.00-1.00   sec  10.3 MBytes  86.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   1.00-2.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   1.00-2.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   1.00-2.00   sec  10.1 MBytes  85.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.44 MBytes  28.9 Mbits/sec                  
[  6]   2.00-3.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   2.00-3.00   sec  3.44 MBytes  28.8 Mbits/sec                  
[SUM]   2.00-3.00   sec  10.3 MBytes  86.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.38 MBytes  28.4 Mbits/sec                  
[  6]   3.00-4.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   3.00-4.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   3.00-4.00   sec  10.1 MBytes  85.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  3.36 MBytes  28.2 Mbits/sec                  
[  6]   4.00-5.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   4.00-5.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   4.00-5.00   sec  10.1 MBytes  84.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   5.00-6.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   5.00-6.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   5.00-6.00   sec  10.1 MBytes  85.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.36 MBytes  28.2 Mbits/sec                  
[  6]   6.00-7.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   6.00-7.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   6.00-7.00   sec  10.1 MBytes  84.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.40 MBytes  28.6 Mbits/sec                  
[  6]   7.00-8.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   7.00-8.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   7.00-8.00   sec  10.2 MBytes  85.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.43 MBytes  28.8 Mbits/sec                  
[  6]   8.00-9.00   sec  3.39 MBytes  28.5 Mbits/sec                  
[  9]   8.00-9.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   8.00-9.00   sec  10.2 MBytes  85.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   9.00-10.00  sec  3.48 MBytes  29.2 Mbits/sec                  
[  9]   9.00-10.00  sec  3.40 MBytes  28.6 Mbits/sec                  
[SUM]   9.00-10.00  sec  10.3 MBytes  86.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  33.7 MBytes  28.3 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  33.7 MBytes  28.3 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   104 MBytes  86.9 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   104 MBytes  86.9 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 34818 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 37432 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 50445 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  36.7 MBytes   308 Mbits/sec  4696  
[  6]   0.00-1.00   sec  36.7 MBytes   308 Mbits/sec  4696  
[  9]   0.00-1.00   sec  36.7 MBytes   308 Mbits/sec  4696  
[SUM]   0.00-1.00   sec   110 MBytes   923 Mbits/sec  14088  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.5 MBytes   314 Mbits/sec  4796  
[  6]   1.00-2.00   sec  37.5 MBytes   314 Mbits/sec  4796  
[  9]   1.00-2.00   sec  37.5 MBytes   314 Mbits/sec  4796  
[SUM]   1.00-2.00   sec   112 MBytes   943 Mbits/sec  14388  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.5 MBytes   314 Mbits/sec  4795  
[  6]   2.00-3.00   sec  37.5 MBytes   314 Mbits/sec  4795  
[  9]   2.00-3.00   sec  37.5 MBytes   314 Mbits/sec  4795  
[SUM]   2.00-3.00   sec   112 MBytes   943 Mbits/sec  14385  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  37.2 MBytes   312 Mbits/sec  4760  
[  6]   3.00-4.00   sec  37.2 MBytes   312 Mbits/sec  4760  
[  9]   3.00-4.00   sec  37.2 MBytes   312 Mbits/sec  4760  
[SUM]   3.00-4.00   sec   112 MBytes   936 Mbits/sec  14280  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4786  
[  6]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4786  
[  9]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4786  
[SUM]   4.00-5.00   sec   112 MBytes   941 Mbits/sec  14358  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[  6]   5.00-6.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[  9]   5.00-6.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[SUM]   5.00-6.00   sec   112 MBytes   941 Mbits/sec  14361  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.4 MBytes   314 Mbits/sec  4790  
[  6]   6.00-7.00   sec  37.4 MBytes   314 Mbits/sec  4790  
[  9]   6.00-7.00   sec  37.4 MBytes   314 Mbits/sec  4790  
[SUM]   6.00-7.00   sec   112 MBytes   942 Mbits/sec  14370  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.4 MBytes   314 Mbits/sec  4790  
[  6]   7.00-8.00   sec  37.4 MBytes   314 Mbits/sec  4790  
[  9]   7.00-8.00   sec  37.4 MBytes   314 Mbits/sec  4790  
[SUM]   7.00-8.00   sec   112 MBytes   942 Mbits/sec  14370  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[  6]   8.00-9.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[  9]   8.00-9.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[SUM]   8.00-9.00   sec   112 MBytes   942 Mbits/sec  14376  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.5 MBytes   314 Mbits/sec  4799  
[  6]   9.00-10.00  sec  37.5 MBytes   314 Mbits/sec  4799  
[  9]   9.00-10.00  sec  37.5 MBytes   314 Mbits/sec  4799  
[SUM]   9.00-10.00  sec   112 MBytes   943 Mbits/sec  14397  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  5950363.786 ms  437/447 (98%)  
[  4] Sent 447 datagrams
[  6]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  6770190.714 ms  22130/22138 (1e+02%)  
[  6] Sent 22138 datagrams
[  9]   0.00-10.00  sec   373 MBytes   313 Mbits/sec  7221536.190 ms  439/446 (98%)  
[  9] Sent 446 datagrams
[SUM]   0.00-10.00  sec  1.09 GBytes   940 Mbits/sec  6647363.564 ms  23006/23031 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 52018 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 51266 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 34793 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  4.55 MBytes  38.1 Mbits/sec  0.124 ms  0/582 (0%)  
[  6]   0.00-1.00   sec  4.54 MBytes  38.1 Mbits/sec  0.104 ms  0/581 (0%)  
[  9]   0.00-1.00   sec  4.53 MBytes  38.0 Mbits/sec  0.140 ms  0/580 (0%)  
[SUM]   0.00-1.00   sec  13.6 MBytes   114 Mbits/sec  0.123 ms  0/1743 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  4.56 MBytes  38.3 Mbits/sec  0.116 ms  0/584 (0%)  
[  6]   1.00-2.00   sec  4.57 MBytes  38.3 Mbits/sec  0.107 ms  0/585 (0%)  
[  9]   1.00-2.00   sec  4.56 MBytes  38.3 Mbits/sec  0.153 ms  0/584 (0%)  
[SUM]   1.00-2.00   sec  13.7 MBytes   115 Mbits/sec  0.125 ms  0/1753 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  4.85 MBytes  40.7 Mbits/sec  0.156 ms  0/621 (0%)  
[  6]   2.00-3.00   sec  4.84 MBytes  40.6 Mbits/sec  0.147 ms  0/620 (0%)  
[  9]   2.00-3.00   sec  4.85 MBytes  40.7 Mbits/sec  0.206 ms  0/621 (0%)  
[SUM]   2.00-3.00   sec  14.5 MBytes   122 Mbits/sec  0.169 ms  0/1862 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  4.98 MBytes  41.8 Mbits/sec  0.272 ms  0/638 (0%)  
[  6]   3.00-4.00   sec  4.99 MBytes  41.9 Mbits/sec  0.155 ms  0/639 (0%)  
[  9]   3.00-4.00   sec  4.99 MBytes  41.9 Mbits/sec  0.198 ms  0/639 (0%)  
[SUM]   3.00-4.00   sec  15.0 MBytes   126 Mbits/sec  0.208 ms  0/1916 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  5.01 MBytes  42.0 Mbits/sec  0.292 ms  0/641 (0%)  
[  6]   4.00-5.00   sec  5.00 MBytes  41.9 Mbits/sec  0.152 ms  0/640 (0%)  
[  9]   4.00-5.00   sec  4.99 MBytes  41.9 Mbits/sec  0.225 ms  0/639 (0%)  
[SUM]   4.00-5.00   sec  15.0 MBytes   126 Mbits/sec  0.223 ms  0/1920 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  4.99 MBytes  41.9 Mbits/sec  0.178 ms  0/639 (0%)  
[  6]   5.00-6.00   sec  4.99 MBytes  41.9 Mbits/sec  0.128 ms  0/639 (0%)  
[  9]   5.00-6.00   sec  4.99 MBytes  41.9 Mbits/sec  0.119 ms  0/639 (0%)  
[SUM]   5.00-6.00   sec  15.0 MBytes   126 Mbits/sec  0.141 ms  0/1917 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  5.01 MBytes  42.0 Mbits/sec  0.279 ms  0/641 (0%)  
[  6]   6.00-7.00   sec  5.01 MBytes  42.0 Mbits/sec  0.143 ms  0/641 (0%)  
[  9]   6.00-7.00   sec  5.01 MBytes  42.0 Mbits/sec  0.278 ms  0/641 (0%)  
[SUM]   6.00-7.00   sec  15.0 MBytes   126 Mbits/sec  0.233 ms  0/1923 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  5.05 MBytes  42.3 Mbits/sec  0.188 ms  0/646 (0%)  
[  6]   7.00-8.00   sec  5.05 MBytes  42.3 Mbits/sec  0.181 ms  0/646 (0%)  
[  9]   7.00-8.00   sec  5.04 MBytes  42.3 Mbits/sec  0.304 ms  0/645 (0%)  
[SUM]   7.00-8.00   sec  15.1 MBytes   127 Mbits/sec  0.224 ms  0/1937 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  5.05 MBytes  42.3 Mbits/sec  0.240 ms  0/646 (0%)  
[  6]   8.00-9.00   sec  5.05 MBytes  42.3 Mbits/sec  0.137 ms  0/646 (0%)  
[  9]   8.00-9.00   sec  5.05 MBytes  42.3 Mbits/sec  0.291 ms  0/646 (0%)  
[SUM]   8.00-9.00   sec  15.1 MBytes   127 Mbits/sec  0.223 ms  0/1938 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  5.05 MBytes  42.3 Mbits/sec  0.140 ms  0/646 (0%)  
[  6]   9.00-10.00  sec  5.04 MBytes  42.3 Mbits/sec  0.206 ms  0/645 (0%)  
[  9]   9.00-10.00  sec  5.04 MBytes  42.3 Mbits/sec  0.125 ms  0/645 (0%)  
[SUM]   9.00-10.00  sec  15.1 MBytes   127 Mbits/sec  0.157 ms  0/1936 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  49.1 MBytes  41.2 Mbits/sec  0.141 ms  0/6291 (0%)  
[  4] Sent 6291 datagrams
[  6]   0.00-10.00  sec  49.1 MBytes  41.2 Mbits/sec  0.325 ms  0/6289 (0%)  
[  6] Sent 6289 datagrams
[  9]   0.00-10.00  sec  49.1 MBytes  41.2 Mbits/sec  0.132 ms  0/6286 (0%)  
[  9] Sent 6286 datagrams
[SUM]   0.00-10.00  sec   147 MBytes   124 Mbits/sec  0.200 ms  0/18866 (0%)  

iperf Done.
+ : ':::::::[' configuration smp_icu_different_vpes ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60368 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  21.3 MBytes   179 Mbits/sec   27   65.0 KBytes       
[  4]   1.00-2.00   sec  20.9 MBytes   175 Mbits/sec   37   56.6 KBytes       
[  4]   2.00-3.00   sec  20.6 MBytes   173 Mbits/sec   41   39.6 KBytes       
[  4]   3.00-4.00   sec  20.9 MBytes   175 Mbits/sec   36   76.4 KBytes       
[  4]   4.00-5.00   sec  20.8 MBytes   175 Mbits/sec   41   73.5 KBytes       
[  4]   5.00-6.00   sec  20.8 MBytes   174 Mbits/sec   29   38.2 KBytes       
[  4]   6.00-7.00   sec  21.1 MBytes   177 Mbits/sec   34   72.1 KBytes       
[  4]   7.00-8.00   sec  20.8 MBytes   174 Mbits/sec   34   49.5 KBytes       
[  4]   8.00-9.00   sec  20.8 MBytes   175 Mbits/sec   44   69.3 KBytes       
[  4]   9.00-10.00  sec  20.8 MBytes   175 Mbits/sec   32   65.0 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   209 MBytes   175 Mbits/sec  355             sender
[  4]   0.00-10.00  sec   208 MBytes   175 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60374 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  10.1 MBytes  84.9 Mbits/sec                  
[  4]   1.00-2.00   sec  10.1 MBytes  85.1 Mbits/sec                  
[  4]   2.00-3.00   sec  10.2 MBytes  85.8 Mbits/sec                  
[  4]   3.00-4.00   sec  10.2 MBytes  85.4 Mbits/sec                  
[  4]   4.00-5.00   sec  10.2 MBytes  85.4 Mbits/sec                  
[  4]   5.00-6.00   sec  10.1 MBytes  84.8 Mbits/sec                  
[  4]   6.00-7.00   sec  10.1 MBytes  84.4 Mbits/sec                  
[  4]   7.00-8.00   sec  10.1 MBytes  84.5 Mbits/sec                  
[  4]   8.00-9.00   sec  10.2 MBytes  85.4 Mbits/sec                  
[  4]   9.00-10.00  sec  10.2 MBytes  85.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   102 MBytes  85.2 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   102 MBytes  85.2 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 35693 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.5 MBytes   138 Mbits/sec  2106  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2287  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2287  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2290  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2286  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2285  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2287  
[  4]   7.00-8.00   sec  17.9 MBytes   151 Mbits/sec  2297  
[  4]   8.00-9.00   sec  17.8 MBytes   150 Mbits/sec  2283  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2293  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  102034.422 ms  1280/1353 (95%)  
[  4] Sent 1353 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 41789 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  14.3 MBytes   120 Mbits/sec  0.174 ms  0/1829 (0%)  
[  4]   1.00-2.00   sec  15.3 MBytes   128 Mbits/sec  0.065 ms  0/1956 (0%)  
[  4]   2.00-3.00   sec  15.4 MBytes   129 Mbits/sec  0.151 ms  0/1973 (0%)  
[  4]   3.00-4.00   sec  15.4 MBytes   129 Mbits/sec  0.063 ms  0/1974 (0%)  
[  4]   4.00-5.00   sec  15.4 MBytes   129 Mbits/sec  0.129 ms  0/1967 (0%)  
[  4]   5.00-6.00   sec  15.3 MBytes   128 Mbits/sec  0.101 ms  0/1956 (0%)  
[  4]   6.00-7.00   sec  15.2 MBytes   128 Mbits/sec  0.137 ms  0/1951 (0%)  
[  4]   7.00-8.00   sec  15.4 MBytes   129 Mbits/sec  0.116 ms  0/1968 (0%)  
[  4]   8.00-9.00   sec  15.4 MBytes   129 Mbits/sec  0.077 ms  0/1974 (0%)  
[  4]   9.00-10.00  sec  15.4 MBytes   129 Mbits/sec  0.160 ms  0/1974 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   153 MBytes   128 Mbits/sec  0.163 ms  0/19529 (0%)  
[  4] Sent 19529 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 52938 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  53.7 MBytes   450 Mbits/sec  6870  
[  4]   1.00-2.00   sec  60.1 MBytes   504 Mbits/sec  7694  
[  4]   2.00-3.00   sec  63.4 MBytes   532 Mbits/sec  8115  
[  4]   3.00-4.00   sec  58.9 MBytes   494 Mbits/sec  7535  
[  4]   4.00-5.00   sec  60.9 MBytes   511 Mbits/sec  7795  
[  4]   5.00-6.00   sec  59.5 MBytes   499 Mbits/sec  7618  
[  4]   6.00-7.00   sec  59.5 MBytes   499 Mbits/sec  7612  
[  4]   7.00-8.00   sec  60.2 MBytes   505 Mbits/sec  7710  
[  4]   8.00-9.00   sec  55.2 MBytes   463 Mbits/sec  7067  
[  4]   9.00-10.00  sec  59.0 MBytes   495 Mbits/sec  7556  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   590 MBytes   495 Mbits/sec  14.770 ms  64911/65123 (1e+02%)  
[  4] Sent 65123 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 42470 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  14.4 MBytes   121 Mbits/sec  0.144 ms  0/1843 (0%)  
[  4]   1.00-2.00   sec  14.4 MBytes   121 Mbits/sec  0.147 ms  0/1848 (0%)  
[  4]   2.00-3.00   sec  15.1 MBytes   127 Mbits/sec  0.087 ms  0/1932 (0%)  
[  4]   3.00-4.00   sec  15.5 MBytes   130 Mbits/sec  0.155 ms  0/1981 (0%)  
[  4]   4.00-5.00   sec  14.8 MBytes   124 Mbits/sec  0.064 ms  0/1889 (0%)  
[  4]   5.00-6.00   sec  15.3 MBytes   129 Mbits/sec  0.146 ms  0/1962 (0%)  
[  4]   6.00-7.00   sec  15.3 MBytes   128 Mbits/sec  0.083 ms  0/1955 (0%)  
[  4]   7.00-8.00   sec  15.4 MBytes   129 Mbits/sec  0.116 ms  0/1968 (0%)  
[  4]   8.00-9.00   sec  15.5 MBytes   130 Mbits/sec  0.066 ms  0/1978 (0%)  
[  4]   9.00-10.00  sec  15.5 MBytes   130 Mbits/sec  0.105 ms  0/1978 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   151 MBytes   127 Mbits/sec  0.109 ms  0/19342 (0%)  
[  4] Sent 19342 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 47293 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  91.2 MBytes   765 Mbits/sec  11673  
[  4]   1.00-2.00   sec   102 MBytes   859 Mbits/sec  13114  
[  4]   2.00-3.00   sec   102 MBytes   858 Mbits/sec  13084  
[  4]   3.00-4.00   sec   102 MBytes   858 Mbits/sec  13093  
[  4]   4.00-5.00   sec   103 MBytes   860 Mbits/sec  13125  
[  4]   5.00-6.00   sec   102 MBytes   858 Mbits/sec  13086  
[  4]   6.00-7.00   sec   102 MBytes   856 Mbits/sec  13062  
[  4]   7.00-8.00   sec   102 MBytes   857 Mbits/sec  13082  
[  4]   8.00-9.00   sec   102 MBytes   859 Mbits/sec  13107  
[  4]   9.00-10.00  sec   102 MBytes   859 Mbits/sec  13109  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1012 MBytes   849 Mbits/sec  858384.293 ms  66827/66867 (1e+02%)  
[  4] Sent 66867 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 42589 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.2 MBytes   128 Mbits/sec  0.083 ms  0/1948 (0%)  
[  4]   1.00-2.00   sec  15.4 MBytes   129 Mbits/sec  0.101 ms  0/1973 (0%)  
[  4]   2.00-3.00   sec  15.5 MBytes   130 Mbits/sec  0.057 ms  0/1986 (0%)  
[  4]   3.00-4.00   sec  15.5 MBytes   130 Mbits/sec  0.100 ms  0/1980 (0%)  
[  4]   4.00-5.00   sec  15.2 MBytes   128 Mbits/sec  0.065 ms  0/1948 (0%)  
[  4]   5.00-6.00   sec  15.4 MBytes   129 Mbits/sec  0.061 ms  0/1971 (0%)  
[  4]   6.00-7.00   sec  15.3 MBytes   129 Mbits/sec  0.068 ms  0/1962 (0%)  
[  4]   7.00-8.00   sec  15.5 MBytes   130 Mbits/sec  0.091 ms  0/1981 (0%)  
[  4]   8.00-9.00   sec  15.5 MBytes   130 Mbits/sec  0.051 ms  0/1983 (0%)  
[  4]   9.00-10.00  sec  15.5 MBytes   130 Mbits/sec  0.065 ms  0/1985 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   154 MBytes   129 Mbits/sec  0.084 ms  0/19724 (0%)  
[  4] Sent 19724 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60418 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60420 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60422 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  8.70 MBytes  72.9 Mbits/sec   66   18.4 KBytes       
[  6]   0.00-1.00   sec  7.89 MBytes  66.2 Mbits/sec   51   19.8 KBytes       
[  9]   0.00-1.00   sec  4.35 MBytes  36.5 Mbits/sec   82   9.90 KBytes       
[SUM]   0.00-1.00   sec  20.9 MBytes   176 Mbits/sec  199             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.83 MBytes  65.7 Mbits/sec   83   8.48 KBytes       
[  6]   1.00-2.00   sec  5.65 MBytes  47.4 Mbits/sec   72   18.4 KBytes       
[  9]   1.00-2.00   sec  6.77 MBytes  56.8 Mbits/sec   76   19.8 KBytes       
[SUM]   1.00-2.00   sec  20.3 MBytes   170 Mbits/sec  231             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  6.71 MBytes  56.3 Mbits/sec   83   39.6 KBytes       
[  6]   2.00-3.00   sec  6.34 MBytes  53.2 Mbits/sec   71   18.4 KBytes       
[  9]   2.00-3.00   sec  7.46 MBytes  62.6 Mbits/sec   56   21.2 KBytes       
[SUM]   2.00-3.00   sec  20.5 MBytes   172 Mbits/sec  210             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  8.26 MBytes  69.3 Mbits/sec   54   35.4 KBytes       
[  6]   3.00-4.00   sec  6.65 MBytes  55.8 Mbits/sec   81   31.1 KBytes       
[  9]   3.00-4.00   sec  5.53 MBytes  46.4 Mbits/sec   77   17.0 KBytes       
[SUM]   3.00-4.00   sec  20.4 MBytes   171 Mbits/sec  212             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  7.71 MBytes  64.6 Mbits/sec   64   25.5 KBytes       
[  6]   4.00-5.00   sec  6.65 MBytes  55.8 Mbits/sec   65   28.3 KBytes       
[  9]   4.00-5.00   sec  5.97 MBytes  50.1 Mbits/sec   68   15.6 KBytes       
[SUM]   4.00-5.00   sec  20.3 MBytes   170 Mbits/sec  197             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  7.27 MBytes  61.0 Mbits/sec   66   18.4 KBytes       
[  6]   5.00-6.00   sec  6.34 MBytes  53.2 Mbits/sec   84   22.6 KBytes       
[  9]   5.00-6.00   sec  6.71 MBytes  56.3 Mbits/sec   67   11.3 KBytes       
[SUM]   5.00-6.00   sec  20.3 MBytes   170 Mbits/sec  217             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  8.08 MBytes  67.8 Mbits/sec   75   24.0 KBytes       
[  6]   6.00-7.00   sec  5.47 MBytes  45.9 Mbits/sec   82   29.7 KBytes       
[  9]   6.00-7.00   sec  7.08 MBytes  59.4 Mbits/sec   63   24.0 KBytes       
[SUM]   6.00-7.00   sec  20.6 MBytes   173 Mbits/sec  220             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  7.21 MBytes  60.4 Mbits/sec   87   9.90 KBytes       
[  6]   7.00-8.00   sec  7.15 MBytes  59.9 Mbits/sec   57   21.2 KBytes       
[  9]   7.00-8.00   sec  6.15 MBytes  51.6 Mbits/sec   94   22.6 KBytes       
[SUM]   7.00-8.00   sec  20.5 MBytes   172 Mbits/sec  238             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  5.72 MBytes  48.0 Mbits/sec   80   31.1 KBytes       
[  6]   8.00-9.00   sec  7.95 MBytes  66.8 Mbits/sec   78   17.0 KBytes       
[  9]   8.00-9.00   sec  6.65 MBytes  55.8 Mbits/sec   58   22.6 KBytes       
[SUM]   8.00-9.00   sec  20.3 MBytes   171 Mbits/sec  216             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  8.08 MBytes  67.8 Mbits/sec   66   17.0 KBytes       
[  6]   9.00-10.00  sec  5.72 MBytes  48.0 Mbits/sec   91   21.2 KBytes       
[  9]   9.00-10.00  sec  6.77 MBytes  56.8 Mbits/sec   62   15.6 KBytes       
[SUM]   9.00-10.00  sec  20.6 MBytes   173 Mbits/sec  219             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  75.6 MBytes  63.4 Mbits/sec  724             sender
[  4]   0.00-10.00  sec  75.2 MBytes  63.1 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  65.8 MBytes  55.2 Mbits/sec  732             sender
[  6]   0.00-10.00  sec  65.4 MBytes  54.9 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  63.5 MBytes  53.2 Mbits/sec  703             sender
[  9]   0.00-10.00  sec  63.1 MBytes  52.9 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   205 MBytes   172 Mbits/sec  2159             sender
[SUM]   0.00-10.00  sec   204 MBytes   171 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60428 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60430 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60432 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.88 MBytes  32.5 Mbits/sec                  
[  6]   0.00-1.00   sec  3.79 MBytes  31.8 Mbits/sec                  
[  9]   0.00-1.00   sec  2.50 MBytes  21.0 Mbits/sec                  
[SUM]   0.00-1.00   sec  10.2 MBytes  85.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   1.00-2.00   sec  3.40 MBytes  28.5 Mbits/sec                  
[  9]   1.00-2.00   sec  3.46 MBytes  29.1 Mbits/sec                  
[SUM]   1.00-2.00   sec  10.2 MBytes  85.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.41 MBytes  28.6 Mbits/sec                  
[  6]   2.00-3.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   2.00-3.00   sec  3.41 MBytes  28.6 Mbits/sec                  
[SUM]   2.00-3.00   sec  10.2 MBytes  85.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.46 MBytes  29.1 Mbits/sec                  
[  6]   3.00-4.00   sec  3.38 MBytes  28.4 Mbits/sec                  
[  9]   3.00-4.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   3.00-4.00   sec  10.2 MBytes  85.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   4.00-5.00   sec  3.40 MBytes  28.5 Mbits/sec                  
[  9]   4.00-5.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   4.00-5.00   sec  10.2 MBytes  85.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   5.00-6.00   sec  3.36 MBytes  28.2 Mbits/sec                  
[  9]   5.00-6.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   5.00-6.00   sec  10.1 MBytes  84.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   6.00-7.00   sec  3.39 MBytes  28.5 Mbits/sec                  
[  9]   6.00-7.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   6.00-7.00   sec  10.1 MBytes  85.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  6]   7.00-8.00   sec  3.46 MBytes  29.0 Mbits/sec                  
[  9]   7.00-8.00   sec  3.39 MBytes  28.4 Mbits/sec                  
[SUM]   7.00-8.00   sec  10.2 MBytes  85.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.45 MBytes  28.9 Mbits/sec                  
[  6]   8.00-9.00   sec  3.38 MBytes  28.3 Mbits/sec                  
[  9]   8.00-9.00   sec  3.48 MBytes  29.2 Mbits/sec                  
[SUM]   8.00-9.00   sec  10.3 MBytes  86.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.42 MBytes  28.7 Mbits/sec                  
[  6]   9.00-10.00  sec  3.40 MBytes  28.5 Mbits/sec                  
[  9]   9.00-10.00  sec  3.38 MBytes  28.3 Mbits/sec                  
[SUM]   9.00-10.00  sec  10.2 MBytes  85.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  34.9 MBytes  29.3 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  33.5 MBytes  28.1 Mbits/sec    2             sender
[  9]   0.00-10.00  sec  33.5 MBytes  28.1 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   103 MBytes  86.7 Mbits/sec    2             sender
[SUM]   0.00-10.00  sec   103 MBytes  86.7 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 36678 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 54699 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 37104 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  33.4 MBytes   280 Mbits/sec  4271  
[  6]   0.00-1.00   sec  33.4 MBytes   280 Mbits/sec  4271  
[  9]   0.00-1.00   sec  33.4 MBytes   280 Mbits/sec  4271  
[SUM]   0.00-1.00   sec   100 MBytes   840 Mbits/sec  12813  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[  6]   1.00-2.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[  9]   1.00-2.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[SUM]   1.00-2.00   sec   112 MBytes   942 Mbits/sec  14376  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[  6]   2.00-3.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[  9]   2.00-3.00   sec  37.4 MBytes   313 Mbits/sec  4783  
[SUM]   2.00-3.00   sec   112 MBytes   940 Mbits/sec  14349  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[  6]   3.00-4.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[  9]   3.00-4.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[SUM]   3.00-4.00   sec   112 MBytes   941 Mbits/sec  14361  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[  6]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[  9]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4787  
[SUM]   4.00-5.00   sec   112 MBytes   941 Mbits/sec  14361  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  36.0 MBytes   302 Mbits/sec  4613  
[  6]   5.00-6.00   sec  36.0 MBytes   302 Mbits/sec  4613  
[  9]   5.00-6.00   sec  36.0 MBytes   302 Mbits/sec  4613  
[SUM]   5.00-6.00   sec   108 MBytes   907 Mbits/sec  13839  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.4 MBytes   314 Mbits/sec  4784  
[  6]   6.00-7.00   sec  37.4 MBytes   314 Mbits/sec  4784  
[  9]   6.00-7.00   sec  37.4 MBytes   314 Mbits/sec  4784  
[SUM]   6.00-7.00   sec   112 MBytes   941 Mbits/sec  14352  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.4 MBytes   313 Mbits/sec  4784  
[  6]   7.00-8.00   sec  37.4 MBytes   313 Mbits/sec  4784  
[  9]   7.00-8.00   sec  37.4 MBytes   313 Mbits/sec  4784  
[SUM]   7.00-8.00   sec   112 MBytes   940 Mbits/sec  14352  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.0 MBytes   310 Mbits/sec  4734  
[  6]   8.00-9.00   sec  37.0 MBytes   310 Mbits/sec  4734  
[  9]   8.00-9.00   sec  37.0 MBytes   310 Mbits/sec  4734  
[SUM]   8.00-9.00   sec   111 MBytes   931 Mbits/sec  14202  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.0 MBytes   311 Mbits/sec  4740  
[  6]   9.00-10.00  sec  37.0 MBytes   311 Mbits/sec  4740  
[  9]   9.00-10.00  sec  37.0 MBytes   311 Mbits/sec  4740  
[SUM]   9.00-10.00  sec   111 MBytes   932 Mbits/sec  14220  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   368 MBytes   309 Mbits/sec  5578465.308 ms  43859/43870 (1e+02%)  
[  4] Sent 43870 datagrams
[  6]   0.00-10.00  sec   368 MBytes   309 Mbits/sec  5950363.027 ms  22076/22086 (1e+02%)  
[  6] Sent 22086 datagrams
[  9]   0.00-10.00  sec   368 MBytes   309 Mbits/sec  6770190.468 ms  43995/44003 (1e+02%)  
[  9] Sent 44003 datagrams
[SUM]   0.00-10.00  sec  1.08 GBytes   926 Mbits/sec  6099672.934 ms  109930/109959 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 49258 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 44006 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 38319 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  4.54 MBytes  38.1 Mbits/sec  0.108 ms  0/581 (0%)  
[  6]   0.00-1.00   sec  4.54 MBytes  38.1 Mbits/sec  0.165 ms  0/581 (0%)  
[  9]   0.00-1.00   sec  4.53 MBytes  38.0 Mbits/sec  0.069 ms  0/580 (0%)  
[SUM]   0.00-1.00   sec  13.6 MBytes   114 Mbits/sec  0.114 ms  0/1742 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  4.98 MBytes  41.8 Mbits/sec  0.160 ms  0/638 (0%)  
[  6]   1.00-2.00   sec  4.98 MBytes  41.8 Mbits/sec  0.135 ms  0/638 (0%)  
[  9]   1.00-2.00   sec  4.98 MBytes  41.8 Mbits/sec  0.176 ms  0/638 (0%)  
[SUM]   1.00-2.00   sec  15.0 MBytes   125 Mbits/sec  0.157 ms  0/1914 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  5.07 MBytes  42.5 Mbits/sec  0.292 ms  0/649 (0%)  
[  6]   2.00-3.00   sec  5.06 MBytes  42.5 Mbits/sec  0.281 ms  0/648 (0%)  
[  9]   2.00-3.00   sec  5.06 MBytes  42.5 Mbits/sec  0.426 ms  0/648 (0%)  
[SUM]   2.00-3.00   sec  15.2 MBytes   127 Mbits/sec  0.333 ms  0/1945 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  5.06 MBytes  42.5 Mbits/sec  0.298 ms  0/648 (0%)  
[  6]   3.00-4.00   sec  5.07 MBytes  42.5 Mbits/sec  0.188 ms  0/649 (0%)  
[  9]   3.00-4.00   sec  5.06 MBytes  42.5 Mbits/sec  0.329 ms  0/648 (0%)  
[SUM]   3.00-4.00   sec  15.2 MBytes   127 Mbits/sec  0.272 ms  0/1945 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  5.05 MBytes  42.3 Mbits/sec  0.171 ms  0/646 (0%)  
[  6]   4.00-5.00   sec  5.04 MBytes  42.3 Mbits/sec  0.215 ms  0/645 (0%)  
[  9]   4.00-5.00   sec  5.04 MBytes  42.3 Mbits/sec  0.175 ms  0/645 (0%)  
[SUM]   4.00-5.00   sec  15.1 MBytes   127 Mbits/sec  0.187 ms  0/1936 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  5.02 MBytes  42.1 Mbits/sec  0.224 ms  0/642 (0%)  
[  6]   5.00-6.00   sec  5.02 MBytes  42.1 Mbits/sec  0.173 ms  0/642 (0%)  
[  9]   5.00-6.00   sec  5.01 MBytes  42.0 Mbits/sec  0.264 ms  0/641 (0%)  
[SUM]   5.00-6.00   sec  15.0 MBytes   126 Mbits/sec  0.220 ms  0/1925 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  5.03 MBytes  42.2 Mbits/sec  0.267 ms  0/644 (0%)  
[  6]   6.00-7.00   sec  5.03 MBytes  42.2 Mbits/sec  0.333 ms  0/644 (0%)  
[  9]   6.00-7.00   sec  5.03 MBytes  42.2 Mbits/sec  0.321 ms  0/644 (0%)  
[SUM]   6.00-7.00   sec  15.1 MBytes   127 Mbits/sec  0.307 ms  0/1932 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  5.06 MBytes  42.5 Mbits/sec  0.194 ms  0/648 (0%)  
[  6]   7.00-8.00   sec  5.06 MBytes  42.5 Mbits/sec  0.190 ms  0/648 (0%)  
[  9]   7.00-8.00   sec  5.06 MBytes  42.5 Mbits/sec  0.183 ms  0/648 (0%)  
[SUM]   7.00-8.00   sec  15.2 MBytes   127 Mbits/sec  0.189 ms  0/1944 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  5.06 MBytes  42.5 Mbits/sec  0.217 ms  0/648 (0%)  
[  6]   8.00-9.00   sec  5.06 MBytes  42.5 Mbits/sec  0.222 ms  0/648 (0%)  
[  9]   8.00-9.00   sec  5.06 MBytes  42.5 Mbits/sec  0.240 ms  0/648 (0%)  
[SUM]   8.00-9.00   sec  15.2 MBytes   127 Mbits/sec  0.226 ms  0/1944 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  5.02 MBytes  42.1 Mbits/sec  0.181 ms  0/642 (0%)  
[  6]   9.00-10.00  sec  5.01 MBytes  42.0 Mbits/sec  0.156 ms  0/641 (0%)  
[  9]   9.00-10.00  sec  5.01 MBytes  42.0 Mbits/sec  0.146 ms  0/641 (0%)  
[SUM]   9.00-10.00  sec  15.0 MBytes   126 Mbits/sec  0.161 ms  0/1924 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  49.9 MBytes  41.9 Mbits/sec  0.177 ms  0/6393 (0%)  
[  4] Sent 6393 datagrams
[  6]   0.00-10.00  sec  49.9 MBytes  41.9 Mbits/sec  0.174 ms  0/6390 (0%)  
[  6] Sent 6390 datagrams
[  9]   0.00-10.00  sec  49.9 MBytes  41.9 Mbits/sec  0.144 ms  0/6387 (0%)  
[  9] Sent 6387 datagrams
[SUM]   0.00-10.00  sec   150 MBytes   126 Mbits/sec  0.165 ms  0/19170 (0%)  

iperf Done.
UDP lantiq->host
@host:		# nc -u -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc -u 10.0.0.1 4321
317MiB 0:00:29 [  13MiB/s]

TCP lantiq->host
@host:		# nc -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc 10.0.0.1 4321
558MiB 0:01:20 [7,53MiB/s]

UDP host->lantiq
@lantiq:	# nc -u -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc -u 10.0.0.80 4321
3,62GiB 0:00:40 [85,8MiB/s] to 3,98GiB 0:00:44 [  96MiB/s]

TCP host->lantiq
@lantiq:	# nc -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc 10.0.0.80 4321
1,41GiB 0:01:14 [19,8MiB/s]
+ : ':::::::[' configuration smp_icu_same_vpe ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60502 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  21.1 MBytes   177 Mbits/sec   33   72.1 KBytes       
[  4]   1.00-2.00   sec  21.2 MBytes   178 Mbits/sec   42   67.9 KBytes       
[  4]   2.00-3.00   sec  21.1 MBytes   177 Mbits/sec   40   41.0 KBytes       
[  4]   3.00-4.00   sec  21.3 MBytes   178 Mbits/sec   28   58.0 KBytes       
[  4]   4.00-5.00   sec  21.3 MBytes   178 Mbits/sec   34   59.4 KBytes       
[  4]   5.00-6.00   sec  21.2 MBytes   178 Mbits/sec   29   72.1 KBytes       
[  4]   6.00-7.00   sec  21.1 MBytes   177 Mbits/sec   32   74.9 KBytes       
[  4]   7.00-8.00   sec  20.9 MBytes   176 Mbits/sec   33   66.5 KBytes       
[  4]   8.00-9.00   sec  21.3 MBytes   179 Mbits/sec   32   70.7 KBytes       
[  4]   9.00-10.00  sec  21.2 MBytes   178 Mbits/sec   32   38.2 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   212 MBytes   178 Mbits/sec  335             sender
[  4]   0.00-10.00  sec   211 MBytes   177 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60506 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  9.66 MBytes  81.0 Mbits/sec                  
[  4]   1.00-2.00   sec  9.62 MBytes  80.7 Mbits/sec                  
[  4]   2.00-3.00   sec  9.63 MBytes  80.8 Mbits/sec                  
[  4]   3.00-4.00   sec  9.64 MBytes  80.9 Mbits/sec                  
[  4]   4.00-5.00   sec  9.60 MBytes  80.6 Mbits/sec                  
[  4]   5.00-6.00   sec  9.64 MBytes  80.9 Mbits/sec                  
[  4]   6.00-7.00   sec  9.65 MBytes  81.0 Mbits/sec                  
[  4]   7.00-8.00   sec  9.63 MBytes  80.8 Mbits/sec                  
[  4]   8.00-9.00   sec  9.65 MBytes  80.9 Mbits/sec                  
[  4]   9.00-10.00  sec  9.63 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  97.5 MBytes  81.8 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  97.5 MBytes  81.8 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 55722 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   138 Mbits/sec  2101  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2290  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2286  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2292  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2286  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2292  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2286  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  7719.884 ms  1310/1423 (92%)  
[  4] Sent 1423 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 54514 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.5 MBytes   130 Mbits/sec  0.084 ms  0/1980 (0%)  
[  4]   1.00-2.00   sec  15.4 MBytes   129 Mbits/sec  0.069 ms  0/1971 (0%)  
[  4]   2.00-3.00   sec  15.3 MBytes   129 Mbits/sec  0.091 ms  0/1962 (0%)  
[  4]   3.00-4.00   sec  15.4 MBytes   129 Mbits/sec  0.089 ms  0/1975 (0%)  
[  4]   4.00-5.00   sec  15.5 MBytes   130 Mbits/sec  0.117 ms  0/1982 (0%)  
[  4]   5.00-6.00   sec  15.5 MBytes   130 Mbits/sec  0.120 ms  0/1981 (0%)  
[  4]   6.00-7.00   sec  15.5 MBytes   130 Mbits/sec  0.113 ms  0/1982 (0%)  
[  4]   7.00-8.00   sec  14.5 MBytes   121 Mbits/sec  0.136 ms  0/1850 (0%)  
[  4]   8.00-9.00   sec  14.4 MBytes   121 Mbits/sec  0.120 ms  0/1847 (0%)  
[  4]   9.00-10.00  sec  15.1 MBytes   127 Mbits/sec  0.121 ms  0/1933 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   152 MBytes   128 Mbits/sec  0.098 ms  0/19471 (0%)  
[  4] Sent 19471 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 47588 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  59.1 MBytes   496 Mbits/sec  7568  
[  4]   1.00-2.00   sec  59.2 MBytes   497 Mbits/sec  7578  
[  4]   2.00-3.00   sec  59.8 MBytes   502 Mbits/sec  7655  
[  4]   3.00-4.00   sec  60.1 MBytes   504 Mbits/sec  7696  
[  4]   4.00-5.00   sec  58.9 MBytes   494 Mbits/sec  7533  
[  4]   5.00-6.00   sec  59.2 MBytes   497 Mbits/sec  7584  
[  4]   6.00-7.00   sec  60.1 MBytes   504 Mbits/sec  7696  
[  4]   7.00-8.00   sec  56.2 MBytes   472 Mbits/sec  7199  
[  4]   8.00-9.00   sec  60.1 MBytes   504 Mbits/sec  7691  
[  4]   9.00-10.00  sec  58.9 MBytes   494 Mbits/sec  7541  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   592 MBytes   496 Mbits/sec  57079.643 ms  64890/64972 (1e+02%)  
[  4] Sent 64972 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 36973 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.5 MBytes   130 Mbits/sec  0.078 ms  0/1981 (0%)  
[  4]   1.00-2.00   sec  15.4 MBytes   130 Mbits/sec  0.065 ms  0/1976 (0%)  
[  4]   2.00-3.00   sec  15.3 MBytes   129 Mbits/sec  0.079 ms  0/1964 (0%)  
[  4]   3.00-4.00   sec  15.4 MBytes   129 Mbits/sec  0.071 ms  0/1972 (0%)  
[  4]   4.00-5.00   sec  15.5 MBytes   130 Mbits/sec  0.154 ms  0/1985 (0%)  
[  4]   5.00-6.00   sec  15.5 MBytes   130 Mbits/sec  0.072 ms  0/1986 (0%)  
[  4]   6.00-7.00   sec  15.5 MBytes   130 Mbits/sec  0.153 ms  0/1982 (0%)  
[  4]   7.00-8.00   sec  15.4 MBytes   129 Mbits/sec  0.153 ms  0/1971 (0%)  
[  4]   8.00-9.00   sec  14.8 MBytes   124 Mbits/sec  0.088 ms  0/1897 (0%)  
[  4]   9.00-10.00  sec  15.5 MBytes   130 Mbits/sec  0.092 ms  0/1981 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   154 MBytes   129 Mbits/sec  0.091 ms  0/19702 (0%)  
[  4] Sent 19702 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 50867 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  97.5 MBytes   818 Mbits/sec  12484  
[  4]   1.00-2.00   sec  99.8 MBytes   837 Mbits/sec  12772  
[  4]   2.00-3.00   sec   100 MBytes   843 Mbits/sec  12856  
[  4]   3.00-4.00   sec   102 MBytes   851 Mbits/sec  12992  
[  4]   4.00-5.00   sec   102 MBytes   858 Mbits/sec  13089  
[  4]   5.00-6.00   sec   102 MBytes   852 Mbits/sec  12995  
[  4]   6.00-7.00   sec   102 MBytes   855 Mbits/sec  13044  
[  4]   7.00-8.00   sec   102 MBytes   858 Mbits/sec  13094  
[  4]   8.00-9.00   sec   103 MBytes   862 Mbits/sec  13148  
[  4]   9.00-10.00  sec   103 MBytes   862 Mbits/sec  13147  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1013 MBytes   849 Mbits/sec  89676.801 ms  66863/66938 (1e+02%)  
[  4] Sent 66938 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 42970 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.7 MBytes   131 Mbits/sec  0.103 ms  0/2006 (0%)  
[  4]   1.00-2.00   sec  15.6 MBytes   131 Mbits/sec  0.066 ms  0/1999 (0%)  
[  4]   2.00-3.00   sec  15.5 MBytes   130 Mbits/sec  0.276 ms  0/1982 (0%)  
[  4]   3.00-4.00   sec  15.6 MBytes   131 Mbits/sec  0.073 ms  0/1993 (0%)  
[  4]   4.00-5.00   sec  15.7 MBytes   132 Mbits/sec  0.074 ms  0/2007 (0%)  
[  4]   5.00-6.00   sec  15.7 MBytes   132 Mbits/sec  0.060 ms  0/2007 (0%)  
[  4]   6.00-7.00   sec  15.7 MBytes   132 Mbits/sec  0.079 ms  0/2007 (0%)  
[  4]   7.00-8.00   sec  15.6 MBytes   131 Mbits/sec  0.085 ms  0/1992 (0%)  
[  4]   8.00-9.00   sec  15.5 MBytes   130 Mbits/sec  0.051 ms  0/1985 (0%)  
[  4]   9.00-10.00  sec  15.5 MBytes   130 Mbits/sec  0.279 ms  0/1990 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   156 MBytes   131 Mbits/sec  0.304 ms  0/19978 (0%)  
[  4] Sent 19978 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60532 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60534 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60536 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  7.66 MBytes  64.2 Mbits/sec   80   33.9 KBytes       
[  6]   0.00-1.00   sec  7.40 MBytes  62.1 Mbits/sec   81   17.0 KBytes       
[  9]   0.00-1.00   sec  6.98 MBytes  58.6 Mbits/sec   80   19.8 KBytes       
[SUM]   0.00-1.00   sec  22.0 MBytes   185 Mbits/sec  241             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.71 MBytes  64.6 Mbits/sec   70   21.2 KBytes       
[  6]   1.00-2.00   sec  7.02 MBytes  58.9 Mbits/sec   78   19.8 KBytes       
[  9]   1.00-2.00   sec  6.59 MBytes  55.3 Mbits/sec   69   22.6 KBytes       
[SUM]   1.00-2.00   sec  21.3 MBytes   179 Mbits/sec  217             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  8.08 MBytes  67.8 Mbits/sec   80   19.8 KBytes       
[  6]   2.00-3.00   sec  7.64 MBytes  64.1 Mbits/sec   84   22.6 KBytes       
[  9]   2.00-3.00   sec  4.85 MBytes  40.7 Mbits/sec   94   11.3 KBytes       
[SUM]   2.00-3.00   sec  20.6 MBytes   173 Mbits/sec  258             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  6.28 MBytes  52.6 Mbits/sec   84   28.3 KBytes       
[  6]   3.00-4.00   sec  8.26 MBytes  69.3 Mbits/sec   72   36.8 KBytes       
[  9]   3.00-4.00   sec  6.15 MBytes  51.6 Mbits/sec   99   9.90 KBytes       
[SUM]   3.00-4.00   sec  20.7 MBytes   174 Mbits/sec  255             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  9.57 MBytes  80.3 Mbits/sec   58   32.5 KBytes       
[  6]   4.00-5.00   sec  6.59 MBytes  55.3 Mbits/sec   63   25.5 KBytes       
[  9]   4.00-5.00   sec  4.35 MBytes  36.5 Mbits/sec   91   11.3 KBytes       
[SUM]   4.00-5.00   sec  20.5 MBytes   172 Mbits/sec  212             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  8.89 MBytes  74.5 Mbits/sec  105   32.5 KBytes       
[  6]   5.00-6.00   sec  4.54 MBytes  38.0 Mbits/sec   98   38.2 KBytes       
[  9]   5.00-6.00   sec  5.90 MBytes  49.5 Mbits/sec   93   32.5 KBytes       
[SUM]   5.00-6.00   sec  19.3 MBytes   162 Mbits/sec  296             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  8.33 MBytes  69.9 Mbits/sec   78   32.5 KBytes       
[  6]   6.00-7.00   sec  5.72 MBytes  48.0 Mbits/sec  116   38.2 KBytes       
[  9]   6.00-7.00   sec  5.16 MBytes  43.3 Mbits/sec  132   32.5 KBytes       
[SUM]   6.00-7.00   sec  19.2 MBytes   161 Mbits/sec  326             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  9.20 MBytes  77.1 Mbits/sec   62   38.2 KBytes       
[  6]   7.00-8.00   sec  6.03 MBytes  50.6 Mbits/sec   93   17.0 KBytes       
[  9]   7.00-8.00   sec  5.22 MBytes  43.8 Mbits/sec   88   12.7 KBytes       
[SUM]   7.00-8.00   sec  20.4 MBytes   171 Mbits/sec  243             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  8.14 MBytes  68.3 Mbits/sec   49   35.4 KBytes       
[  6]   8.00-9.00   sec  5.65 MBytes  47.4 Mbits/sec   88   17.0 KBytes       
[  9]   8.00-9.00   sec  7.15 MBytes  60.0 Mbits/sec   96   32.5 KBytes       
[SUM]   8.00-9.00   sec  20.9 MBytes   176 Mbits/sec  233             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  7.52 MBytes  63.1 Mbits/sec   64   17.0 KBytes       
[  6]   9.00-10.00  sec  4.91 MBytes  41.2 Mbits/sec   91   11.3 KBytes       
[  9]   9.00-10.00  sec  7.83 MBytes  65.7 Mbits/sec  113   15.6 KBytes       
[SUM]   9.00-10.00  sec  20.3 MBytes   170 Mbits/sec  268             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  81.4 MBytes  68.2 Mbits/sec  730             sender
[  4]   0.00-10.00  sec  80.9 MBytes  67.9 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  63.8 MBytes  53.5 Mbits/sec  864             sender
[  6]   0.00-10.00  sec  63.4 MBytes  53.2 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  60.2 MBytes  50.5 Mbits/sec  955             sender
[  9]   0.00-10.00  sec  59.8 MBytes  50.2 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   205 MBytes   172 Mbits/sec  2549             sender
[SUM]   0.00-10.00  sec   204 MBytes   171 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60560 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60562 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60564 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.63 MBytes  30.4 Mbits/sec                  
[  6]   0.00-1.00   sec  3.62 MBytes  30.4 Mbits/sec                  
[  9]   0.00-1.00   sec  2.38 MBytes  19.9 Mbits/sec                  
[SUM]   0.00-1.00   sec  9.63 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.25 MBytes  27.2 Mbits/sec                  
[  6]   1.00-2.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   1.00-2.00   sec  3.10 MBytes  26.0 Mbits/sec                  
[SUM]   1.00-2.00   sec  9.60 MBytes  80.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   2.00-3.00   sec  3.17 MBytes  26.6 Mbits/sec                  
[  9]   2.00-3.00   sec  3.20 MBytes  26.9 Mbits/sec                  
[SUM]   2.00-3.00   sec  9.63 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.00 MBytes  25.2 Mbits/sec                  
[  6]   3.00-4.00   sec  3.00 MBytes  25.2 Mbits/sec                  
[  9]   3.00-4.00   sec  2.97 MBytes  24.9 Mbits/sec                  
[SUM]   3.00-4.00   sec  8.97 MBytes  75.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  2.81 MBytes  23.6 Mbits/sec                  
[  6]   4.00-5.00   sec  2.67 MBytes  22.4 Mbits/sec                  
[  9]   4.00-5.00   sec  2.80 MBytes  23.5 Mbits/sec                  
[SUM]   4.00-5.00   sec  8.29 MBytes  69.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.00 MBytes  25.2 Mbits/sec                  
[  6]   5.00-6.00   sec  2.89 MBytes  24.3 Mbits/sec                  
[  9]   5.00-6.00   sec  2.88 MBytes  24.1 Mbits/sec                  
[SUM]   5.00-6.00   sec  8.77 MBytes  73.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   6.00-7.00   sec  3.23 MBytes  27.1 Mbits/sec                  
[  9]   6.00-7.00   sec  3.17 MBytes  26.6 Mbits/sec                  
[SUM]   6.00-7.00   sec  9.53 MBytes  79.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.21 MBytes  26.9 Mbits/sec                  
[  6]   7.00-8.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   7.00-8.00   sec  3.20 MBytes  26.9 Mbits/sec                  
[SUM]   7.00-8.00   sec  9.54 MBytes  80.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.17 MBytes  26.6 Mbits/sec                  
[  6]   8.00-9.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   8.00-9.00   sec  3.14 MBytes  26.3 Mbits/sec                  
[SUM]   8.00-9.00   sec  9.55 MBytes  80.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.19 MBytes  26.7 Mbits/sec                  
[  6]   9.00-10.00  sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   9.00-10.00  sec  3.24 MBytes  27.2 Mbits/sec                  
[SUM]   9.00-10.00  sec  9.55 MBytes  80.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  32.6 MBytes  27.3 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  32.6 MBytes  27.3 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  32.3 MBytes  27.1 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  32.3 MBytes  27.1 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  31.0 MBytes  26.0 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  31.0 MBytes  26.0 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  95.9 MBytes  80.4 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec  95.9 MBytes  80.4 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 51700 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 43404 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 38091 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  36.8 MBytes   309 Mbits/sec  4708  
[  6]   0.00-1.00   sec  36.8 MBytes   309 Mbits/sec  4708  
[  9]   0.00-1.00   sec  36.8 MBytes   309 Mbits/sec  4708  
[SUM]   0.00-1.00   sec   110 MBytes   926 Mbits/sec  14124  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.5 MBytes   315 Mbits/sec  4800  
[  6]   1.00-2.00   sec  37.5 MBytes   315 Mbits/sec  4800  
[  9]   1.00-2.00   sec  37.5 MBytes   315 Mbits/sec  4800  
[SUM]   1.00-2.00   sec   112 MBytes   944 Mbits/sec  14400  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  6]   2.00-3.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  9]   2.00-3.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[SUM]   2.00-3.00   sec   113 MBytes   944 Mbits/sec  14403  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  6]   3.00-4.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  9]   3.00-4.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[SUM]   3.00-4.00   sec   112 MBytes   943 Mbits/sec  14382  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4793  
[  6]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4793  
[  9]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec  4793  
[SUM]   4.00-5.00   sec   112 MBytes   942 Mbits/sec  14379  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[  6]   5.00-6.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[  9]   5.00-6.00   sec  37.4 MBytes   314 Mbits/sec  4792  
[SUM]   5.00-6.00   sec   112 MBytes   942 Mbits/sec  14376  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  6]   6.00-7.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  9]   6.00-7.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[SUM]   6.00-7.00   sec   113 MBytes   944 Mbits/sec  14403  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.5 MBytes   315 Mbits/sec  4802  
[  6]   7.00-8.00   sec  37.5 MBytes   315 Mbits/sec  4802  
[  9]   7.00-8.00   sec  37.5 MBytes   315 Mbits/sec  4802  
[SUM]   7.00-8.00   sec   113 MBytes   944 Mbits/sec  14406  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  6]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  9]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[SUM]   8.00-9.00   sec   112 MBytes   943 Mbits/sec  14382  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.5 MBytes   315 Mbits/sec  4800  
[  6]   9.00-10.00  sec  37.5 MBytes   315 Mbits/sec  4800  
[  9]   9.00-10.00  sec  37.5 MBytes   315 Mbits/sec  4800  
[SUM]   9.00-10.00  sec   112 MBytes   944 Mbits/sec  14400  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   374 MBytes   314 Mbits/sec  6770189.413 ms  44145/44153 (1e+02%)  
[  4] Sent 44153 datagrams
[  6]   0.00-10.00  sec   374 MBytes   314 Mbits/sec  7221535.397 ms  44146/44153 (1e+02%)  
[  6] Sent 44153 datagrams
[  9]   0.00-10.00  sec   374 MBytes   314 Mbits/sec  7702970.989 ms  258/264 (98%)  
[  9] Sent 264 datagrams
[SUM]   0.00-10.00  sec  1.10 GBytes   941 Mbits/sec  7231565.266 ms  88549/88570 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 53441 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 46065 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 45591 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  4.99 MBytes  41.9 Mbits/sec  0.131 ms  0/639 (0%)  
[  6]   0.00-1.00   sec  4.99 MBytes  41.9 Mbits/sec  0.156 ms  0/639 (0%)  
[  9]   0.00-1.00   sec  4.99 MBytes  41.9 Mbits/sec  0.196 ms  0/639 (0%)  
[SUM]   0.00-1.00   sec  15.0 MBytes   126 Mbits/sec  0.161 ms  0/1917 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  5.02 MBytes  42.1 Mbits/sec  0.321 ms  0/642 (0%)  
[  6]   1.00-2.00   sec  5.01 MBytes  42.0 Mbits/sec  0.152 ms  0/641 (0%)  
[  9]   1.00-2.00   sec  5.01 MBytes  42.0 Mbits/sec  0.392 ms  0/641 (0%)  
[SUM]   1.00-2.00   sec  15.0 MBytes   126 Mbits/sec  0.288 ms  0/1924 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  4.63 MBytes  38.9 Mbits/sec  0.104 ms  0/593 (0%)  
[  6]   2.00-3.00   sec  4.63 MBytes  38.9 Mbits/sec  0.108 ms  0/593 (0%)  
[  9]   2.00-3.00   sec  4.63 MBytes  38.9 Mbits/sec  0.167 ms  0/593 (0%)  
[SUM]   2.00-3.00   sec  13.9 MBytes   117 Mbits/sec  0.126 ms  0/1779 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  4.91 MBytes  41.2 Mbits/sec  0.165 ms  0/629 (0%)  
[  6]   3.00-4.00   sec  4.91 MBytes  41.2 Mbits/sec  0.139 ms  0/629 (0%)  
[  9]   3.00-4.00   sec  4.91 MBytes  41.2 Mbits/sec  0.223 ms  0/629 (0%)  
[SUM]   3.00-4.00   sec  14.7 MBytes   124 Mbits/sec  0.176 ms  0/1887 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  5.05 MBytes  42.4 Mbits/sec  0.171 ms  0/647 (0%)  
[  6]   4.00-5.00   sec  5.05 MBytes  42.4 Mbits/sec  0.182 ms  0/647 (0%)  
[  9]   4.00-5.00   sec  5.05 MBytes  42.4 Mbits/sec  0.182 ms  0/647 (0%)  
[SUM]   4.00-5.00   sec  15.2 MBytes   127 Mbits/sec  0.178 ms  0/1941 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  5.04 MBytes  42.3 Mbits/sec  0.173 ms  0/645 (0%)  
[  6]   5.00-6.00   sec  5.03 MBytes  42.2 Mbits/sec  0.177 ms  0/644 (0%)  
[  9]   5.00-6.00   sec  5.03 MBytes  42.2 Mbits/sec  0.169 ms  0/644 (0%)  
[SUM]   5.00-6.00   sec  15.1 MBytes   127 Mbits/sec  0.173 ms  0/1933 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  5.01 MBytes  42.0 Mbits/sec  0.194 ms  0/641 (0%)  
[  6]   6.00-7.00   sec  5.00 MBytes  41.9 Mbits/sec  0.192 ms  0/640 (0%)  
[  9]   6.00-7.00   sec  5.00 MBytes  41.9 Mbits/sec  0.194 ms  0/640 (0%)  
[SUM]   6.00-7.00   sec  15.0 MBytes   126 Mbits/sec  0.193 ms  0/1921 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  5.03 MBytes  42.2 Mbits/sec  0.110 ms  0/644 (0%)  
[  6]   7.00-8.00   sec  5.02 MBytes  42.1 Mbits/sec  0.214 ms  0/643 (0%)  
[  9]   7.00-8.00   sec  5.02 MBytes  42.1 Mbits/sec  0.193 ms  0/643 (0%)  
[SUM]   7.00-8.00   sec  15.1 MBytes   126 Mbits/sec  0.172 ms  0/1930 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  5.05 MBytes  42.4 Mbits/sec  0.168 ms  0/647 (0%)  
[  6]   8.00-9.00   sec  5.05 MBytes  42.4 Mbits/sec  0.197 ms  0/647 (0%)  
[  9]   8.00-9.00   sec  5.05 MBytes  42.4 Mbits/sec  0.223 ms  0/647 (0%)  
[SUM]   8.00-9.00   sec  15.2 MBytes   127 Mbits/sec  0.196 ms  0/1941 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  5.07 MBytes  42.5 Mbits/sec  0.153 ms  0/649 (0%)  
[  6]   9.00-10.00  sec  5.06 MBytes  42.5 Mbits/sec  0.236 ms  0/648 (0%)  
[  9]   9.00-10.00  sec  5.05 MBytes  42.4 Mbits/sec  0.260 ms  0/647 (0%)  
[SUM]   9.00-10.00  sec  15.2 MBytes   127 Mbits/sec  0.216 ms  0/1944 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  49.9 MBytes  41.8 Mbits/sec  0.209 ms  0/6383 (0%)  
[  4] Sent 6383 datagrams
[  6]   0.00-10.00  sec  49.8 MBytes  41.8 Mbits/sec  0.229 ms  0/6378 (0%)  
[  6] Sent 6378 datagrams
[  9]   0.00-10.00  sec  49.8 MBytes  41.8 Mbits/sec  0.301 ms  0/6377 (0%)  
[  9] Sent 6377 datagrams
[SUM]   0.00-10.00  sec   150 MBytes   125 Mbits/sec  0.246 ms  0/19138 (0%)  

iperf Done.
+ : ':::::::[' configuration smp_icu_same_vpe ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60574 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  21.0 MBytes   176 Mbits/sec   32   50.9 KBytes       
[  4]   1.00-2.00   sec  21.1 MBytes   177 Mbits/sec   38   74.9 KBytes       
[  4]   2.00-3.00   sec  20.7 MBytes   174 Mbits/sec   40   63.6 KBytes       
[  4]   3.00-4.00   sec  20.6 MBytes   173 Mbits/sec   34   77.8 KBytes       
[  4]   4.00-5.00   sec  20.9 MBytes   176 Mbits/sec   41   69.3 KBytes       
[  4]   5.00-6.00   sec  21.1 MBytes   177 Mbits/sec   36   67.9 KBytes       
[  4]   6.00-7.00   sec  21.1 MBytes   177 Mbits/sec   33   66.5 KBytes       
[  4]   7.00-8.00   sec  20.9 MBytes   175 Mbits/sec   32   60.8 KBytes       
[  4]   8.00-9.00   sec  20.7 MBytes   174 Mbits/sec   43   73.5 KBytes       
[  4]   9.00-10.00  sec  20.5 MBytes   172 Mbits/sec   34   53.7 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   209 MBytes   175 Mbits/sec  363             sender
[  4]   0.00-10.00  sec   208 MBytes   175 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60578 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  9.58 MBytes  80.4 Mbits/sec                  
[  4]   1.00-2.00   sec  9.58 MBytes  80.4 Mbits/sec                  
[  4]   2.00-3.00   sec  9.62 MBytes  80.7 Mbits/sec                  
[  4]   3.00-4.00   sec  9.58 MBytes  80.3 Mbits/sec                  
[  4]   4.00-5.00   sec  9.61 MBytes  80.6 Mbits/sec                  
[  4]   5.00-6.00   sec  11.2 MBytes  94.1 Mbits/sec                  
[  4]   6.00-7.00   sec  11.3 MBytes  94.6 Mbits/sec                  
[  4]   7.00-8.00   sec  12.4 MBytes   104 Mbits/sec                  
[  4]   8.00-9.00   sec  13.4 MBytes   112 Mbits/sec                  
[  4]   9.00-10.00  sec  13.2 MBytes   111 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   110 MBytes  92.1 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   110 MBytes  92.0 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 57465 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   138 Mbits/sec  2100  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2292  
[  4]   2.00-3.00   sec  17.8 MBytes   150 Mbits/sec  2282  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2296  
[  4]   4.00-5.00   sec  17.8 MBytes   150 Mbits/sec  2284  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2293  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2286  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2286  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  36331.186 ms  1332/1421 (94%)  
[  4] Sent 1421 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 54737 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.3 MBytes   129 Mbits/sec  0.221 ms  0/1963 (0%)  
[  4]   1.00-2.00   sec  15.4 MBytes   129 Mbits/sec  0.089 ms  0/1976 (0%)  
[  4]   2.00-3.00   sec  15.5 MBytes   130 Mbits/sec  0.069 ms  0/1986 (0%)  
[  4]   3.00-4.00   sec  15.5 MBytes   130 Mbits/sec  0.084 ms  0/1985 (0%)  
[  4]   4.00-5.00   sec  15.5 MBytes   130 Mbits/sec  0.064 ms  0/1984 (0%)  
[  4]   5.00-6.00   sec  15.4 MBytes   129 Mbits/sec  0.264 ms  0/1969 (0%)  
[  4]   6.00-7.00   sec  15.3 MBytes   129 Mbits/sec  0.069 ms  0/1963 (0%)  
[  4]   7.00-8.00   sec  15.4 MBytes   129 Mbits/sec  0.073 ms  0/1976 (0%)  
[  4]   8.00-9.00   sec  15.4 MBytes   129 Mbits/sec  0.070 ms  0/1975 (0%)  
[  4]   9.00-10.00  sec  15.4 MBytes   129 Mbits/sec  0.091 ms  0/1973 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   154 MBytes   129 Mbits/sec  0.102 ms  0/19756 (0%)  
[  4] Sent 19756 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 36414 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  59.5 MBytes   499 Mbits/sec  7621  
[  4]   1.00-2.00   sec  58.8 MBytes   493 Mbits/sec  7527  
[  4]   2.00-3.00   sec  59.7 MBytes   501 Mbits/sec  7642  
[  4]   3.00-4.00   sec  60.0 MBytes   504 Mbits/sec  7685  
[  4]   4.00-5.00   sec  59.7 MBytes   501 Mbits/sec  7639  
[  4]   5.00-6.00   sec  58.5 MBytes   491 Mbits/sec  7484  
[  4]   6.00-7.00   sec  60.2 MBytes   505 Mbits/sec  7710  
[  4]   7.00-8.00   sec  60.3 MBytes   506 Mbits/sec  7718  
[  4]   8.00-9.00   sec  58.5 MBytes   490 Mbits/sec  7484  
[  4]   9.00-10.00  sec  59.5 MBytes   499 Mbits/sec  7610  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   595 MBytes   499 Mbits/sec  1438505.745 ms  64069/64101 (1e+02%)  
[  4] Sent 64101 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 58013 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.2 MBytes   128 Mbits/sec  0.051 ms  0/1952 (0%)  
[  4]   1.00-2.00   sec  15.4 MBytes   129 Mbits/sec  0.074 ms  0/1965 (0%)  
[  4]   2.00-3.00   sec  15.5 MBytes   130 Mbits/sec  0.084 ms  0/1981 (0%)  
[  4]   3.00-4.00   sec  15.5 MBytes   130 Mbits/sec  0.060 ms  0/1979 (0%)  
[  4]   4.00-5.00   sec  15.5 MBytes   130 Mbits/sec  0.095 ms  0/1980 (0%)  
[  4]   5.00-6.00   sec  15.4 MBytes   129 Mbits/sec  0.071 ms  0/1969 (0%)  
[  4]   6.00-7.00   sec  15.3 MBytes   128 Mbits/sec  0.084 ms  0/1960 (0%)  
[  4]   7.00-8.00   sec  15.4 MBytes   129 Mbits/sec  0.076 ms  0/1969 (0%)  
[  4]   8.00-9.00   sec  15.5 MBytes   130 Mbits/sec  0.071 ms  0/1979 (0%)  
[  4]   9.00-10.00  sec  15.5 MBytes   130 Mbits/sec  0.154 ms  0/1979 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   154 MBytes   129 Mbits/sec  0.131 ms  0/19720 (0%)  
[  4] Sent 19720 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 39332 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec   104 MBytes   875 Mbits/sec  13359  
[  4]   1.00-2.00   sec   104 MBytes   874 Mbits/sec  13340  
[  4]   2.00-3.00   sec   105 MBytes   882 Mbits/sec  13461  
[  4]   3.00-4.00   sec   106 MBytes   891 Mbits/sec  13592  
[  4]   4.00-5.00   sec   106 MBytes   886 Mbits/sec  13517  
[  4]   5.00-6.00   sec   107 MBytes   898 Mbits/sec  13697  
[  4]   6.00-7.00   sec   107 MBytes   898 Mbits/sec  13701  
[  4]   7.00-8.00   sec   107 MBytes   899 Mbits/sec  13718  
[  4]   8.00-9.00   sec   107 MBytes   897 Mbits/sec  13685  
[  4]   9.00-10.00  sec   104 MBytes   869 Mbits/sec  13267  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.03 GBytes   887 Mbits/sec  5950362.269 ms  0/10 (0%)  
[  4] Sent 10 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 46998 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.3 MBytes   128 Mbits/sec  0.067 ms  0/1956 (0%)  
[  4]   1.00-2.00   sec  15.3 MBytes   129 Mbits/sec  0.071 ms  0/1964 (0%)  
[  4]   2.00-3.00   sec  15.5 MBytes   130 Mbits/sec  0.084 ms  0/1978 (0%)  
[  4]   3.00-4.00   sec  15.5 MBytes   130 Mbits/sec  0.074 ms  0/1978 (0%)  
[  4]   4.00-5.00   sec  15.5 MBytes   130 Mbits/sec  0.072 ms  0/1978 (0%)  
[  4]   5.00-6.00   sec  15.4 MBytes   129 Mbits/sec  0.088 ms  0/1966 (0%)  
[  4]   6.00-7.00   sec  15.3 MBytes   128 Mbits/sec  0.088 ms  0/1955 (0%)  
[  4]   7.00-8.00   sec  15.4 MBytes   129 Mbits/sec  0.102 ms  0/1966 (0%)  
[  4]   8.00-9.00   sec  15.5 MBytes   130 Mbits/sec  0.071 ms  0/1978 (0%)  
[  4]   9.00-10.00  sec  15.4 MBytes   130 Mbits/sec  0.078 ms  0/1977 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   154 MBytes   129 Mbits/sec  0.088 ms  0/19703 (0%)  
[  4] Sent 19703 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 60616 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60618 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60620 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  8.14 MBytes  68.2 Mbits/sec   88   55.1 KBytes       
[  6]   0.00-1.00   sec  7.90 MBytes  66.2 Mbits/sec   55   55.1 KBytes       
[  9]   0.00-1.00   sec  5.58 MBytes  46.8 Mbits/sec  104   36.8 KBytes       
[SUM]   0.00-1.00   sec  21.6 MBytes   181 Mbits/sec  247             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  6.84 MBytes  57.4 Mbits/sec   96   14.1 KBytes       
[  6]   1.00-2.00   sec  6.28 MBytes  52.7 Mbits/sec   98   33.9 KBytes       
[  9]   1.00-2.00   sec  6.71 MBytes  56.4 Mbits/sec   85   19.8 KBytes       
[SUM]   1.00-2.00   sec  19.8 MBytes   166 Mbits/sec  279             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  6.34 MBytes  53.2 Mbits/sec   77   18.4 KBytes       
[  6]   2.00-3.00   sec  7.52 MBytes  63.1 Mbits/sec   61   15.6 KBytes       
[  9]   2.00-3.00   sec  7.21 MBytes  60.5 Mbits/sec   61   15.6 KBytes       
[SUM]   2.00-3.00   sec  21.1 MBytes   177 Mbits/sec  199             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  8.70 MBytes  73.0 Mbits/sec   61   17.0 KBytes       
[  6]   3.00-4.00   sec  6.59 MBytes  55.2 Mbits/sec   76   22.6 KBytes       
[  9]   3.00-4.00   sec  5.97 MBytes  50.0 Mbits/sec   72   33.9 KBytes       
[SUM]   3.00-4.00   sec  21.3 MBytes   178 Mbits/sec  209             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  8.26 MBytes  69.3 Mbits/sec   71   26.9 KBytes       
[  6]   4.00-5.00   sec  6.09 MBytes  51.1 Mbits/sec  105   8.48 KBytes       
[  9]   4.00-5.00   sec  5.65 MBytes  47.4 Mbits/sec   94   19.8 KBytes       
[SUM]   4.00-5.00   sec  20.0 MBytes   168 Mbits/sec  270             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  8.26 MBytes  69.3 Mbits/sec   81   46.7 KBytes       
[  6]   5.00-6.00   sec  5.28 MBytes  44.3 Mbits/sec   93   24.0 KBytes       
[  9]   5.00-6.00   sec  6.15 MBytes  51.6 Mbits/sec  107   32.5 KBytes       
[SUM]   5.00-6.00   sec  19.7 MBytes   165 Mbits/sec  281             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  8.82 MBytes  74.0 Mbits/sec   67   36.8 KBytes       
[  6]   6.00-7.00   sec  5.65 MBytes  47.4 Mbits/sec   94   17.0 KBytes       
[  9]   6.00-7.00   sec  6.34 MBytes  53.2 Mbits/sec   87   11.3 KBytes       
[SUM]   6.00-7.00   sec  20.8 MBytes   175 Mbits/sec  248             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  7.58 MBytes  63.6 Mbits/sec   86   42.4 KBytes       
[  6]   7.00-8.00   sec  5.90 MBytes  49.5 Mbits/sec   73   21.2 KBytes       
[  9]   7.00-8.00   sec  7.21 MBytes  60.4 Mbits/sec   76   8.48 KBytes       
[SUM]   7.00-8.00   sec  20.7 MBytes   174 Mbits/sec  235             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  7.95 MBytes  66.7 Mbits/sec   65   18.4 KBytes       
[  6]   8.00-9.00   sec  7.21 MBytes  60.5 Mbits/sec   64   22.6 KBytes       
[  9]   8.00-9.00   sec  5.16 MBytes  43.3 Mbits/sec   86   15.6 KBytes       
[SUM]   8.00-9.00   sec  20.3 MBytes   171 Mbits/sec  215             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  7.15 MBytes  60.0 Mbits/sec   92   50.9 KBytes       
[  6]   9.00-10.00  sec  7.15 MBytes  60.0 Mbits/sec   74   9.90 KBytes       
[  9]   9.00-10.00  sec  6.21 MBytes  52.1 Mbits/sec  103   9.90 KBytes       
[SUM]   9.00-10.00  sec  20.5 MBytes   172 Mbits/sec  269             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  78.1 MBytes  65.5 Mbits/sec  784             sender
[  4]   0.00-10.00  sec  77.7 MBytes  65.1 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  65.6 MBytes  55.0 Mbits/sec  793             sender
[  6]   0.00-10.00  sec  65.2 MBytes  54.7 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  62.2 MBytes  52.2 Mbits/sec  875             sender
[  9]   0.00-10.00  sec  61.8 MBytes  51.8 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   206 MBytes   173 Mbits/sec  2452             sender
[SUM]   0.00-10.00  sec   205 MBytes   172 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 60638 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 60640 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60642 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.58 MBytes  30.0 Mbits/sec                  
[  6]   0.00-1.00   sec  3.62 MBytes  30.4 Mbits/sec                  
[  9]   0.00-1.00   sec  2.31 MBytes  19.3 Mbits/sec                  
[SUM]   0.00-1.00   sec  9.51 MBytes  79.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.23 MBytes  27.1 Mbits/sec                  
[  6]   1.00-2.00   sec  3.20 MBytes  26.9 Mbits/sec                  
[  9]   1.00-2.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[SUM]   1.00-2.00   sec  9.56 MBytes  80.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   2.00-3.00   sec  3.17 MBytes  26.6 Mbits/sec                  
[  9]   2.00-3.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[SUM]   2.00-3.00   sec  9.55 MBytes  80.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   3.00-4.00   sec  3.19 MBytes  26.8 Mbits/sec                  
[  9]   3.00-4.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[SUM]   3.00-4.00   sec  9.56 MBytes  80.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  6]   4.00-5.00   sec  3.17 MBytes  26.6 Mbits/sec                  
[  9]   4.00-5.00   sec  3.16 MBytes  26.5 Mbits/sec                  
[SUM]   4.00-5.00   sec  9.46 MBytes  79.4 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.22 MBytes  27.0 Mbits/sec                  
[  6]   5.00-6.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   5.00-6.00   sec  3.21 MBytes  26.9 Mbits/sec                  
[SUM]   5.00-6.00   sec  9.55 MBytes  80.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.16 MBytes  26.5 Mbits/sec                  
[  6]   6.00-7.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   6.00-7.00   sec  3.15 MBytes  26.4 Mbits/sec                  
[SUM]   6.00-7.00   sec  9.56 MBytes  80.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.18 MBytes  26.7 Mbits/sec                  
[  6]   7.00-8.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   7.00-8.00   sec  3.23 MBytes  27.1 Mbits/sec                  
[SUM]   7.00-8.00   sec  9.53 MBytes  80.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.19 MBytes  26.8 Mbits/sec                  
[  6]   8.00-9.00   sec  3.22 MBytes  27.0 Mbits/sec                  
[  9]   8.00-9.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[SUM]   8.00-9.00   sec  9.54 MBytes  80.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.15 MBytes  26.4 Mbits/sec                  
[  6]   9.00-10.00  sec  3.15 MBytes  26.4 Mbits/sec                  
[  9]   9.00-10.00  sec  3.25 MBytes  27.3 Mbits/sec                  
[SUM]   9.00-10.00  sec  9.55 MBytes  80.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  32.4 MBytes  27.2 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  32.4 MBytes  27.2 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  32.3 MBytes  27.1 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  32.3 MBytes  27.1 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  31.0 MBytes  26.0 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  31.0 MBytes  26.0 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  95.7 MBytes  80.3 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec  95.7 MBytes  80.3 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 56394 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 55930 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 59942 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  37.2 MBytes   312 Mbits/sec  4759  
[  6]   0.00-1.00   sec  37.2 MBytes   312 Mbits/sec  4759  
[  9]   0.00-1.00   sec  37.2 MBytes   312 Mbits/sec  4759  
[SUM]   0.00-1.00   sec   112 MBytes   936 Mbits/sec  14277  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  37.3 MBytes   313 Mbits/sec  4769  
[  6]   1.00-2.00   sec  37.3 MBytes   313 Mbits/sec  4769  
[  9]   1.00-2.00   sec  37.3 MBytes   313 Mbits/sec  4769  
[SUM]   1.00-2.00   sec   112 MBytes   938 Mbits/sec  14307  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  6]   2.00-3.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[  9]   2.00-3.00   sec  37.5 MBytes   314 Mbits/sec  4794  
[SUM]   2.00-3.00   sec   112 MBytes   943 Mbits/sec  14382  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  6]   3.00-4.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[  9]   3.00-4.00   sec  37.5 MBytes   315 Mbits/sec  4801  
[SUM]   3.00-4.00   sec   113 MBytes   944 Mbits/sec  14403  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  37.5 MBytes   315 Mbits/sec  4806  
[  6]   4.00-5.00   sec  37.5 MBytes   315 Mbits/sec  4806  
[  9]   4.00-5.00   sec  37.5 MBytes   315 Mbits/sec  4806  
[SUM]   4.00-5.00   sec   113 MBytes   945 Mbits/sec  14418  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4798  
[  6]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4798  
[  9]   5.00-6.00   sec  37.5 MBytes   315 Mbits/sec  4798  
[SUM]   5.00-6.00   sec   112 MBytes   944 Mbits/sec  14394  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  37.1 MBytes   311 Mbits/sec  4752  
[  6]   6.00-7.00   sec  37.1 MBytes   311 Mbits/sec  4752  
[  9]   6.00-7.00   sec  37.1 MBytes   311 Mbits/sec  4752  
[SUM]   6.00-7.00   sec   111 MBytes   934 Mbits/sec  14256  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  37.4 MBytes   314 Mbits/sec  4785  
[  6]   7.00-8.00   sec  37.4 MBytes   314 Mbits/sec  4785  
[  9]   7.00-8.00   sec  37.4 MBytes   314 Mbits/sec  4785  
[SUM]   7.00-8.00   sec   112 MBytes   941 Mbits/sec  14355  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4799  
[  6]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4799  
[  9]   8.00-9.00   sec  37.5 MBytes   314 Mbits/sec  4799  
[SUM]   8.00-9.00   sec   112 MBytes   943 Mbits/sec  14397  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.5 MBytes   314 Mbits/sec  4796  
[  6]   9.00-10.00  sec  37.5 MBytes   314 Mbits/sec  4796  
[  9]   9.00-10.00  sec  37.5 MBytes   314 Mbits/sec  4796  
[SUM]   9.00-10.00  sec   112 MBytes   943 Mbits/sec  14388  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   374 MBytes   314 Mbits/sec  4902947.942 ms  455/468 (97%)  
[  4] Sent 468 datagrams
[  6]   0.00-10.00  sec   374 MBytes   314 Mbits/sec  5229810.948 ms  416/428 (97%)  
[  6] Sent 428 datagrams
[  9]   0.00-10.00  sec   374 MBytes   314 Mbits/sec  5229810.777 ms  43761/43773 (1e+02%)  
[  9] Sent 43773 datagrams
[SUM]   0.00-10.00  sec  1.10 GBytes   941 Mbits/sec  5120856.555 ms  44632/44669 (1e+02%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 56299 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 38712 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 46097 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  5.05 MBytes  42.3 Mbits/sec  0.256 ms  0/646 (0%)  
[  6]   0.00-1.00   sec  5.04 MBytes  42.3 Mbits/sec  0.134 ms  0/645 (0%)  
[  9]   0.00-1.00   sec  5.04 MBytes  42.3 Mbits/sec  0.317 ms  0/645 (0%)  
[SUM]   0.00-1.00   sec  15.1 MBytes   127 Mbits/sec  0.236 ms  0/1936 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  5.05 MBytes  42.4 Mbits/sec  0.166 ms  0/647 (0%)  
[  6]   1.00-2.00   sec  5.05 MBytes  42.4 Mbits/sec  0.132 ms  0/647 (0%)  
[  9]   1.00-2.00   sec  5.05 MBytes  42.3 Mbits/sec  0.248 ms  0/646 (0%)  
[SUM]   1.00-2.00   sec  15.2 MBytes   127 Mbits/sec  0.182 ms  0/1940 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  5.05 MBytes  42.4 Mbits/sec  0.299 ms  0/647 (0%)  
[  6]   2.00-3.00   sec  5.05 MBytes  42.4 Mbits/sec  0.179 ms  0/647 (0%)  
[  9]   2.00-3.00   sec  5.05 MBytes  42.3 Mbits/sec  0.445 ms  0/646 (0%)  
[SUM]   2.00-3.00   sec  15.2 MBytes   127 Mbits/sec  0.308 ms  0/1940 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  5.03 MBytes  42.2 Mbits/sec  0.143 ms  0/644 (0%)  
[  6]   3.00-4.00   sec  5.02 MBytes  42.1 Mbits/sec  0.114 ms  0/643 (0%)  
[  9]   3.00-4.00   sec  5.03 MBytes  42.2 Mbits/sec  0.253 ms  0/644 (0%)  
[SUM]   3.00-4.00   sec  15.1 MBytes   127 Mbits/sec  0.170 ms  0/1931 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  5.00 MBytes  41.9 Mbits/sec  0.160 ms  0/640 (0%)  
[  6]   4.00-5.00   sec  5.00 MBytes  41.9 Mbits/sec  0.116 ms  0/640 (0%)  
[  9]   4.00-5.00   sec  4.99 MBytes  41.9 Mbits/sec  0.155 ms  0/639 (0%)  
[SUM]   4.00-5.00   sec  15.0 MBytes   126 Mbits/sec  0.144 ms  0/1919 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  5.02 MBytes  42.1 Mbits/sec  0.218 ms  0/642 (0%)  
[  6]   5.00-6.00   sec  5.02 MBytes  42.1 Mbits/sec  0.199 ms  0/642 (0%)  
[  9]   5.00-6.00   sec  5.02 MBytes  42.1 Mbits/sec  0.140 ms  0/642 (0%)  
[SUM]   5.00-6.00   sec  15.0 MBytes   126 Mbits/sec  0.186 ms  0/1926 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  5.05 MBytes  42.3 Mbits/sec  0.284 ms  0/646 (0%)  
[  6]   6.00-7.00   sec  5.05 MBytes  42.3 Mbits/sec  0.132 ms  0/646 (0%)  
[  9]   6.00-7.00   sec  5.04 MBytes  42.3 Mbits/sec  0.181 ms  0/645 (0%)  
[SUM]   6.00-7.00   sec  15.1 MBytes   127 Mbits/sec  0.199 ms  0/1937 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  5.05 MBytes  42.3 Mbits/sec  0.137 ms  0/646 (0%)  
[  6]   7.00-8.00   sec  5.05 MBytes  42.3 Mbits/sec  0.167 ms  0/646 (0%)  
[  9]   7.00-8.00   sec  5.05 MBytes  42.3 Mbits/sec  0.156 ms  0/646 (0%)  
[SUM]   7.00-8.00   sec  15.1 MBytes   127 Mbits/sec  0.153 ms  0/1938 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  5.05 MBytes  42.4 Mbits/sec  0.193 ms  0/647 (0%)  
[  6]   8.00-9.00   sec  5.05 MBytes  42.3 Mbits/sec  0.210 ms  0/646 (0%)  
[  9]   8.00-9.00   sec  5.05 MBytes  42.3 Mbits/sec  0.157 ms  0/646 (0%)  
[SUM]   8.00-9.00   sec  15.1 MBytes   127 Mbits/sec  0.186 ms  0/1939 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  5.02 MBytes  42.1 Mbits/sec  0.172 ms  0/642 (0%)  
[  6]   9.00-10.00  sec  5.02 MBytes  42.1 Mbits/sec  0.130 ms  0/643 (0%)  
[  9]   9.00-10.00  sec  5.02 MBytes  42.1 Mbits/sec  0.273 ms  0/642 (0%)  
[SUM]   9.00-10.00  sec  15.1 MBytes   126 Mbits/sec  0.192 ms  0/1927 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  50.4 MBytes  42.3 Mbits/sec  0.156 ms  0/6454 (0%)  
[  4] Sent 6454 datagrams
[  6]   0.00-10.00  sec  50.4 MBytes  42.3 Mbits/sec  0.163 ms  0/6452 (0%)  
[  6] Sent 6452 datagrams
[  9]   0.00-10.00  sec  50.4 MBytes  42.3 Mbits/sec  0.299 ms  0/6448 (0%)  
[  9] Sent 6448 datagrams
[SUM]   0.00-10.00  sec   151 MBytes   127 Mbits/sec  0.206 ms  0/19354 (0%)  

iperf Done.
UDP lantiq->host
@host:		# nc -u -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc -u 10.0.0.1 4321
634MiB 0:00:52 [13,1MiB/s]

TCP lantiq->host
@host:		# nc -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc 10.0.0.1 4321
175MiB 0:00:29 [6,69MiB/s] or 220MiB 0:00:35 [8,32MiB/s]

UDP host->lantiq
@lantiq:	# nc -u -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc -u 10.0.0.80 4321
3,77GiB 0:00:42 [  81MiB/s] to 4,13GiB 0:00:46 [ 100MiB/s]

TCP host->lantiq
@lantiq:	# nc -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc 10.0.0.80 4321
264MiB 0:00:14 [16,3MiB/s] or 621MiB 0:00:32 [20,8MiB/s]
+ : ':::::::[' configuration vanilla ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 51814 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  21.2 MBytes   178 Mbits/sec   27   72.1 KBytes       
[  4]   1.00-2.00   sec  20.6 MBytes   173 Mbits/sec   29   70.7 KBytes       
[  4]   2.00-3.00   sec  20.8 MBytes   174 Mbits/sec   35   60.8 KBytes       
[  4]   3.00-4.00   sec  20.8 MBytes   174 Mbits/sec   29   73.5 KBytes       
[  4]   4.00-5.00   sec  20.8 MBytes   174 Mbits/sec   32   70.7 KBytes       
[  4]   5.00-6.00   sec  20.7 MBytes   174 Mbits/sec   35   69.3 KBytes       
[  4]   6.00-7.00   sec  20.8 MBytes   174 Mbits/sec   36   60.8 KBytes       
[  4]   7.00-8.00   sec  20.8 MBytes   175 Mbits/sec   29   59.4 KBytes       
[  4]   8.00-9.00   sec  20.8 MBytes   175 Mbits/sec   41   46.7 KBytes       
[  4]   9.00-10.00  sec  20.8 MBytes   175 Mbits/sec   28   50.9 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   208 MBytes   174 Mbits/sec  321             sender
[  4]   0.00-10.00  sec   208 MBytes   174 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 51862 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  9.63 MBytes  80.7 Mbits/sec                  
[  4]   1.00-2.00   sec  9.65 MBytes  81.0 Mbits/sec                  
[  4]   2.00-3.00   sec  9.52 MBytes  79.9 Mbits/sec                  
[  4]   3.00-4.00   sec  9.69 MBytes  81.3 Mbits/sec                  
[  4]   4.00-5.00   sec  9.68 MBytes  81.2 Mbits/sec                  
[  4]   5.00-6.00   sec  9.66 MBytes  81.0 Mbits/sec                  
[  4]   6.00-7.00   sec  9.68 MBytes  81.2 Mbits/sec                  
[  4]   7.00-8.00   sec  9.70 MBytes  81.4 Mbits/sec                  
[  4]   8.00-9.00   sec  9.69 MBytes  81.3 Mbits/sec                  
[  4]   9.00-10.00  sec  9.79 MBytes  82.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  97.0 MBytes  81.4 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  97.0 MBytes  81.4 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 51957 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   138 Mbits/sec  2101  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2285  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2292  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2287  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2291  
[  4]   8.00-9.00   sec  17.8 MBytes   150 Mbits/sec  2282  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2292  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  136434.385 ms  1349/1417 (95%)  
[  4] Sent 1417 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 46317 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  14.7 MBytes   124 Mbits/sec  0.077 ms  0/1885 (0%)  
[  4]   1.00-2.00   sec  15.2 MBytes   127 Mbits/sec  0.072 ms  0/1942 (0%)  
[  4]   2.00-3.00   sec  15.0 MBytes   126 Mbits/sec  0.074 ms  0/1924 (0%)  
[  4]   3.00-4.00   sec  14.3 MBytes   120 Mbits/sec  0.080 ms  0/1825 (0%)  
[  4]   4.00-5.00   sec  14.4 MBytes   120 Mbits/sec  0.079 ms  0/1837 (0%)  
[  4]   5.00-6.00   sec  14.8 MBytes   124 Mbits/sec  0.065 ms  0/1888 (0%)  
[  4]   6.00-7.00   sec  15.3 MBytes   128 Mbits/sec  0.076 ms  0/1956 (0%)  
[  4]   7.00-8.00   sec  15.2 MBytes   128 Mbits/sec  0.095 ms  0/1948 (0%)  
[  4]   8.00-9.00   sec  15.1 MBytes   127 Mbits/sec  0.092 ms  0/1932 (0%)  
[  4]   9.00-10.00  sec  15.1 MBytes   127 Mbits/sec  0.095 ms  0/1938 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   149 MBytes   125 Mbits/sec  0.085 ms  0/19082 (0%)  
[  4] Sent 19082 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 48172 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  58.5 MBytes   491 Mbits/sec  7494  
[  4]   1.00-2.00   sec  60.6 MBytes   508 Mbits/sec  7756  
[  4]   2.00-3.00   sec  58.7 MBytes   492 Mbits/sec  7508  
[  4]   3.00-4.00   sec  60.2 MBytes   505 Mbits/sec  7710  
[  4]   4.00-5.00   sec  59.0 MBytes   495 Mbits/sec  7556  
[  4]   5.00-6.00   sec  60.5 MBytes   508 Mbits/sec  7744  
[  4]   6.00-7.00   sec  58.7 MBytes   492 Mbits/sec  7508  
[  4]   7.00-8.00   sec  59.1 MBytes   496 Mbits/sec  7565  
[  4]   8.00-9.00   sec  60.4 MBytes   507 Mbits/sec  7730  
[  4]   9.00-10.00  sec  59.9 MBytes   502 Mbits/sec  7664  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   596 MBytes   500 Mbits/sec  2051749.337 ms  64268/64294 (1e+02%)  
[  4] Sent 64294 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 35361 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  14.3 MBytes   120 Mbits/sec  0.097 ms  0/1830 (0%)  
[  4]   1.00-2.00   sec  14.3 MBytes   120 Mbits/sec  0.101 ms  0/1830 (0%)  
[  4]   2.00-3.00   sec  14.3 MBytes   120 Mbits/sec  0.072 ms  0/1827 (0%)  
[  4]   3.00-4.00   sec  14.2 MBytes   119 Mbits/sec  0.081 ms  0/1819 (0%)  
[  4]   4.00-5.00   sec  14.3 MBytes   120 Mbits/sec  0.070 ms  0/1834 (0%)  
[  4]   5.00-6.00   sec  14.3 MBytes   120 Mbits/sec  0.085 ms  0/1833 (0%)  
[  4]   6.00-7.00   sec  14.3 MBytes   120 Mbits/sec  0.082 ms  0/1835 (0%)  
[  4]   7.00-8.00   sec  14.3 MBytes   120 Mbits/sec  0.109 ms  0/1836 (0%)  
[  4]   8.00-9.00   sec  14.2 MBytes   119 Mbits/sec  0.080 ms  0/1822 (0%)  
[  4]   9.00-10.00  sec  14.3 MBytes   120 Mbits/sec  0.090 ms  0/1825 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   143 MBytes   120 Mbits/sec  0.104 ms  0/18298 (0%)  
[  4] Sent 18298 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 53231 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec   107 MBytes   902 Mbits/sec  13759  
[  4]   1.00-2.00   sec   107 MBytes   896 Mbits/sec  13675  
[  4]   2.00-3.00   sec   107 MBytes   901 Mbits/sec  13753  
[  4]   3.00-4.00   sec   107 MBytes   898 Mbits/sec  13700  
[  4]   4.00-5.00   sec   107 MBytes   902 Mbits/sec  13759  
[  4]   5.00-6.00   sec   108 MBytes   902 Mbits/sec  13762  
[  4]   6.00-7.00   sec   107 MBytes   899 Mbits/sec  13719  
[  4]   7.00-8.00   sec   108 MBytes   902 Mbits/sec  13760  
[  4]   8.00-9.00   sec   107 MBytes   901 Mbits/sec  13753  
[  4]   9.00-10.00  sec   107 MBytes   902 Mbits/sec  13756  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.05 GBytes   900 Mbits/sec  5762140.265 ms  210/220 (95%)  
[  4] Sent 220 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 34296 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  14.3 MBytes   120 Mbits/sec  0.084 ms  0/1835 (0%)  
[  4]   1.00-2.00   sec  14.3 MBytes   120 Mbits/sec  0.075 ms  0/1835 (0%)  
[  4]   2.00-3.00   sec  14.5 MBytes   122 Mbits/sec  0.062 ms  0/1858 (0%)  
[  4]   3.00-4.00   sec  15.1 MBytes   127 Mbits/sec  0.060 ms  0/1935 (0%)  
[  4]   4.00-5.00   sec  15.3 MBytes   128 Mbits/sec  0.076 ms  0/1958 (0%)  
[  4]   5.00-6.00   sec  14.5 MBytes   122 Mbits/sec  0.078 ms  0/1861 (0%)  
[  4]   6.00-7.00   sec  14.4 MBytes   120 Mbits/sec  0.100 ms  0/1837 (0%)  
[  4]   7.00-8.00   sec  14.3 MBytes   120 Mbits/sec  0.098 ms  0/1835 (0%)  
[  4]   8.00-9.00   sec  14.2 MBytes   119 Mbits/sec  0.085 ms  0/1821 (0%)  
[  4]   9.00-10.00  sec  14.3 MBytes   120 Mbits/sec  0.110 ms  0/1825 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   145 MBytes   122 Mbits/sec  0.101 ms  0/18606 (0%)  
[  4] Sent 18606 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 52130 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 52132 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 52134 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  7.47 MBytes  62.6 Mbits/sec   73   17.0 KBytes       
[  6]   0.00-1.00   sec  7.21 MBytes  60.5 Mbits/sec   78   19.8 KBytes       
[  9]   0.00-1.00   sec  7.14 MBytes  59.9 Mbits/sec   76   31.1 KBytes       
[SUM]   0.00-1.00   sec  21.8 MBytes   183 Mbits/sec  227             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  7.95 MBytes  66.7 Mbits/sec   61   12.7 KBytes       
[  6]   1.00-2.00   sec  5.84 MBytes  49.0 Mbits/sec   99   35.4 KBytes       
[  9]   1.00-2.00   sec  7.08 MBytes  59.4 Mbits/sec   78   32.5 KBytes       
[SUM]   1.00-2.00   sec  20.9 MBytes   175 Mbits/sec  238             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  6.09 MBytes  51.1 Mbits/sec   73   31.1 KBytes       
[  6]   2.00-3.00   sec  8.95 MBytes  75.1 Mbits/sec   64   22.6 KBytes       
[  9]   2.00-3.00   sec  6.09 MBytes  51.1 Mbits/sec   81   18.4 KBytes       
[SUM]   2.00-3.00   sec  21.1 MBytes   177 Mbits/sec  218             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  6.71 MBytes  56.3 Mbits/sec   80   11.3 KBytes       
[  6]   3.00-4.00   sec  8.26 MBytes  69.3 Mbits/sec   76   17.0 KBytes       
[  9]   3.00-4.00   sec  6.28 MBytes  52.7 Mbits/sec   77   42.4 KBytes       
[SUM]   3.00-4.00   sec  21.3 MBytes   178 Mbits/sec  233             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  6.59 MBytes  55.3 Mbits/sec   94   12.7 KBytes       
[  6]   4.00-5.00   sec  7.58 MBytes  63.6 Mbits/sec   63   28.3 KBytes       
[  9]   4.00-5.00   sec  6.84 MBytes  57.3 Mbits/sec   62   11.3 KBytes       
[SUM]   4.00-5.00   sec  21.0 MBytes   176 Mbits/sec  219             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  8.76 MBytes  73.5 Mbits/sec   57   22.6 KBytes       
[  6]   5.00-6.00   sec  6.28 MBytes  52.6 Mbits/sec   80   38.2 KBytes       
[  9]   5.00-6.00   sec  6.28 MBytes  52.6 Mbits/sec   90   7.07 KBytes       
[SUM]   5.00-6.00   sec  21.3 MBytes   179 Mbits/sec  227             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  7.33 MBytes  61.5 Mbits/sec   72   18.4 KBytes       
[  6]   6.00-7.00   sec  7.02 MBytes  58.9 Mbits/sec   66   35.4 KBytes       
[  9]   6.00-7.00   sec  6.77 MBytes  56.8 Mbits/sec   67   17.0 KBytes       
[SUM]   6.00-7.00   sec  21.1 MBytes   177 Mbits/sec  205             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  8.45 MBytes  70.9 Mbits/sec   72   25.5 KBytes       
[  6]   7.00-8.00   sec  6.71 MBytes  56.3 Mbits/sec   82   35.4 KBytes       
[  9]   7.00-8.00   sec  5.90 MBytes  49.5 Mbits/sec   74   17.0 KBytes       
[SUM]   7.00-8.00   sec  21.1 MBytes   177 Mbits/sec  228             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  6.46 MBytes  54.2 Mbits/sec   77   36.8 KBytes       
[  6]   8.00-9.00   sec  6.90 MBytes  57.9 Mbits/sec   78   11.3 KBytes       
[  9]   8.00-9.00   sec  7.89 MBytes  66.2 Mbits/sec   68   11.3 KBytes       
[SUM]   8.00-9.00   sec  21.3 MBytes   178 Mbits/sec  223             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  6.59 MBytes  55.3 Mbits/sec   79   38.2 KBytes       
[  6]   9.00-10.00  sec  8.76 MBytes  73.5 Mbits/sec   58   24.0 KBytes       
[  9]   9.00-10.00  sec  5.72 MBytes  48.0 Mbits/sec   77   7.07 KBytes       
[SUM]   9.00-10.00  sec  21.1 MBytes   177 Mbits/sec  214             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  72.4 MBytes  60.7 Mbits/sec  738             sender
[  4]   0.00-10.00  sec  72.0 MBytes  60.4 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  73.5 MBytes  61.7 Mbits/sec  744             sender
[  6]   0.00-10.00  sec  73.2 MBytes  61.4 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  66.0 MBytes  55.4 Mbits/sec  750             sender
[  9]   0.00-10.00  sec  65.6 MBytes  55.1 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   212 MBytes   178 Mbits/sec  2232             sender
[SUM]   0.00-10.00  sec   211 MBytes   177 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 52178 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 52180 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 52182 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  4.03 MBytes  33.8 Mbits/sec                  
[  6]   0.00-1.00   sec  2.81 MBytes  23.6 Mbits/sec                  
[  9]   0.00-1.00   sec  2.79 MBytes  23.4 Mbits/sec                  
[SUM]   0.00-1.00   sec  9.63 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   1.00-2.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   1.00-2.00   sec  3.22 MBytes  27.0 Mbits/sec                  
[SUM]   1.00-2.00   sec  9.72 MBytes  81.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   2.00-3.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   2.00-3.00   sec  3.30 MBytes  27.6 Mbits/sec                  
[SUM]   2.00-3.00   sec  9.80 MBytes  82.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   3.00-4.00   sec  3.12 MBytes  26.2 Mbits/sec                  
[  9]   3.00-4.00   sec  3.19 MBytes  26.8 Mbits/sec                  
[SUM]   3.00-4.00   sec  9.57 MBytes  80.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  2.22 MBytes  18.6 Mbits/sec                  
[  6]   4.00-5.00   sec  2.38 MBytes  19.9 Mbits/sec                  
[  9]   4.00-5.00   sec  2.28 MBytes  19.2 Mbits/sec                  
[SUM]   4.00-5.00   sec  6.88 MBytes  57.7 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  3.30 MBytes  27.7 Mbits/sec                  
[  6]   5.00-6.00   sec  3.37 MBytes  28.3 Mbits/sec                  
[  9]   5.00-6.00   sec  3.18 MBytes  26.7 Mbits/sec                  
[SUM]   5.00-6.00   sec  9.85 MBytes  82.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  2.99 MBytes  25.1 Mbits/sec                  
[  6]   6.00-7.00   sec  2.88 MBytes  24.1 Mbits/sec                  
[  9]   6.00-7.00   sec  3.00 MBytes  25.2 Mbits/sec                  
[SUM]   6.00-7.00   sec  8.87 MBytes  74.4 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.14 MBytes  26.3 Mbits/sec                  
[  6]   7.00-8.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   7.00-8.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[SUM]   7.00-8.00   sec  9.64 MBytes  80.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.25 MBytes  27.2 Mbits/sec                  
[  6]   8.00-9.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   8.00-9.00   sec  3.16 MBytes  26.5 Mbits/sec                  
[SUM]   8.00-9.00   sec  9.65 MBytes  81.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   9.00-10.00  sec  3.21 MBytes  26.9 Mbits/sec                  
[  9]   9.00-10.00  sec  3.22 MBytes  27.0 Mbits/sec                  
[SUM]   9.00-10.00  sec  9.68 MBytes  81.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  32.2 MBytes  27.0 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  32.2 MBytes  27.0 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  31.1 MBytes  26.1 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  31.1 MBytes  26.1 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  30.9 MBytes  25.9 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  30.9 MBytes  25.9 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  94.2 MBytes  79.0 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec  94.2 MBytes  79.0 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 36791 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 51969 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 39473 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  38.1 MBytes   319 Mbits/sec  4871  
[  6]   0.00-1.00   sec  38.1 MBytes   319 Mbits/sec  4871  
[  9]   0.00-1.00   sec  38.1 MBytes   319 Mbits/sec  4871  
[SUM]   0.00-1.00   sec   114 MBytes   958 Mbits/sec  14613  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  6]   1.00-2.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  9]   1.00-2.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[SUM]   1.00-2.00   sec   114 MBytes   958 Mbits/sec  14619  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  38.1 MBytes   319 Mbits/sec  4875  
[  6]   2.00-3.00   sec  38.1 MBytes   319 Mbits/sec  4875  
[  9]   2.00-3.00   sec  38.1 MBytes   319 Mbits/sec  4875  
[SUM]   2.00-3.00   sec   114 MBytes   958 Mbits/sec  14625  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  6]   3.00-4.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  9]   3.00-4.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[SUM]   3.00-4.00   sec   114 MBytes   958 Mbits/sec  14622  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  38.0 MBytes   319 Mbits/sec  4864  
[  6]   4.00-5.00   sec  38.0 MBytes   319 Mbits/sec  4864  
[  9]   4.00-5.00   sec  38.0 MBytes   319 Mbits/sec  4864  
[SUM]   4.00-5.00   sec   114 MBytes   956 Mbits/sec  14592  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  38.1 MBytes   319 Mbits/sec  4875  
[  6]   5.00-6.00   sec  38.1 MBytes   319 Mbits/sec  4875  
[  9]   5.00-6.00   sec  38.1 MBytes   319 Mbits/sec  4875  
[SUM]   5.00-6.00   sec   114 MBytes   958 Mbits/sec  14625  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  6]   6.00-7.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  9]   6.00-7.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[SUM]   6.00-7.00   sec   114 MBytes   958 Mbits/sec  14619  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  38.1 MBytes   319 Mbits/sec  4876  
[  6]   7.00-8.00   sec  38.1 MBytes   319 Mbits/sec  4876  
[  9]   7.00-8.00   sec  38.1 MBytes   319 Mbits/sec  4876  
[SUM]   7.00-8.00   sec   114 MBytes   958 Mbits/sec  14628  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  6]   8.00-9.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  9]   8.00-9.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[SUM]   8.00-9.00   sec   114 MBytes   958 Mbits/sec  14622  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  37.9 MBytes   318 Mbits/sec  4856  
[  6]   9.00-10.00  sec  37.9 MBytes   318 Mbits/sec  4856  
[  9]   9.00-10.00  sec  37.9 MBytes   318 Mbits/sec  4856  
[SUM]   9.00-10.00  sec   114 MBytes   955 Mbits/sec  14568  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   381 MBytes   319 Mbits/sec  9052841.391 ms  0/3 (0%)  
[  4] Sent 3 datagrams
[  6]   0.00-10.00  sec   381 MBytes   319 Mbits/sec  9052841.281 ms  0/3 (0%)  
[  6] Sent 3 datagrams
[  9]   0.00-10.00  sec   381 MBytes   319 Mbits/sec  9052841.181 ms  0/3 (0%)  
[  9] Sent 3 datagrams
[SUM]   0.00-10.00  sec  1.11 GBytes   958 Mbits/sec  9052841.285 ms  0/9 (0%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 43263 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 49331 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 60542 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  4.92 MBytes  41.3 Mbits/sec  0.156 ms  0/630 (0%)  
[  6]   0.00-1.00   sec  4.92 MBytes  41.3 Mbits/sec  0.170 ms  0/630 (0%)  
[  9]   0.00-1.00   sec  4.91 MBytes  41.2 Mbits/sec  0.237 ms  0/629 (0%)  
[SUM]   0.00-1.00   sec  14.8 MBytes   124 Mbits/sec  0.188 ms  0/1889 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  4.92 MBytes  41.3 Mbits/sec  0.173 ms  0/630 (0%)  
[  6]   1.00-2.00   sec  4.91 MBytes  41.2 Mbits/sec  0.191 ms  0/629 (0%)  
[  9]   1.00-2.00   sec  4.91 MBytes  41.2 Mbits/sec  0.192 ms  0/629 (0%)  
[SUM]   1.00-2.00   sec  14.8 MBytes   124 Mbits/sec  0.185 ms  0/1888 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  4.96 MBytes  41.6 Mbits/sec  0.246 ms  0/635 (0%)  
[  6]   2.00-3.00   sec  4.97 MBytes  41.7 Mbits/sec  0.167 ms  0/636 (0%)  
[  9]   2.00-3.00   sec  4.95 MBytes  41.5 Mbits/sec  0.232 ms  0/634 (0%)  
[SUM]   2.00-3.00   sec  14.9 MBytes   125 Mbits/sec  0.215 ms  0/1905 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  4.97 MBytes  41.7 Mbits/sec  0.189 ms  0/636 (0%)  
[  6]   3.00-4.00   sec  4.96 MBytes  41.6 Mbits/sec  0.121 ms  0/635 (0%)  
[  9]   3.00-4.00   sec  4.97 MBytes  41.7 Mbits/sec  0.195 ms  0/636 (0%)  
[SUM]   3.00-4.00   sec  14.9 MBytes   125 Mbits/sec  0.168 ms  0/1907 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  4.97 MBytes  41.7 Mbits/sec  0.180 ms  0/636 (0%)  
[  6]   4.00-5.00   sec  4.97 MBytes  41.7 Mbits/sec  0.185 ms  0/636 (0%)  
[  9]   4.00-5.00   sec  4.96 MBytes  41.6 Mbits/sec  0.132 ms  0/635 (0%)  
[SUM]   4.00-5.00   sec  14.9 MBytes   125 Mbits/sec  0.166 ms  0/1907 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  4.97 MBytes  41.7 Mbits/sec  0.178 ms  0/636 (0%)  
[  6]   5.00-6.00   sec  4.97 MBytes  41.7 Mbits/sec  0.209 ms  0/636 (0%)  
[  9]   5.00-6.00   sec  4.97 MBytes  41.7 Mbits/sec  0.167 ms  0/636 (0%)  
[SUM]   5.00-6.00   sec  14.9 MBytes   125 Mbits/sec  0.185 ms  0/1908 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  4.91 MBytes  41.2 Mbits/sec  0.141 ms  0/628 (0%)  
[  6]   6.00-7.00   sec  4.91 MBytes  41.2 Mbits/sec  0.211 ms  0/628 (0%)  
[  9]   6.00-7.00   sec  4.91 MBytes  41.2 Mbits/sec  0.152 ms  0/629 (0%)  
[SUM]   6.00-7.00   sec  14.7 MBytes   124 Mbits/sec  0.168 ms  0/1885 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  4.92 MBytes  41.3 Mbits/sec  0.290 ms  0/630 (0%)  
[  6]   7.00-8.00   sec  4.91 MBytes  41.2 Mbits/sec  0.167 ms  0/629 (0%)  
[  9]   7.00-8.00   sec  4.91 MBytes  41.2 Mbits/sec  0.367 ms  0/629 (0%)  
[SUM]   7.00-8.00   sec  14.8 MBytes   124 Mbits/sec  0.275 ms  0/1888 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  4.93 MBytes  41.4 Mbits/sec  0.147 ms  0/631 (0%)  
[  6]   8.00-9.00   sec  4.91 MBytes  41.2 Mbits/sec  0.170 ms  0/628 (0%)  
[  9]   8.00-9.00   sec  4.91 MBytes  41.2 Mbits/sec  0.137 ms  0/628 (0%)  
[SUM]   8.00-9.00   sec  14.7 MBytes   124 Mbits/sec  0.151 ms  0/1887 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  4.97 MBytes  41.7 Mbits/sec  0.215 ms  0/636 (0%)  
[  6]   9.00-10.00  sec  4.98 MBytes  41.7 Mbits/sec  0.150 ms  0/637 (0%)  
[  9]   9.00-10.00  sec  4.96 MBytes  41.6 Mbits/sec  0.272 ms  0/635 (0%)  
[SUM]   9.00-10.00  sec  14.9 MBytes   125 Mbits/sec  0.212 ms  0/1908 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  49.5 MBytes  41.5 Mbits/sec  0.227 ms  0/6335 (0%)  
[  4] Sent 6335 datagrams
[  6]   0.00-10.00  sec  49.5 MBytes  41.5 Mbits/sec  0.183 ms  0/6331 (0%)  
[  6] Sent 6331 datagrams
[  9]   0.00-10.00  sec  49.4 MBytes  41.5 Mbits/sec  0.261 ms  0/6327 (0%)  
[  9] Sent 6327 datagrams
[SUM]   0.00-10.00  sec   148 MBytes   124 Mbits/sec  0.224 ms  0/18993 (0%)  

iperf Done.
+ : ':::::::[' configuration vanilla ']:::::::' :
+ iperf3 -c 10.0.0.80
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 52728 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  21.2 MBytes   178 Mbits/sec   24   66.5 KBytes       
[  4]   1.00-2.00   sec  20.8 MBytes   175 Mbits/sec   36   67.9 KBytes       
[  4]   2.00-3.00   sec  20.5 MBytes   172 Mbits/sec   40   52.3 KBytes       
[  4]   3.00-4.00   sec  20.7 MBytes   174 Mbits/sec   37   45.2 KBytes       
[  4]   4.00-5.00   sec  20.4 MBytes   171 Mbits/sec   27   46.7 KBytes       
[  4]   5.00-6.00   sec  20.6 MBytes   173 Mbits/sec   36   66.5 KBytes       
[  4]   6.00-7.00   sec  20.8 MBytes   174 Mbits/sec   31   56.6 KBytes       
[  4]   7.00-8.00   sec  20.8 MBytes   174 Mbits/sec   46   43.8 KBytes       
[  4]   8.00-9.00   sec  20.9 MBytes   176 Mbits/sec   31   48.1 KBytes       
[  4]   9.00-10.00  sec  20.9 MBytes   175 Mbits/sec   28   65.0 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   208 MBytes   174 Mbits/sec  336             sender
[  4]   0.00-10.00  sec   207 MBytes   174 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 52768 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  9.95 MBytes  83.5 Mbits/sec                  
[  4]   1.00-2.00   sec  13.0 MBytes   109 Mbits/sec                  
[  4]   2.00-3.00   sec  13.0 MBytes   109 Mbits/sec                  
[  4]   3.00-4.00   sec  13.0 MBytes   109 Mbits/sec                  
[  4]   4.00-5.00   sec  13.1 MBytes   110 Mbits/sec                  
[  4]   5.00-6.00   sec  13.2 MBytes   111 Mbits/sec                  
[  4]   6.00-7.00   sec  13.2 MBytes   111 Mbits/sec                  
[  4]   7.00-8.00   sec  13.2 MBytes   111 Mbits/sec                  
[  4]   8.00-9.00   sec  13.3 MBytes   112 Mbits/sec                  
[  4]   9.00-10.00  sec  10.2 MBytes  85.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   125 MBytes   105 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   125 MBytes   105 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 40911 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  16.4 MBytes   138 Mbits/sec  2100  
[  4]   1.00-2.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   2.00-3.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   3.00-4.00   sec  17.9 MBytes   150 Mbits/sec  2292  
[  4]   4.00-5.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   5.00-6.00   sec  17.9 MBytes   150 Mbits/sec  2286  
[  4]   6.00-7.00   sec  17.9 MBytes   150 Mbits/sec  2288  
[  4]   7.00-8.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   8.00-9.00   sec  17.9 MBytes   150 Mbits/sec  2289  
[  4]   9.00-10.00  sec  17.9 MBytes   150 Mbits/sec  2289  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   177 MBytes   149 Mbits/sec  136432.924 ms  1354/1422 (95%)  
[  4] Sent 1422 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 150M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 45555 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.3 MBytes   128 Mbits/sec  0.077 ms  0/1960 (0%)  
[  4]   1.00-2.00   sec  15.3 MBytes   129 Mbits/sec  0.068 ms  0/1962 (0%)  
[  4]   2.00-3.00   sec  15.2 MBytes   127 Mbits/sec  0.051 ms  0/1942 (0%)  
[  4]   3.00-4.00   sec  15.2 MBytes   127 Mbits/sec  0.074 ms  0/1940 (0%)  
[  4]   4.00-5.00   sec  15.3 MBytes   128 Mbits/sec  0.064 ms  0/1959 (0%)  
[  4]   5.00-6.00   sec  14.7 MBytes   123 Mbits/sec  0.093 ms  0/1879 (0%)  
[  4]   6.00-7.00   sec  15.5 MBytes   130 Mbits/sec  0.086 ms  0/1990 (0%)  
[  4]   7.00-8.00   sec  17.5 MBytes   146 Mbits/sec  0.089 ms  0/2235 (0%)  
[  4]   8.00-9.00   sec  14.2 MBytes   119 Mbits/sec  0.060 ms  0/1816 (0%)  
[  4]   9.00-10.00  sec  15.0 MBytes   126 Mbits/sec  0.095 ms  0/1917 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   153 MBytes   128 Mbits/sec  0.101 ms  0/19606 (0%)  
[  4] Sent 19606 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 33642 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  59.3 MBytes   497 Mbits/sec  7585  
[  4]   1.00-2.00   sec  58.5 MBytes   491 Mbits/sec  7492  
[  4]   2.00-3.00   sec  60.0 MBytes   503 Mbits/sec  7677  
[  4]   3.00-4.00   sec  59.3 MBytes   498 Mbits/sec  7596  
[  4]   4.00-5.00   sec  60.9 MBytes   511 Mbits/sec  7794  
[  4]   5.00-6.00   sec  59.0 MBytes   495 Mbits/sec  7556  
[  4]   6.00-7.00   sec  59.7 MBytes   501 Mbits/sec  7639  
[  4]   7.00-8.00   sec  59.2 MBytes   496 Mbits/sec  7574  
[  4]   8.00-9.00   sec  60.4 MBytes   507 Mbits/sec  7736  
[  4]   9.00-10.00  sec  58.7 MBytes   493 Mbits/sec  7517  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   595 MBytes   499 Mbits/sec  1147799.599 ms  64273/64308 (1e+02%)  
[  4] Sent 64308 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 500M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 42014 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.2 MBytes   127 Mbits/sec  0.086 ms  0/1942 (0%)  
[  4]   1.00-2.00   sec  15.2 MBytes   127 Mbits/sec  0.099 ms  0/1940 (0%)  
[  4]   2.00-3.00   sec  15.1 MBytes   127 Mbits/sec  0.087 ms  0/1932 (0%)  
[  4]   3.00-4.00   sec  15.0 MBytes   126 Mbits/sec  0.059 ms  0/1920 (0%)  
[  4]   4.00-5.00   sec  15.1 MBytes   127 Mbits/sec  0.070 ms  0/1931 (0%)  
[  4]   5.00-6.00   sec  15.2 MBytes   127 Mbits/sec  0.109 ms  0/1942 (0%)  
[  4]   6.00-7.00   sec  15.2 MBytes   127 Mbits/sec  0.102 ms  0/1941 (0%)  
[  4]   7.00-8.00   sec  15.2 MBytes   127 Mbits/sec  0.069 ms  0/1943 (0%)  
[  4]   8.00-9.00   sec  15.0 MBytes   126 Mbits/sec  0.074 ms  0/1926 (0%)  
[  4]   9.00-10.00  sec  15.0 MBytes   126 Mbits/sec  0.082 ms  0/1919 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   151 MBytes   127 Mbits/sec  0.089 ms  0/19342 (0%)  
[  4] Sent 19342 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 55639 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  96.9 MBytes   813 Mbits/sec  12402  
[  4]   1.00-2.00   sec   107 MBytes   897 Mbits/sec  13693  
[  4]   2.00-3.00   sec   107 MBytes   898 Mbits/sec  13701  
[  4]   3.00-4.00   sec   107 MBytes   898 Mbits/sec  13698  
[  4]   4.00-5.00   sec   107 MBytes   897 Mbits/sec  13689  
[  4]   5.00-6.00   sec   107 MBytes   896 Mbits/sec  13679  
[  4]   6.00-7.00   sec   107 MBytes   898 Mbits/sec  13710  
[  4]   7.00-8.00   sec   107 MBytes   899 Mbits/sec  13719  
[  4]   8.00-9.00   sec   107 MBytes   894 Mbits/sec  13635  
[  4]   9.00-10.00  sec   107 MBytes   899 Mbits/sec  13725  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  1.03 GBytes   889 Mbits/sec  3022016.748 ms  1257/1277 (98%)  
[  4] Sent 1277 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -u -b 1000M -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 54887 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  15.2 MBytes   127 Mbits/sec  0.087 ms  0/1942 (0%)  
[  4]   1.00-2.00   sec  15.2 MBytes   127 Mbits/sec  0.092 ms  0/1945 (0%)  
[  4]   2.00-3.00   sec  15.1 MBytes   126 Mbits/sec  0.078 ms  0/1930 (0%)  
[  4]   3.00-4.00   sec  15.1 MBytes   127 Mbits/sec  0.078 ms  0/1938 (0%)  
[  4]   4.00-5.00   sec  15.3 MBytes   128 Mbits/sec  0.080 ms  0/1954 (0%)  
[  4]   5.00-6.00   sec  15.3 MBytes   128 Mbits/sec  0.088 ms  0/1959 (0%)  
[  4]   6.00-7.00   sec  15.3 MBytes   129 Mbits/sec  0.084 ms  0/1961 (0%)  
[  4]   7.00-8.00   sec  15.3 MBytes   128 Mbits/sec  0.266 ms  0/1956 (0%)  
[  4]   8.00-9.00   sec  15.2 MBytes   128 Mbits/sec  0.079 ms  0/1949 (0%)  
[  4]   9.00-10.00  sec  15.1 MBytes   127 Mbits/sec  0.069 ms  0/1939 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   152 MBytes   128 Mbits/sec  0.063 ms  0/19480 (0%)  
[  4] Sent 19480 datagrams

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 53060 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 53062 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 53064 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  8.14 MBytes  68.3 Mbits/sec   65   11.3 KBytes       
[  6]   0.00-1.00   sec  6.65 MBytes  55.8 Mbits/sec   81   12.7 KBytes       
[  9]   0.00-1.00   sec  7.20 MBytes  60.4 Mbits/sec   60   49.5 KBytes       
[SUM]   0.00-1.00   sec  22.0 MBytes   184 Mbits/sec  206             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  6.84 MBytes  57.3 Mbits/sec   76   25.5 KBytes       
[  6]   1.00-2.00   sec  6.59 MBytes  55.3 Mbits/sec   89   24.0 KBytes       
[  9]   1.00-2.00   sec  7.83 MBytes  65.7 Mbits/sec   60   18.4 KBytes       
[SUM]   1.00-2.00   sec  21.3 MBytes   178 Mbits/sec  225             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  7.83 MBytes  65.7 Mbits/sec   78   15.6 KBytes       
[  6]   2.00-3.00   sec  6.84 MBytes  57.3 Mbits/sec   69   29.7 KBytes       
[  9]   2.00-3.00   sec  6.77 MBytes  56.8 Mbits/sec   72   19.8 KBytes       
[SUM]   2.00-3.00   sec  21.4 MBytes   180 Mbits/sec  219             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  6.52 MBytes  54.7 Mbits/sec  120   18.4 KBytes       
[  6]   3.00-4.00   sec  7.08 MBytes  59.4 Mbits/sec   90   26.9 KBytes       
[  9]   3.00-4.00   sec  6.77 MBytes  56.8 Mbits/sec   77   31.1 KBytes       
[SUM]   3.00-4.00   sec  20.4 MBytes   171 Mbits/sec  287             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  6.28 MBytes  52.6 Mbits/sec   82   21.2 KBytes       
[  6]   4.00-5.00   sec  7.15 MBytes  59.9 Mbits/sec   61   19.8 KBytes       
[  9]   4.00-5.00   sec  7.71 MBytes  64.6 Mbits/sec   61   22.6 KBytes       
[SUM]   4.00-5.00   sec  21.1 MBytes   177 Mbits/sec  204             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  8.95 MBytes  75.1 Mbits/sec   61   11.3 KBytes       
[  6]   5.00-6.00   sec  5.84 MBytes  49.0 Mbits/sec  105   39.6 KBytes       
[  9]   5.00-6.00   sec  5.10 MBytes  42.7 Mbits/sec  112   21.2 KBytes       
[SUM]   5.00-6.00   sec  19.9 MBytes   167 Mbits/sec  278             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  7.95 MBytes  66.7 Mbits/sec   78   46.7 KBytes       
[  6]   6.00-7.00   sec  6.77 MBytes  56.8 Mbits/sec  110   14.1 KBytes       
[  9]   6.00-7.00   sec  5.65 MBytes  47.4 Mbits/sec  112   18.4 KBytes       
[SUM]   6.00-7.00   sec  20.4 MBytes   171 Mbits/sec  300             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  8.51 MBytes  71.4 Mbits/sec   69   32.5 KBytes       
[  6]   7.00-8.00   sec  6.52 MBytes  54.7 Mbits/sec  109   12.7 KBytes       
[  9]   7.00-8.00   sec  4.97 MBytes  41.7 Mbits/sec   81   19.8 KBytes       
[SUM]   7.00-8.00   sec  20.0 MBytes   168 Mbits/sec  259             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  8.58 MBytes  71.9 Mbits/sec   65   14.1 KBytes       
[  6]   8.00-9.00   sec  5.72 MBytes  48.0 Mbits/sec  104   28.3 KBytes       
[  9]   8.00-9.00   sec  6.59 MBytes  55.3 Mbits/sec   85   11.3 KBytes       
[SUM]   8.00-9.00   sec  20.9 MBytes   175 Mbits/sec  254             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  9.94 MBytes  83.4 Mbits/sec   63   48.1 KBytes       
[  6]   9.00-10.00  sec  4.47 MBytes  37.5 Mbits/sec   75   26.9 KBytes       
[  9]   9.00-10.00  sec  5.03 MBytes  42.2 Mbits/sec  122   43.8 KBytes       
[SUM]   9.00-10.00  sec  19.5 MBytes   163 Mbits/sec  260             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  79.5 MBytes  66.7 Mbits/sec  757             sender
[  4]   0.00-10.00  sec  79.1 MBytes  66.4 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  63.6 MBytes  53.4 Mbits/sec  893             sender
[  6]   0.00-10.00  sec  63.3 MBytes  53.1 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  63.6 MBytes  53.4 Mbits/sec  842             sender
[  9]   0.00-10.00  sec  63.2 MBytes  53.1 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   207 MBytes   173 Mbits/sec  2492             sender
[SUM]   0.00-10.00  sec   206 MBytes   172 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 53114 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 53116 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 53118 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  3.58 MBytes  30.1 Mbits/sec                  
[  6]   0.00-1.00   sec  3.68 MBytes  30.9 Mbits/sec                  
[  9]   0.00-1.00   sec  2.38 MBytes  19.9 Mbits/sec                  
[SUM]   0.00-1.00   sec  9.64 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  3.21 MBytes  26.9 Mbits/sec                  
[  6]   1.00-2.00   sec  3.19 MBytes  26.8 Mbits/sec                  
[  9]   1.00-2.00   sec  3.23 MBytes  27.1 Mbits/sec                  
[SUM]   1.00-2.00   sec  9.63 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  3.21 MBytes  26.9 Mbits/sec                  
[  6]   2.00-3.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   2.00-3.00   sec  3.17 MBytes  26.6 Mbits/sec                  
[SUM]   2.00-3.00   sec  9.63 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  3.38 MBytes  28.4 Mbits/sec                  
[  6]   3.00-4.00   sec  3.27 MBytes  27.4 Mbits/sec                  
[  9]   3.00-4.00   sec  3.32 MBytes  27.8 Mbits/sec                  
[SUM]   3.00-4.00   sec  9.97 MBytes  83.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  4.84 MBytes  40.6 Mbits/sec                  
[  6]   4.00-5.00   sec  4.20 MBytes  35.2 Mbits/sec                  
[  9]   4.00-5.00   sec  4.67 MBytes  39.2 Mbits/sec                  
[SUM]   4.00-5.00   sec  13.7 MBytes   115 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  4.12 MBytes  34.6 Mbits/sec                  
[  6]   5.00-6.00   sec  2.81 MBytes  23.6 Mbits/sec                  
[  9]   5.00-6.00   sec  2.76 MBytes  23.1 Mbits/sec                  
[SUM]   5.00-6.00   sec  9.69 MBytes  81.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  3.25 MBytes  27.2 Mbits/sec                  
[  6]   6.00-7.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  9]   6.00-7.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[SUM]   6.00-7.00   sec  9.75 MBytes  81.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  3.27 MBytes  27.4 Mbits/sec                  
[  6]   7.00-8.00   sec  3.37 MBytes  28.3 Mbits/sec                  
[  9]   7.00-8.00   sec  3.24 MBytes  27.2 Mbits/sec                  
[SUM]   7.00-8.00   sec  9.88 MBytes  82.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   8.00-9.00   sec  3.20 MBytes  26.8 Mbits/sec                  
[  9]   8.00-9.00   sec  3.18 MBytes  26.7 Mbits/sec                  
[SUM]   8.00-9.00   sec  9.63 MBytes  80.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  3.25 MBytes  27.3 Mbits/sec                  
[  6]   9.00-10.00  sec  3.23 MBytes  27.1 Mbits/sec                  
[  9]   9.00-10.00  sec  3.25 MBytes  27.3 Mbits/sec                  
[SUM]   9.00-10.00  sec  9.73 MBytes  81.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  35.7 MBytes  29.9 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  35.7 MBytes  29.9 Mbits/sec                  receiver
[  6]   0.00-10.00  sec  33.8 MBytes  28.3 Mbits/sec    0             sender
[  6]   0.00-10.00  sec  33.8 MBytes  28.3 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  32.8 MBytes  27.5 Mbits/sec    0             sender
[  9]   0.00-10.00  sec  32.8 MBytes  27.5 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   102 MBytes  85.8 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   102 MBytes  85.8 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -u -b 800M
Connecting to host 10.0.0.80, port 5201
[  4] local 10.0.0.1 port 54179 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 53430 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 57739 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  38.0 MBytes   318 Mbits/sec  4860  
[  6]   0.00-1.00   sec  38.0 MBytes   318 Mbits/sec  4860  
[  9]   0.00-1.00   sec  38.0 MBytes   318 Mbits/sec  4860  
[SUM]   0.00-1.00   sec   114 MBytes   955 Mbits/sec  14580  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  38.1 MBytes   319 Mbits/sec  4872  
[  6]   1.00-2.00   sec  38.1 MBytes   319 Mbits/sec  4872  
[  9]   1.00-2.00   sec  38.1 MBytes   319 Mbits/sec  4872  
[SUM]   1.00-2.00   sec   114 MBytes   958 Mbits/sec  14616  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  38.0 MBytes   319 Mbits/sec  4870  
[  6]   2.00-3.00   sec  38.0 MBytes   319 Mbits/sec  4870  
[  9]   2.00-3.00   sec  38.0 MBytes   319 Mbits/sec  4870  
[SUM]   2.00-3.00   sec   114 MBytes   958 Mbits/sec  14610  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  38.1 MBytes   319 Mbits/sec  4872  
[  6]   3.00-4.00   sec  38.1 MBytes   319 Mbits/sec  4872  
[  9]   3.00-4.00   sec  38.1 MBytes   319 Mbits/sec  4872  
[SUM]   3.00-4.00   sec   114 MBytes   958 Mbits/sec  14616  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  6]   4.00-5.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  9]   4.00-5.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[SUM]   4.00-5.00   sec   114 MBytes   958 Mbits/sec  14622  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  6]   5.00-6.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  9]   5.00-6.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[SUM]   5.00-6.00   sec   114 MBytes   958 Mbits/sec  14619  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  6]   6.00-7.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[  9]   6.00-7.00   sec  38.1 MBytes   319 Mbits/sec  4873  
[SUM]   6.00-7.00   sec   114 MBytes   958 Mbits/sec  14619  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  6]   7.00-8.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  9]   7.00-8.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[SUM]   7.00-8.00   sec   114 MBytes   958 Mbits/sec  14622  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  6]   8.00-9.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[  9]   8.00-9.00   sec  38.1 MBytes   319 Mbits/sec  4874  
[SUM]   8.00-9.00   sec   114 MBytes   958 Mbits/sec  14622  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  38.1 MBytes   319 Mbits/sec  4874  
[  6]   9.00-10.00  sec  38.1 MBytes   319 Mbits/sec  4874  
[  9]   9.00-10.00  sec  38.1 MBytes   319 Mbits/sec  4874  
[SUM]   9.00-10.00  sec   114 MBytes   958 Mbits/sec  14622  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec   381 MBytes   319 Mbits/sec  8487039.300 ms  0/4 (0%)  
[  4] Sent 4 datagrams
[  6]   0.00-10.00  sec   381 MBytes   319 Mbits/sec  8487039.639 ms  365/369 (99%)  
[  6] Sent 369 datagrams
[  9]   0.00-10.00  sec   381 MBytes   319 Mbits/sec  8487039.544 ms  472/476 (99%)  
[  9] Sent 476 datagrams
[SUM]   0.00-10.00  sec  1.12 GBytes   958 Mbits/sec  8487039.495 ms  837/849 (99%)  

iperf Done.
+ sleep 10
+ iperf3 -c 10.0.0.80 -P3 -R -u -b 800M
Connecting to host 10.0.0.80, port 5201
Reverse mode, remote host 10.0.0.80 is sending
[  4] local 10.0.0.1 port 58078 connected to 10.0.0.80 port 5201
[  6] local 10.0.0.1 port 50018 connected to 10.0.0.80 port 5201
[  9] local 10.0.0.1 port 46349 connected to 10.0.0.80 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  4.97 MBytes  41.7 Mbits/sec  0.205 ms  0/636 (0%)  
[  6]   0.00-1.00   sec  4.96 MBytes  41.6 Mbits/sec  0.154 ms  0/635 (0%)  
[  9]   0.00-1.00   sec  4.96 MBytes  41.6 Mbits/sec  0.248 ms  0/635 (0%)  
[SUM]   0.00-1.00   sec  14.9 MBytes   125 Mbits/sec  0.202 ms  0/1906 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  4.95 MBytes  41.5 Mbits/sec  0.162 ms  0/634 (0%)  
[  6]   1.00-2.00   sec  4.95 MBytes  41.5 Mbits/sec  0.216 ms  0/634 (0%)  
[  9]   1.00-2.00   sec  4.95 MBytes  41.5 Mbits/sec  0.125 ms  0/633 (0%)  
[SUM]   1.00-2.00   sec  14.9 MBytes   125 Mbits/sec  0.168 ms  0/1901 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  4.91 MBytes  41.2 Mbits/sec  0.148 ms  0/629 (0%)  
[  6]   2.00-3.00   sec  4.92 MBytes  41.3 Mbits/sec  0.213 ms  0/630 (0%)  
[  9]   2.00-3.00   sec  4.91 MBytes  41.2 Mbits/sec  0.123 ms  0/629 (0%)  
[SUM]   2.00-3.00   sec  14.8 MBytes   124 Mbits/sec  0.161 ms  0/1888 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  4.94 MBytes  41.4 Mbits/sec  0.226 ms  0/632 (0%)  
[  6]   3.00-4.00   sec  4.94 MBytes  41.4 Mbits/sec  0.151 ms  0/632 (0%)  
[  9]   3.00-4.00   sec  4.94 MBytes  41.4 Mbits/sec  0.171 ms  0/632 (0%)  
[SUM]   3.00-4.00   sec  14.8 MBytes   124 Mbits/sec  0.183 ms  0/1896 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  4.98 MBytes  41.8 Mbits/sec  0.191 ms  0/638 (0%)  
[  6]   4.00-5.00   sec  4.98 MBytes  41.7 Mbits/sec  0.129 ms  0/637 (0%)  
[  9]   4.00-5.00   sec  4.98 MBytes  41.7 Mbits/sec  0.154 ms  0/637 (0%)  
[SUM]   4.00-5.00   sec  14.9 MBytes   125 Mbits/sec  0.158 ms  0/1912 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  4.98 MBytes  41.7 Mbits/sec  0.162 ms  0/637 (0%)  
[  6]   5.00-6.00   sec  4.97 MBytes  41.7 Mbits/sec  0.085 ms  0/636 (0%)  
[  9]   5.00-6.00   sec  4.97 MBytes  41.7 Mbits/sec  0.157 ms  0/636 (0%)  
[SUM]   5.00-6.00   sec  14.9 MBytes   125 Mbits/sec  0.135 ms  0/1909 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  4.97 MBytes  41.7 Mbits/sec  0.221 ms  0/636 (0%)  
[  6]   6.00-7.00   sec  4.97 MBytes  41.7 Mbits/sec  0.115 ms  0/636 (0%)  
[  9]   6.00-7.00   sec  4.96 MBytes  41.6 Mbits/sec  0.193 ms  0/635 (0%)  
[SUM]   6.00-7.00   sec  14.9 MBytes   125 Mbits/sec  0.176 ms  0/1907 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  4.94 MBytes  41.4 Mbits/sec  0.226 ms  0/632 (0%)  
[  6]   7.00-8.00   sec  4.94 MBytes  41.4 Mbits/sec  0.134 ms  0/632 (0%)  
[  9]   7.00-8.00   sec  4.94 MBytes  41.4 Mbits/sec  0.180 ms  0/632 (0%)  
[SUM]   7.00-8.00   sec  14.8 MBytes   124 Mbits/sec  0.180 ms  0/1896 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  4.92 MBytes  41.3 Mbits/sec  0.196 ms  0/630 (0%)  
[  6]   8.00-9.00   sec  4.91 MBytes  41.2 Mbits/sec  0.161 ms  0/629 (0%)  
[  9]   8.00-9.00   sec  4.91 MBytes  41.2 Mbits/sec  0.161 ms  0/629 (0%)  
[SUM]   8.00-9.00   sec  14.8 MBytes   124 Mbits/sec  0.173 ms  0/1888 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  4.95 MBytes  41.5 Mbits/sec  0.194 ms  0/633 (0%)  
[  6]   9.00-10.00  sec  4.95 MBytes  41.5 Mbits/sec  0.132 ms  0/633 (0%)  
[  9]   9.00-10.00  sec  4.94 MBytes  41.4 Mbits/sec  0.107 ms  0/632 (0%)  
[SUM]   9.00-10.00  sec  14.8 MBytes   124 Mbits/sec  0.144 ms  0/1898 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-10.00  sec  49.6 MBytes  41.6 Mbits/sec  0.223 ms  0/6344 (0%)  
[  4] Sent 6344 datagrams
[  6]   0.00-10.00  sec  49.5 MBytes  41.6 Mbits/sec  0.153 ms  0/6341 (0%)  
[  6] Sent 6341 datagrams
[  9]   0.00-10.00  sec  49.5 MBytes  41.5 Mbits/sec  0.125 ms  0/6337 (0%)  
[  9] Sent 6337 datagrams
[SUM]   0.00-10.00  sec   149 MBytes   125 Mbits/sec  0.167 ms  0/19022 (0%)  

iperf Done.
UDP lantiq->host
@host:		# nc -u -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc -u 10.0.0.1 4321
1,54GiB 0:02:04 [12,9MiB/s]

TCP lantiq->host
@host:		# nc -l -p 4321 | pv > /dev/null
@lantiq:	# cat /dev/zero | nc 10.0.0.1 4321
701MiB 0:01:33 [7,92MiB/s] or 157MiB 0:00:32 [6,65MiB/s]

UDP host->lantiq
@lantiq:	# nc -u -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc -u 10.0.0.80 4321
6,98GiB 0:01:09 [ 104MiB/s]

TCP host->lantiq
@lantiq:	# nc -l -p 4321 > /dev/null
@host:		# cat /dev/zero | pv | nc 10.0.0.80 4321
1,13GiB 0:00:56 [20,9MiB/s]
--- a/drivers/net/ethernet/lantiq_xrx200.c	2019-01-30 02:20:35.780993746 +0100
+++ b/drivers/net/ethernet/lantiq_xrx200.c	2019-02-03 09:37:27.155082134 +0100
@@ -39,13 +39,10 @@
 #define SW_POLLING
 #define SW_ROUTING
 
-#ifdef SW_ROUTING
-#define XRX200_MAX_DEV		2
-#else
-#define XRX200_MAX_DEV		1
-#endif
-
 #define XRX200_MAX_VLAN		64
+//pc2005 test
+//#define XRX200_MAX_VLAN		8
+
 #define XRX200_PCE_ACTVLAN_IDX	0x01
 #define XRX200_PCE_VLANMAP_IDX	0x02
 
@@ -207,46 +204,42 @@
 	int refcount;
 	int tx_free;
 
-	struct net_device dummy_dev;
-	struct net_device *devs[XRX200_MAX_DEV];
-
 	struct tasklet_struct tasklet;
 	struct napi_struct napi;
 	struct ltq_dma_channel dma;
 	struct sk_buff *skb[LTQ_DESC_NUM];
 
+	struct xrx200_priv *priv;
 	spinlock_t lock;
 };
 
-struct xrx200_hw {
-	struct clk *clk;
-	struct mii_bus *mii_bus;
-
-	struct xrx200_chan chan[XRX200_MAX_DMA];
-	u16 vlan_vid[XRX200_MAX_VLAN];
-	u16 vlan_port_map[XRX200_MAX_VLAN];
-
-	struct net_device *devs[XRX200_MAX_DEV];
-	int num_devs;
-
-	int port_map[XRX200_MAX_PORT];
-	unsigned short wan_map;
-
-	struct switch_dev swdev;
-};
-
 struct xrx200_priv {
 	struct net_device_stats stats;
 	int id;
+	
+	struct clk *clk;	
 
+	struct xrx200_chan chan_tx;
+	struct xrx200_chan chan_rx;
+	struct net_device *net_dev;
+	struct device *dev;
+		
 	struct xrx200_port port[XRX200_MAX_PORT];
 	int num_port;
 	bool wan;
 	bool sw;
-	unsigned short port_map;
+	unsigned short d_port_map;
 	unsigned char mac[6];
 
-	struct xrx200_hw *hw;
+	struct mii_bus *mii_bus;
+
+	u16 vlan_vid[XRX200_MAX_VLAN];
+	u16 vlan_port_map[XRX200_MAX_VLAN];
+
+	int port_map[XRX200_MAX_PORT];
+	unsigned short wan_map;
+
+	struct switch_dev swdev;
 };
 
 static __iomem void *xrx200_switch_membase;
@@ -470,14 +463,14 @@
 }
 
 // swconfig interface
-static void xrx200_hw_init(struct xrx200_hw *hw);
+static void xrx200_hw_init(struct xrx200_priv *priv);
 
 // global
 static int xrx200sw_reset_switch(struct switch_dev *dev)
 {
-	struct xrx200_hw *hw = container_of(dev, struct xrx200_hw, swdev);
+	struct xrx200_priv *priv = container_of(dev, struct xrx200_priv, swdev);
 
-	xrx200_hw_init(hw);
+	xrx200_hw_init(priv);
 
 	return 0;
 }
@@ -523,7 +516,7 @@
 static int xrx200sw_set_vlan_vid(struct switch_dev *dev, const struct switch_attr *attr,
 				 struct switch_val *val)
 {
-	struct xrx200_hw *hw = container_of(dev, struct xrx200_hw, swdev);
+	struct xrx200_priv *priv = container_of(dev, struct xrx200_priv, swdev);
 	int i;
 	struct xrx200_pce_table_entry tev;
 	struct xrx200_pce_table_entry tem;
@@ -538,7 +531,7 @@
 			return -EINVAL;
 	}
 
-	hw->vlan_vid[val->port_vlan] = val->value.i;
+	priv->vlan_vid[val->port_vlan] = val->value.i;
 
 	tev.index = val->port_vlan;
 	xrx200_pce_table_entry_read(&tev);
@@ -571,7 +564,7 @@
 
 static int xrx200sw_set_vlan_ports(struct switch_dev *dev, struct switch_val *val)
 {
-	struct xrx200_hw *hw = container_of(dev, struct xrx200_hw, swdev);
+	struct xrx200_priv *priv = container_of(dev, struct xrx200_priv, swdev);
 	int i, portmap, tagmap, untagged;
 	struct xrx200_pce_table_entry tem;
 
@@ -624,7 +617,7 @@
 
 	ltq_switch_w32_mask(0, portmap, PCE_PMAP2);
 	ltq_switch_w32_mask(0, portmap, PCE_PMAP3);
-	hw->vlan_port_map[val->port_vlan] = portmap;
+	priv->vlan_port_map[val->port_vlan] = portmap;
 
 	xrx200sw_fixup_pvids();
 
@@ -834,19 +827,16 @@
 //	.get_port_stats = xrx200sw_get_port_stats, //TODO
 };
 
-static int xrx200sw_init(struct xrx200_hw *hw)
+static int xrx200sw_init(struct xrx200_priv *priv)
 {
-	int netdev_num;
 
-	for (netdev_num = 0; netdev_num < hw->num_devs; netdev_num++)
-	{
 		struct switch_dev *swdev;
-		struct net_device *dev = hw->devs[netdev_num];
-		struct xrx200_priv *priv = netdev_priv(dev);
-		if (!priv->sw)
-			continue;
+		if (!priv->sw) {
+			pr_info("!!!! no switch\n");
+			return -ENODEV;
+		}
 
-		swdev = &hw->swdev;
+		swdev = &priv->swdev;
 
 		swdev->name = "Lantiq XRX200 Switch";
 		swdev->vlans = XRX200_MAX_VLAN;
@@ -854,32 +844,49 @@
 		swdev->cpu_port = 6;
 		swdev->ops = &xrx200sw_ops;
 
-		register_switch(swdev, dev);
+		register_switch(swdev, priv->net_dev);
 		return 0; // enough switches
+}
+
+/* drop all the packets from the DMA ring */
+static void xrx200_flush_dma(struct xrx200_chan *ch)
+{
+	int i;
+
+	for (i = 0; i < LTQ_DESC_NUM; i++) {
+		struct ltq_dma_desc *desc = &ch->dma.desc_base[ch->dma.desc];
+
+		if ((desc->ctl & (LTQ_DMA_OWN | LTQ_DMA_C)) != LTQ_DMA_C)
+			break;
+
+		desc->ctl = LTQ_DMA_OWN | LTQ_DMA_RX_OFFSET(NET_IP_ALIGN) |
+			    XRX200_DMA_DATA_LEN;
+		ch->dma.desc++;
+		ch->dma.desc %= LTQ_DESC_NUM;
 	}
-	return 0;
 }
 
 static int xrx200_open(struct net_device *dev)
 {
 	struct xrx200_priv *priv = netdev_priv(dev);
-	int i;
 
-	for (i = 0; i < XRX200_MAX_DMA; i++) {
-		if (!priv->hw->chan[i].dma.irq)
-			continue;
-		spin_lock_bh(&priv->hw->chan[i].lock);
-		if (!priv->hw->chan[i].refcount) {
-			if (XRX200_DMA_IS_RX(i))
-				napi_enable(&priv->hw->chan[i].napi);
-			ltq_dma_open(&priv->hw->chan[i].dma);
-		}
-		priv->hw->chan[i].refcount++;
-		spin_unlock_bh(&priv->hw->chan[i].lock);
-	}
-	for (i = 0; i < priv->num_port; i++)
-		if (priv->port[i].phydev)
-			phy_start(priv->port[i].phydev);
+	napi_enable(&priv->chan_tx.napi);
+	ltq_dma_open(&priv->chan_tx.dma);
+	ltq_dma_enable_irq(&priv->chan_tx.dma);
+
+	napi_enable(&priv->chan_rx.napi);
+	ltq_dma_open(&priv->chan_rx.dma);
+	/* The boot loader does not always deactivate the receiving of frames
+	 * on the ports and then some packets queue up in the PPE buffers.
+	 * They already passed the PMAC so they do not have the tags
+	 * configured here. Read the these packets here and drop them.
+	 * The HW should have written them into memory after 10us
+	 */
+	usleep_range(20, 40);
+	xrx200_flush_dma(&priv->chan_rx);
+
+	ltq_dma_enable_irq(&priv->chan_rx.dma);
+	
 	netif_wake_queue(dev);
 
 	return 0;
@@ -896,19 +903,11 @@
 		if (priv->port[i].phydev)
 			phy_stop(priv->port[i].phydev);
 
-	for (i = 0; i < XRX200_MAX_DMA; i++) {
-		if (!priv->hw->chan[i].dma.irq)
-			continue;
+	napi_disable(&priv->chan_rx.napi);
+	ltq_dma_close(&priv->chan_rx.dma);
 
-		priv->hw->chan[i].refcount--;
-		if (!priv->hw->chan[i].refcount) {
-			if (XRX200_DMA_IS_RX(i))
-				napi_disable(&priv->hw->chan[i].napi);
-			spin_lock_bh(&priv->hw->chan[i].lock);
-			ltq_dma_close(&priv->hw->chan[XRX200_DMA_RX].dma);
-			spin_unlock_bh(&priv->hw->chan[i].lock);
-		}
-	}
+	napi_disable(&priv->chan_tx.napi);
+	ltq_dma_close(&priv->chan_tx.dma);
 
 	return 0;
 }
@@ -938,8 +937,8 @@
 
 static void xrx200_hw_receive(struct xrx200_chan *ch, int id)
 {
-	struct net_device *dev = ch->devs[id];
-	struct xrx200_priv *priv = netdev_priv(dev);
+	struct xrx200_priv *priv = ch->priv;
+	struct net_device *dev = priv->net_dev;
 	struct ltq_dma_desc *desc = &ch->dma.desc_base[ch->dma.desc];
 	struct sk_buff *skb = ch->skb[ch->dma.desc];
 	int len = (desc->ctl & LTQ_DMA_SIZE_MASK);
@@ -963,15 +962,15 @@
 	skb->dev = dev;
 	skb->protocol = eth_type_trans(skb, dev);
 	netif_receive_skb(skb);
-	priv->stats.rx_packets++;
-	priv->stats.rx_bytes+=len;
+	dev->stats.rx_packets++;
+	dev->stats.rx_bytes+=len;
 }
 
 static int xrx200_poll_rx(struct napi_struct *napi, int budget)
 {
 	struct xrx200_chan *ch = container_of(napi,
 				struct xrx200_chan, napi);
-	struct xrx200_priv *priv = netdev_priv(ch->devs[0]);
+	struct xrx200_priv *priv = ch->priv;
 	int rx = 0;
 	int complete = 0;
 
@@ -982,7 +981,7 @@
 			struct sk_buff *skb = ch->skb[ch->dma.desc];
 			u8 *special_tag = (u8*)skb->data;
 			int port = (special_tag[7] >> SPPID_SHIFT) & SPPID_MASK;
-			xrx200_hw_receive(ch, priv->hw->port_map[port]);
+			xrx200_hw_receive(ch, priv->port_map[port]);
 #else
 			xrx200_hw_receive(ch, 0);
 #endif
@@ -993,47 +992,70 @@
 	}
 
 	if (complete || !rx) {
-		napi_complete(&ch->napi);
+
+		if (napi_complete_done(&ch->napi,rx)) {
+//		ltq_dma_ack_irq(&ch->dma);
 		ltq_dma_enable_irq(&ch->dma);
+		}
 	}
 
 	return rx;
 }
 
-static void xrx200_tx_housekeeping(unsigned long ptr)
+
+static struct net_device_stats *xrx200_get_stats (struct net_device *dev)
 {
-	struct xrx200_chan *ch = (struct xrx200_chan *) ptr;
+	struct xrx200_priv *priv = netdev_priv(dev);
+
+	return &priv->stats;
+}
+
+
+static int xrx200_tx_housekeeping(struct napi_struct *napi, int budget)
+{
+	struct xrx200_chan *ch = container_of(napi,
+				struct xrx200_chan, napi);
+	struct net_device *net_dev = ch->priv->net_dev;
 	int pkts = 0;
-	int i;
+	int bytes = 0;
 
-	spin_lock_bh(&ch->lock);
-	ltq_dma_ack_irq(&ch->dma);
-	while ((ch->dma.desc_base[ch->tx_free].ctl & (LTQ_DMA_OWN | LTQ_DMA_C)) == LTQ_DMA_C) {
-		struct sk_buff *skb = ch->skb[ch->tx_free];
+	while (pkts < budget) {
+		struct ltq_dma_desc *desc = &ch->dma.desc_base[ch->tx_free];
 
-		pkts++;
-		ch->skb[ch->tx_free] = NULL;
-		dev_kfree_skb(skb);
-		memset(&ch->dma.desc_base[ch->tx_free], 0,
-			sizeof(struct ltq_dma_desc));
-		ch->tx_free++;
-		ch->tx_free %= LTQ_DESC_NUM;
-	}
-	ltq_dma_enable_irq(&ch->dma);
-	spin_unlock_bh(&ch->lock);
+		if ((desc->ctl & (LTQ_DMA_OWN | LTQ_DMA_C)) == LTQ_DMA_C) {
+			struct sk_buff *skb = ch->skb[ch->tx_free];
 
-	if (!pkts)
-		return;
+			pkts++;
+			bytes += skb->len;
+			ch->skb[ch->tx_free] = NULL;
+			consume_skb(skb);
+			memset(&ch->dma.desc_base[ch->tx_free], 0,
+			       sizeof(struct ltq_dma_desc));
+			ch->tx_free++;
+			ch->tx_free %= LTQ_DESC_NUM;
+		} else {
+			break;
+		}
+	}
 
-	for (i = 0; i < XRX200_MAX_DEV && ch->devs[i]; i++)
-		netif_wake_queue(ch->devs[i]);
-}
+	net_dev->stats.tx_packets += pkts;
+	net_dev->stats.tx_bytes += bytes;
 
-static struct net_device_stats *xrx200_get_stats (struct net_device *dev)
-{
-	struct xrx200_priv *priv = netdev_priv(dev);
+	if (pkts < budget) {
+		if (napi_complete_done(&ch->napi, pkts)) {
+//			ltq_dma_ack_irq(&ch->dma);
+			ltq_dma_enable_irq(&ch->dma);
+		}
+	}
+	
+	if (netif_queue_stopped(net_dev)) {
+		if (ch->dma.desc != ch->tx_free) {
+			netif_wake_queue(net_dev);
+		}
+		
+	}
 
-	return &priv->stats;
+	return pkts;
 }
 
 static void xrx200_tx_timeout(struct net_device *dev)
@@ -1043,33 +1065,42 @@
 	printk(KERN_ERR "%s: transmit timed out, disable the dma channel irq\n", dev->name);
 
 	priv->stats.tx_errors++;
+	
+	ltq_dma_enable_irq(&priv->chan_tx.dma);  //TODO necessary?
+	
 	netif_wake_queue(dev);
 }
 
 static int xrx200_start_xmit(struct sk_buff *skb, struct net_device *dev)
 {
 	struct xrx200_priv *priv = netdev_priv(dev);
-	struct xrx200_chan *ch;
+	struct xrx200_chan *ch = &priv->chan_tx;
+
 	struct ltq_dma_desc *desc;
 	u32 byte_offset;
 	int ret = NETDEV_TX_OK;
 	int len;
+	dma_addr_t mapping;	
 #ifdef SW_ROUTING
 	u32 special_tag = (SPID_CPU_PORT << SPID_SHIFT) | DPID_ENABLE;
 #endif
-	if(priv->id)
-		ch = &priv->hw->chan[XRX200_DMA_TX_2];
-	else
-		ch = &priv->hw->chan[XRX200_DMA_TX];
 
 	desc = &ch->dma.desc_base[ch->dma.desc];
 
+/*
 	skb->dev = dev;
 	len = skb->len < ETH_ZLEN ? ETH_ZLEN : skb->len;
+*/
+	if (skb_put_padto(skb, ETH_ZLEN)) {
+		dev->stats.tx_dropped++;
+		return NETDEV_TX_OK;
+	}
+
+	len = skb->len;
 
 #ifdef SW_ROUTING
 	if (is_multicast_ether_addr(eth_hdr(skb)->h_dest)) {
-		u16 port_map = priv->port_map;
+		u16 port_map = priv->d_port_map;
 
 		if (priv->sw && skb->protocol == htons(ETH_P_8021Q)) {
 			u16 vid;
@@ -1078,9 +1109,9 @@
 			port_map = 0;
 			if (!__vlan_get_tag(skb, &vid)) {
 				for (i = 0; i < XRX200_MAX_VLAN; i++) {
-					if (priv->hw->vlan_vid[i] != vid)
+					if (priv->vlan_vid[i] != vid)
 						continue;
-					port_map = priv->hw->vlan_port_map[i];
+					port_map = priv->vlan_port_map[i];
 					break;
 				}
 			}
@@ -1093,6 +1124,7 @@
 		special_tag |= (1 << DPID_SHIFT);
 	if(skb_headroom(skb) < 4) {
 		struct sk_buff *tmp = skb_realloc_headroom(skb, 4);
+pr_info("-------fucking slow\n");
 		dev_kfree_skb_any(skb);
 		skb = tmp;
 	}
@@ -1101,10 +1133,19 @@
 	len += 4;
 #endif
 
+/*
+if (skb->len > 1518) {
+pr_info("lll %i\n", skb->len);
+}
+
+if (len > 1520) {
+pr_info("LLL %i\n", len);
+}
+*/
 	/* dma needs to start on a 16 byte aligned address */
 	byte_offset = CPHYSADDR(skb->data) % 16;
 
-	spin_lock_bh(&ch->lock);
+//	spin_lock_bh(&ch->lock);
 	if ((desc->ctl & (LTQ_DMA_OWN | LTQ_DMA_C)) || ch->skb[ch->dma.desc]) {
 		netdev_err(dev, "tx ring full\n");
 		netif_stop_queue(dev);
@@ -1114,83 +1155,111 @@
 
 	ch->skb[ch->dma.desc] = skb;
 
-	netif_trans_update(dev);
-
-	desc->addr = ((unsigned int) dma_map_single(NULL, skb->data, len,
+/*
+	desc->addr = ((unsigned int) dma_map_single(priv->dev, skb->data, len,
 						DMA_TO_DEVICE)) - byte_offset;
+*/
+						
+	mapping = dma_map_single(priv->dev, skb->data, len, DMA_TO_DEVICE);
+	if (unlikely(dma_mapping_error(priv->dev, mapping))) {
+pr_info("!!!!! dma mapping error\n");
+		dev_kfree_skb(skb);
+		dev->stats.tx_dropped++;
+		dev->stats.tx_errors++;	
+		ret = NETDEV_TX_OK;
+		goto out;
+	}
+
+	/* dma needs to start on a 16 byte aligned address */
+	byte_offset = mapping % 16;
+
+	desc->addr = mapping - byte_offset;						
+
 	wmb();
 	desc->ctl = LTQ_DMA_OWN | LTQ_DMA_SOP | LTQ_DMA_EOP |
 		LTQ_DMA_TX_OFFSET(byte_offset) | (len & LTQ_DMA_SIZE_MASK);
 	ch->dma.desc++;
 	ch->dma.desc %= LTQ_DESC_NUM;
-	if (ch->dma.desc == ch->tx_free)
+	if (ch->dma.desc == ch->tx_free) {
+pr_info("rx full\n");
 		netif_stop_queue(dev);
+	}
 
-
-	priv->stats.tx_packets++;
-	priv->stats.tx_bytes+=len;
-
+//	skb_tx_timestamp(skb);
+	
 out:
-	spin_unlock_bh(&ch->lock);
+//	spin_unlock_bh(&ch->lock);
 
 	return ret;
 }
 
-static irqreturn_t xrx200_dma_irq(int irq, void *priv)
+static irqreturn_t xrx200_dma_irq(int irq, void *ptr)
 {
-	struct xrx200_hw *hw = priv;
-	int chnr = irq - XRX200_DMA_IRQ;
-	struct xrx200_chan *ch = &hw->chan[chnr];
+	struct xrx200_chan *ch = ptr;
 
 	ltq_dma_disable_irq(&ch->dma);
 	ltq_dma_ack_irq(&ch->dma);
-
-	if (chnr % 2)
-		tasklet_schedule(&ch->tasklet);
-	else
-		napi_schedule(&ch->napi);
+	napi_schedule(&ch->napi);
 
 	return IRQ_HANDLED;
 }
 
-static int xrx200_dma_init(struct xrx200_hw *hw)
+static int xrx200_dma_init(struct xrx200_priv *priv)
 {
-	int i, err = 0;
+	int i;
+	struct xrx200_chan *ch_rx = &priv->chan_rx;
+	struct xrx200_chan *ch_tx = &priv->chan_tx;	
+	int ret;
 
 	ltq_dma_init_port(DMA_PORT_ETOP);
 
-	for (i = 0; i < 8 && !err; i++) {
-		int irq = XRX200_DMA_IRQ + i;
-		struct xrx200_chan *ch = &hw->chan[i];
-
-		spin_lock_init(&ch->lock);
-
-		ch->idx = ch->dma.nr = i;
-
-		if (i == XRX200_DMA_TX) {
-			ltq_dma_alloc_tx(&ch->dma);
-			err = request_irq(irq, xrx200_dma_irq, 0, "vrx200_tx", hw);
-		} else if (i == XRX200_DMA_TX_2) {
-			ltq_dma_alloc_tx(&ch->dma);
-			err = request_irq(irq, xrx200_dma_irq, 0, "vrx200_tx_2", hw);
-		} else if (i == XRX200_DMA_RX) {
-			ltq_dma_alloc_rx(&ch->dma);
-			for (ch->dma.desc = 0; ch->dma.desc < LTQ_DESC_NUM;
-					ch->dma.desc++)
-				if (xrx200_alloc_skb(ch))
-					err = -ENOMEM;
-			ch->dma.desc = 0;
-			err = request_irq(irq, xrx200_dma_irq, 0, "vrx200_rx", hw);
-		} else
-			continue;
+	ch_rx->dma.nr = XRX200_DMA_RX;
+	ch_rx->priv = priv;
+	
+	ltq_dma_alloc_rx(&ch_rx->dma);
+	for (ch_rx->dma.desc = 0; ch_rx->dma.desc < LTQ_DESC_NUM;
+	     ch_rx->dma.desc++) {
+		ret = xrx200_alloc_skb(ch_rx);
+		if (ret)
+			goto rx_free;
+	}
+	ch_rx->dma.desc = 0;
+	
+	ret = devm_request_irq(priv->dev, ch_rx->dma.irq, xrx200_dma_irq, 0,
+			       "vrx200_rx", &priv->chan_rx);
+	if (ret) {
+		dev_err(priv->dev, "failed to request RX irq %d\n",
+			ch_rx->dma.irq);
+		goto rx_ring_free;
+	}
+		
+	ch_tx->dma.nr = XRX200_DMA_TX;
+	ch_tx->priv = priv;
+
+	ltq_dma_alloc_tx(&ch_tx->dma);
+	ret = devm_request_irq(priv->dev, ch_tx->dma.irq, xrx200_dma_irq, 0,
+			       "vrx200_tx", &priv->chan_tx);
+	if (ret) {
+		dev_err(priv->dev, "failed to request TX irq %d\n",
+			ch_tx->dma.irq);
+		goto tx_free;
+	}
 
-		if (!err)
-			ch->dma.irq = irq;
-		else
-			pr_err("net-xrx200: failed to request irq %d\n", irq);
+	return ret;
+
+tx_free:
+	ltq_dma_free(&ch_tx->dma);
+
+rx_ring_free:
+	/* free the allocated RX ring */
+	for (i = 0; i < LTQ_DESC_NUM; i++) {
+		if (priv->chan_rx.skb[i])
+			dev_kfree_skb_any(priv->chan_rx.skb[i]);
 	}
 
-	return err;
+rx_free:
+	ltq_dma_free(&ch_rx->dma);
+	return ret;
 }
 
 #ifdef SW_POLLING
@@ -1328,11 +1397,12 @@
 {
 	struct net_device *netdev = phydev->attached_dev;
 
-	if (do_carrier)
+	if (do_carrier) {
 		if (up)
 			netif_carrier_on(netdev);
 		else if (!xrx200_phy_has_link(netdev))
 			netif_carrier_off(netdev);
+	}
 
 	phydev->adjust_link(netdev);
 }
@@ -1343,7 +1413,7 @@
 	struct phy_device *phydev = NULL;
 	unsigned val;
 
-	phydev = mdiobus_get_phy(priv->hw->mii_bus, port->phy_addr);
+	phydev = mdiobus_get_phy(priv->mii_bus, port->phy_addr);
 
 	if (!phydev) {
 		netdev_err(dev, "no PHY found\n");
@@ -1376,10 +1446,10 @@
 #ifdef SW_POLLING
 	phy_read_status(phydev);
 
-	val = xrx200_mdio_rd(priv->hw->mii_bus, MDIO_DEVAD_NONE, MII_CTRL1000);
+	val = xrx200_mdio_rd(priv->mii_bus, MDIO_DEVAD_NONE, MII_CTRL1000);
 	val |= ADVERTIZE_MPD;
-	xrx200_mdio_wr(priv->hw->mii_bus, MDIO_DEVAD_NONE, MII_CTRL1000, val);
-	xrx200_mdio_wr(priv->hw->mii_bus, 0, 0, 0x1040);
+	xrx200_mdio_wr(priv->mii_bus, MDIO_DEVAD_NONE, MII_CTRL1000, val);
+	xrx200_mdio_wr(priv->mii_bus, 0, 0, 0x1040);
 
 	phy_start_aneg(phydev);
 #endif
@@ -1522,12 +1592,12 @@
 	ltq_switch_w32_mask(0, BIT(3), PCE_GCTRL_REG(0));
 }
 
-static void xrx200_hw_init(struct xrx200_hw *hw)
+static void xrx200_hw_init(struct xrx200_priv *priv)
 {
 	int i;
 
 	/* enable clock gate */
-	clk_enable(hw->clk);
+	clk_enable(priv->clk);
 
 	ltq_switch_w32(1, 0);
 	mdelay(100);
@@ -1595,49 +1665,45 @@
 	xrx200sw_write_x(1, XRX200_BM_QUEUE_GCTRL_GL_MOD, 0);
 
 	for (i = 0; i < XRX200_MAX_VLAN; i++)
-		hw->vlan_vid[i] = i;
+		priv->vlan_vid[i] = i;
 }
 
-static void xrx200_hw_cleanup(struct xrx200_hw *hw)
+static void xrx200_hw_cleanup(struct xrx200_priv *priv)
 {
 	int i;
 
 	/* disable the switch */
 	ltq_mdio_w32_mask(MDIO_GLOB_ENABLE, 0, MDIO_GLOB);
 
-	/* free the channels and IRQs */
-	for (i = 0; i < 2; i++) {
-		ltq_dma_free(&hw->chan[i].dma);
-		if (hw->chan[i].dma.irq)
-			free_irq(hw->chan[i].dma.irq, hw);
-	}
+	ltq_dma_free(&priv->chan_tx.dma);
+	ltq_dma_free(&priv->chan_rx.dma);
 
 	/* free the allocated RX ring */
 	for (i = 0; i < LTQ_DESC_NUM; i++)
-		dev_kfree_skb_any(hw->chan[XRX200_DMA_RX].skb[i]);
+		dev_kfree_skb_any(priv->chan_rx.skb[i]);
 
 	/* clear the mdio bus */
-	mdiobus_unregister(hw->mii_bus);
-	mdiobus_free(hw->mii_bus);
+	mdiobus_unregister(priv->mii_bus);
+	mdiobus_free(priv->mii_bus);
 
 	/* release the clock */
-	clk_disable(hw->clk);
-	clk_put(hw->clk);
+	clk_disable(priv->clk);
+	clk_put(priv->clk);
 }
 
-static int xrx200_of_mdio(struct xrx200_hw *hw, struct device_node *np)
+static int xrx200_of_mdio(struct xrx200_priv *priv, struct device_node *np)
 {
-	hw->mii_bus = mdiobus_alloc();
-	if (!hw->mii_bus)
+	priv->mii_bus = mdiobus_alloc();
+	if (!priv->mii_bus)
 		return -ENOMEM;
 
-	hw->mii_bus->read = xrx200_mdio_rd;
-	hw->mii_bus->write = xrx200_mdio_wr;
-	hw->mii_bus->name = "lantiq,xrx200-mdio";
-	snprintf(hw->mii_bus->id, MII_BUS_ID_SIZE, "%x", 0);
+	priv->mii_bus->read = xrx200_mdio_rd;
+	priv->mii_bus->write = xrx200_mdio_wr;
+	priv->mii_bus->name = "lantiq,xrx200-mdio";
+	snprintf(priv->mii_bus->id, MII_BUS_ID_SIZE, "%x", 0);
 
-	if (of_mdiobus_register(hw->mii_bus, np)) {
-		mdiobus_free(hw->mii_bus);
+	if (of_mdiobus_register(priv->mii_bus, np)) {
+		mdiobus_free(priv->mii_bus);
 		return -ENXIO;
 	}
 
@@ -1677,12 +1743,12 @@
 		}
 	/* is this port a wan port ? */
 	if (priv->wan)
-		priv->hw->wan_map |= BIT(p->num);
+		priv->wan_map |= BIT(p->num);
 
-	priv->port_map |= BIT(p->num);
+	priv->d_port_map |= BIT(p->num);
 
 	/* store the port id in the hw struct so we can map ports -> devices */
-	priv->hw->port_map[p->num] = priv->hw->num_devs;
+	priv->port_map[p->num] = 0;
 }
 
 static const struct net_device_ops xrx200_netdev_ops = {
@@ -1696,29 +1762,21 @@
 	.ndo_tx_timeout		= xrx200_tx_timeout,
 };
 
-static void xrx200_of_iface(struct xrx200_hw *hw, struct device_node *iface, struct device *dev)
+static void xrx200_of_iface(struct xrx200_priv *priv, struct device_node *iface, struct device *dev)
 {
-	struct xrx200_priv *priv;
 	struct device_node *port;
 	const __be32 *wan;
 	const u8 *mac;
 
-	/* alloc the network device */
-	hw->devs[hw->num_devs] = alloc_etherdev(sizeof(struct xrx200_priv));
-	if (!hw->devs[hw->num_devs])
-		return;
-
 	/* setup the network device */
-	strcpy(hw->devs[hw->num_devs]->name, "eth%d");
-	hw->devs[hw->num_devs]->netdev_ops = &xrx200_netdev_ops;
-	hw->devs[hw->num_devs]->watchdog_timeo = XRX200_TX_TIMEOUT;
-	hw->devs[hw->num_devs]->needed_headroom = XRX200_HEADROOM;
-	SET_NETDEV_DEV(hw->devs[hw->num_devs], dev);
+	strcpy(priv->net_dev->name, "eth%d");
+	priv->net_dev->netdev_ops = &xrx200_netdev_ops;
+	priv->net_dev->watchdog_timeo = XRX200_TX_TIMEOUT;
+	priv->net_dev->needed_headroom = XRX200_HEADROOM;
+	SET_NETDEV_DEV(priv->net_dev, dev);
 
 	/* setup our private data */
-	priv = netdev_priv(hw->devs[hw->num_devs]);
-	priv->hw = hw;
-	priv->id = hw->num_devs;
+	priv->id = 0;
 
 	mac = of_get_mac_address(iface);
 	if (mac)
@@ -1738,20 +1796,33 @@
 		if (of_device_is_compatible(port, "lantiq,xrx200-pdi-port"))
 			xrx200_of_port(priv, port);
 
-	/* register the actual device */
-	if (!register_netdev(hw->devs[hw->num_devs]))
-		hw->num_devs++;
 }
 
-static struct xrx200_hw xrx200_hw;
-
 static int xrx200_probe(struct platform_device *pdev)
 {
+	struct device *dev = &pdev->dev;
 	struct resource *res[4];
 	struct device_node *mdio_np, *iface_np, *phy_np;
 	struct of_phandle_iterator it;
 	int err;
 	int i;
+	struct xrx200_priv *priv;	
+	struct net_device *net_dev;
+
+
+	/* alloc the network device */
+	net_dev = devm_alloc_etherdev(dev, sizeof(struct xrx200_priv));
+	if (!net_dev)
+		return -ENOMEM;
+
+	priv = netdev_priv(net_dev);
+	priv->net_dev = net_dev;
+	priv->dev = dev;
+
+	net_dev->netdev_ops = &xrx200_netdev_ops;
+	SET_NETDEV_DEV(net_dev, dev);
+	net_dev->min_mtu = ETH_ZLEN;
+	net_dev->max_mtu = XRX200_DMA_DATA_LEN;
 
 	/* load the memory ranges */
 	for (i = 0; i < 4; i++) {
@@ -1781,85 +1852,90 @@
 				return -EPROBE_DEFER;
 		}
 	}
+	
+	priv->chan_rx.dma.irq = XRX200_DMA_IRQ + XRX200_DMA_RX;
+	priv->chan_tx.dma.irq = XRX200_DMA_IRQ + XRX200_DMA_TX;
+	priv->chan_rx.priv = priv;
+	priv->chan_tx.priv = priv;
 
 	/* get the clock */
-	xrx200_hw.clk = clk_get(&pdev->dev, NULL);
-	if (IS_ERR(xrx200_hw.clk)) {
+	priv->clk = clk_get(&pdev->dev, NULL);
+	if (IS_ERR(priv->clk)) {
 		dev_err(&pdev->dev, "failed to get clock\n");
-		return PTR_ERR(xrx200_hw.clk);
+		return PTR_ERR(priv->clk);
 	}
 
 	/* bring up the dma engine and IP core */
-	xrx200_dma_init(&xrx200_hw);
-	xrx200_hw_init(&xrx200_hw);
-	tasklet_init(&xrx200_hw.chan[XRX200_DMA_TX].tasklet, xrx200_tx_housekeeping, (u32) &xrx200_hw.chan[XRX200_DMA_TX]);
-	tasklet_init(&xrx200_hw.chan[XRX200_DMA_TX_2].tasklet, xrx200_tx_housekeeping, (u32) &xrx200_hw.chan[XRX200_DMA_TX_2]);
+	err = xrx200_dma_init(priv);
+	if (err)
+		return err;
+
+	/* enable clock gate */
+	err = clk_prepare_enable(priv->clk);
+	if (err)
+		goto err_uninit_dma;
+
+	xrx200_hw_init(priv);
 
 	/* bring up the mdio bus */
 	mdio_np = of_find_compatible_node(pdev->dev.of_node, NULL,
 				"lantiq,xrx200-mdio");
 	if (mdio_np)
-		if (xrx200_of_mdio(&xrx200_hw, mdio_np))
+		if (xrx200_of_mdio(priv, mdio_np))
 			dev_err(&pdev->dev, "mdio probe failed\n");
 
 	/* load the interfaces */
 	for_each_child_of_node(pdev->dev.of_node, iface_np)
-		if (of_device_is_compatible(iface_np, "lantiq,xrx200-pdi")) {
-			if (xrx200_hw.num_devs < XRX200_MAX_DEV)
-				xrx200_of_iface(&xrx200_hw, iface_np, &pdev->dev);
-			else
-				dev_err(&pdev->dev,
-					"only %d interfaces allowed\n",
-					XRX200_MAX_DEV);
-		}
-
-	if (!xrx200_hw.num_devs) {
-		xrx200_hw_cleanup(&xrx200_hw);
-		dev_err(&pdev->dev, "failed to load interfaces\n");
-		return -ENOENT;
-	}
-
-	xrx200sw_init(&xrx200_hw);
+			if (of_device_is_compatible(iface_np, "lantiq,xrx200-pdi")) {
+				xrx200_of_iface(priv, iface_np, &pdev->dev);
+				break;	//hack
+			}
+						
+	xrx200sw_init(priv);
 
 	/* set wan port mask */
-	ltq_pmac_w32(xrx200_hw.wan_map, PMAC_EWAN);
-
-	for (i = 0; i < xrx200_hw.num_devs; i++) {
-		xrx200_hw.chan[XRX200_DMA_RX].devs[i] = xrx200_hw.devs[i];
-		xrx200_hw.chan[XRX200_DMA_TX].devs[i] = xrx200_hw.devs[i];
-		xrx200_hw.chan[XRX200_DMA_TX_2].devs[i] = xrx200_hw.devs[i];
-	}
+	ltq_pmac_w32(priv->wan_map, PMAC_EWAN);
 
 	/* setup NAPI */
-	init_dummy_netdev(&xrx200_hw.chan[XRX200_DMA_RX].dummy_dev);
-	netif_napi_add(&xrx200_hw.chan[XRX200_DMA_RX].dummy_dev,
-			&xrx200_hw.chan[XRX200_DMA_RX].napi, xrx200_poll_rx, 32);
+	netif_napi_add(net_dev, &priv->chan_rx.napi, xrx200_poll_rx, 32);	//32
+	netif_napi_add(net_dev, &priv->chan_tx.napi, xrx200_tx_housekeeping, 32);
+	
+	platform_set_drvdata(pdev, priv);
 
-	platform_set_drvdata(pdev, &xrx200_hw);
+	err = register_netdev(net_dev);
+	if (err)
+		goto err_unprepare_clk;
 
 	return 0;
+
+err_unprepare_clk:
+	clk_disable_unprepare(priv->clk);
+
+err_uninit_dma:
+	xrx200_hw_cleanup(priv);
+
+	return err;
 }
 
 static int xrx200_remove(struct platform_device *pdev)
 {
-	struct net_device *dev = platform_get_drvdata(pdev);
-	struct xrx200_priv *priv;
 
-	if (!dev)
-		return 0;
-
-	priv = netdev_priv(dev);
+	struct xrx200_priv *priv = platform_get_drvdata(pdev);
+	struct net_device *net_dev = priv->net_dev;
 
 	/* free stack related instances */
-	netif_stop_queue(dev);
-	netif_napi_del(&xrx200_hw.chan[XRX200_DMA_RX].napi);
-
-	/* shut down hardware */
-	xrx200_hw_cleanup(&xrx200_hw);
+	netif_stop_queue(net_dev);
+	netif_napi_del(&priv->chan_tx.napi);
+	netif_napi_del(&priv->chan_rx.napi);
 
 	/* remove the actual device */
-	unregister_netdev(dev);
-	free_netdev(dev);
+	unregister_netdev(net_dev);
+
+	/* release the clock */
+	clk_disable_unprepare(priv->clk);
+
+	/* shut down hardware */
+	xrx200_hw_cleanup(priv);
 
 	return 0;
 }
Hauke Mehrtens Feb. 10, 2019, 3:49 p.m. UTC | #6
Hi Petr,

Thank you for the tests.

On 2/3/19 9:44 AM, Petr Cvek wrote:
> I did an exhaustive ethernet measuring. Parameters: no wifi, no running
> dsl connection, 1 cable (in 1G port with external phy), no USB, almost
> vanilla openwrt (changes for rootfs on NFS, kernel command line and fix
> for uwc2 USB).
> 
> run.sh
> A script which runs and logs measurements into a file named by its first
> parameter (or just the unix epoch time). You need to run "iperf3 -s" on
> lantiq manually.

I am surprised that "iperf3 -c 10.0.0.80" has the double speed of
"iperf3 -c 10.0.0.80 -R" isn't this the same stream just in the
different direction?

> *_a and *_b files
> Main iperf3 measurements. It seems the schedulers migrates processes
> between VPEs (in every configuration). There are sometimes differences
> of ~20Mbit/s. To isolate that one would probably have to compile and use
> cgroups.
> 
> *_netcat
> Running netcat pipe with pipeview in server/client and TCP/UDP mode.
> More useful to measure the changes of the process affinity.
> 
> vanilla*
> Default (slowest) openwrt code.
> 
> backported*
> Ethernet driver with full napi polling, used from vanilla kernel v5.
> Newest patch in the attachment too.
> 
> dma_burst*
> The change in size of DMA burst, from default to (probably) 4 words.
> 
> smp_icu_different_vpes*
> ICU with SMP interrupts support. Forcing the IRQ SMP affinity to
> different VPE for TX and RX interrupt. Process jumping between VPE
> should have the smallest impact here.
> 
> smp_icu_same_vpe*
> Both TX and RX interrupts are on the same VPE (forced on CPU0). Probably
> the biggest impact from process jumping between VPEs (not checked).
> 
> everything*
> SMP ICU, DMA burst and "backported" ethernet driver together.
> 
> 
> Notes:
> 1) The backported driver seems to not working on some machines (I would
> assume everything different from 4x 1G ports). You can still patch the
> polling and interrupt routines to match the vanilla kernel. A help why
> it doesn't boot would be appreciated (are your machine using multiple
> eth%d interfaces, how does dmesg look like, ...).
> 
> 2) The vanilla openwrt driver declares TX2 interrupt and HW. There is no
> traffic on this interrupt (on DMA channel probably too?). Does anybody
> have some documentation how this work? Are there more DMA interfaces
> from/to which send the data?

In the SoC there are 2 internal GPHYs and some *MII connections to
external PHYs. They are all connected to the GSWIP inside of the SoC, on
the CPU port normally a special tag is added to every packet which
indicates from which LAN port it was received on. This CPU port is
connected to the PPE and the PPE is connected to two DMA channels which
send the packets to the MIPS CPU running Linux. There are two ports
between the PPA and the CPU, the upstream driver only uses one of these
ports as we let the PPE stay in the default configuration. We could
later use it to put high prio packets on a special channel or to put the
DSL packets onto the other channel.

> 3) The second ICU devicetree node doesn't need to be deleted for
> uniprocessor ICU usage.

When the Voice firmware is used the second VPE is used for this FW and
not for Linux then the ICU should only use one block.

> Feel free to make your own tests and sorry for hardcoded IPs :-D

I would like to use the upstream driver also in OpenWrt, I am working on
bridge offloading for the upstream DSA driver.  OpenWrt still misses a
script which can convert the common swconfig configuration into a bridge
configuration if such a script would be there I would like to switch to
the DSA driver with kernel 4.19.
Therefore I am not sure how efficient it is to invest so much time into
the driver currently used in OpenWrt.

> 
> Petr
> 
> Dne 30. 01. 19 v 11:38 Petr Cvek napsal(a):
>> Hello,
>>
>> I discovered the lantiq xrx200 lacks support for interrupts on secondary
>> VPE, and I've managed to add this functionality to the kernel, the
>> second icu controller lives on base address 0x1f880300 and works in the
>> same way as first. Tested with 4.14.93 kernel, untested patches in the
>> attachment or on openwrt forum:
>>
>> https://forum.openwrt.org/t/xrx200-irq-balancing-between-vpes/29732/11
>>
>> My second submission is a backported xrx200 ethernet driver from vanilla
>> kernel v5 patched with switch and phy functions. Using kernel napi
>> polling seems to highly increase the throughput of the network.
>>
>> Trying to initially increase the throughput of the network I've found
>> there is an inefficiently setting of DMA burst size. My patch sets this
>> value to a higher value.
>>
>> These two patches were tested with 4.14.93 kernel too, there is forum
>> thread:
>>
>> https://forum.openwrt.org/t/how-can-we-make-the-lantiq-xrx200-devices-faster/9724/30
>>
>> RFC for any parallel development info (next version of ethernet driver
>> will be based on vanilla kernel version?), ideas, testing ...
>>
>> best regards,
>> Petr Cvek
>>
>>
>> _______________________________________________
>> openwrt-devel mailing list
>> openwrt-devel@lists.openwrt.org
>> https://lists.openwrt.org/mailman/listinfo/openwrt-devel
Petr Cvek Feb. 10, 2019, 4:28 p.m. UTC | #7
Hi,

Dne 10. 02. 19 v 16:49 Hauke Mehrtens napsal(a):
> Hi Petr,
> 
> Thank you for the tests.
> 
> On 2/3/19 9:44 AM, Petr Cvek wrote:
>> I did an exhaustive ethernet measuring. Parameters: no wifi, no running
>> dsl connection, 1 cable (in 1G port with external phy), no USB, almost
>> vanilla openwrt (changes for rootfs on NFS, kernel command line and fix
>> for uwc2 USB).
>>
>> run.sh
>> A script which runs and logs measurements into a file named by its first
>> parameter (or just the unix epoch time). You need to run "iperf3 -s" on
>> lantiq manually.
> 
> I am surprised that "iperf3 -c 10.0.0.80" has the double speed of
> "iperf3 -c 10.0.0.80 -R" isn't this the same stream just in the
> different direction?
> 
Yeah that's why I started poking in the system at the first place. The
transmitting out was slow. It seems the problem is in the packet
generation, probably copying a skb into a linear buffer. When I
converted the driver for the skb frags support it speeded up (thread:
"[OpenWrt-Devel] [RFC] [PATCH v2] lantiq: net: ethernet driver with
fragments").

> In the SoC there are 2 internal GPHYs and some *MII connections to
> external PHYs. They are all connected to the GSWIP inside of the SoC, on
> the CPU port normally a special tag is added to every packet which
> indicates from which LAN port it was received on. This CPU port is
> connected to the PPE and the PPE is connected to two DMA channels which
> send the packets to the MIPS CPU running Linux. There are two ports
> between the PPA and the CPU, the upstream driver only uses one of these
> ports as we let the PPE stay in the default configuration. We could
> later use it to put high prio packets on a special channel or to put the
> DSL packets onto the other channel.
> 

Or make something like dual queue which is in the lantiq etop driver?
Thanks for info. I was thinking about a generic dual queue (each VPE
handling one) could be another speedup.

>> 3) The second ICU devicetree node doesn't need to be deleted for
>> uniprocessor ICU usage.
> 
> When the Voice firmware is used the second VPE is used for this FW and
> not for Linux then the ICU should only use one block.
> 
So machines with voice ports won't have second ICU node and machines
without voice ports can have it.

>> Feel free to make your own tests and sorry for hardcoded IPs :-D
> 
> I would like to use the upstream driver also in OpenWrt, I am working on
> bridge offloading for the upstream DSA driver.  OpenWrt still misses a
> script which can convert the common swconfig configuration into a bridge
> configuration if such a script would be there I would like to switch to
> the DSA driver with kernel 4.19.
> Therefore I am not sure how efficient it is to invest so much time into
> the driver currently used in OpenWrt.
> 

Well my changes are mostly only in xmit and TX polling NAPI code, maybe
some DMA intialization, so it should be fairly compatible I can patch
it. We should definitely put skb frags code in the final version though.

Petr
Hauke Mehrtens Feb. 10, 2019, 6:21 p.m. UTC | #8
On 2/10/19 5:28 PM, Petr Cvek wrote:
> Hi,
> 
> Dne 10. 02. 19 v 16:49 Hauke Mehrtens napsal(a):
>> Hi Petr,
>>
>> Thank you for the tests.
>>
>> On 2/3/19 9:44 AM, Petr Cvek wrote:
>>> I did an exhaustive ethernet measuring. Parameters: no wifi, no running
>>> dsl connection, 1 cable (in 1G port with external phy), no USB, almost
>>> vanilla openwrt (changes for rootfs on NFS, kernel command line and fix
>>> for uwc2 USB).
>>>
>>> run.sh
>>> A script which runs and logs measurements into a file named by its first
>>> parameter (or just the unix epoch time). You need to run "iperf3 -s" on
>>> lantiq manually.
>>
>> I am surprised that "iperf3 -c 10.0.0.80" has the double speed of
>> "iperf3 -c 10.0.0.80 -R" isn't this the same stream just in the
>> different direction?
>>
> Yeah that's why I started poking in the system at the first place. The
> transmitting out was slow. It seems the problem is in the packet
> generation, probably copying a skb into a linear buffer. When I
> converted the driver for the skb frags support it speeded up (thread:
> "[OpenWrt-Devel] [RFC] [PATCH v2] lantiq: net: ethernet driver with
> fragments").

One of the iperf instances was running on the router?
When the VR9 SoC was doing the TX it was slow and when it received it
was fast.

There are also 2 areas for the DMA controller so we can remove the
locking in the dma controller and use one register area for each CPU.

Did you also test the forwarding performance like NAT between 2 pots?


>> In the SoC there are 2 internal GPHYs and some *MII connections to
>> external PHYs. They are all connected to the GSWIP inside of the SoC, on
>> the CPU port normally a special tag is added to every packet which
>> indicates from which LAN port it was received on. This CPU port is
>> connected to the PPE and the PPE is connected to two DMA channels which
>> send the packets to the MIPS CPU running Linux. There are two ports
>> between the PPA and the CPU, the upstream driver only uses one of these
>> ports as we let the PPE stay in the default configuration. We could
>> later use it to put high prio packets on a special channel or to put the
>> DSL packets onto the other channel.
>>
> 
> Or make something like dual queue which is in the lantiq etop driver?
> Thanks for info. I was thinking about a generic dual queue (each VPE
> handling one) could be another speedup.

Yes we can probably also do something like this.

> 
>>> 3) The second ICU devicetree node doesn't need to be deleted for
>>> uniprocessor ICU usage.
>>
>> When the Voice firmware is used the second VPE is used for this FW and
>> not for Linux then the ICU should only use one block.
>>
> So machines with voice ports won't have second ICU node and machines
> without voice ports can have it.

To make voice work you need the voice FW whihc runs on one VPE.

> 
>>> Feel free to make your own tests and sorry for hardcoded IPs :-D
>>
>> I would like to use the upstream driver also in OpenWrt, I am working on
>> bridge offloading for the upstream DSA driver.  OpenWrt still misses a
>> script which can convert the common swconfig configuration into a bridge
>> configuration if such a script would be there I would like to switch to
>> the DSA driver with kernel 4.19.
>> Therefore I am not sure how efficient it is to invest so much time into
>> the driver currently used in OpenWrt.
>>
> 
> Well my changes are mostly only in xmit and TX polling NAPI code, maybe
> some DMA intialization, so it should be fairly compatible I can patch
> it. We should definitely put skb frags code in the final version though.
> 
> Petr
Hauke Mehrtens Feb. 10, 2019, 6:58 p.m. UTC | #9
On 2/1/19 12:36 PM, Petr Cvek wrote:
> Dne 01. 02. 19 v 10:51 Hauke Mehrtens napsal(a):> On 1/31/19 9:30 PM,
> Mathias Kresin wrote:
>>> 30/01/2019 11:38, Petr Cvek:
>>>>
> 
> Hi,
> 
> thank you both for the answer and sorry for "./" in the patches I
> usually do only git patching :-D. The patches are really RFC only. For
> example I would like to know if a separate node is the best way for SMP
> irq controller (ICU). The second set of the registers could be just
> appended at the end of icu0 registers.

Yes there are two identical register blocks for the ICU for each VPE
like you detected correctly.

The split into these 5 memory blocks we currently have in the driver
does not really match the documentation and the hardware, there it is
one block for each VPE. As the drivers currently already use the 5
register blocks for one ICU, I would suggest to add the 5 additional
memory blocks to the existing driver, if it does SMP. Be aware that this
driver is also used by some SoC which do not have multiple VPEs.

I think the locking should also be improved, but I do not know which
constrains the Linux kernel already provides you when these functions
are called.

> Origin of patches: well I was able to find second ICU just by dumping
> iomem space and looking for patterns (which is enough to make a clean
> implementation), but I was lazy to write it (again, done it once for
> some FPGA) myself so I've copied part of the code from this repo:
> 
> https://github.com/paldier/K3C-merlin/blob/master/release/src-lantiq/linux/linux-3.10.104/arch/mips/lantiq/irq.c
> 
> The probable address of second ICU was confirmed by grepping the GPL
> source codes from my modem's vendor (tplink td-W9980)
> 
> https://static.tp-link.com/resources/gpl/GPL_TD-W9980.tar.gz
> 
> The burst flag is basically the same value as in "etop" code path. The
> warning about 8 word burst size is again from tplink source blob (btw I
> think the DMA_2W_BURST flag in 4.14.9x is actually 4 word burst, but I
> didn't confirmed it yet).

I will have a look at this later.

>> I am also interested in benchmarks with only one of the patches to know
>> which patch gives us which improvement. The IRQ controller patch needs
>> some improvements to get into mainline Linux kernel and I would look
>> into it if it creates some improvement.
> 
> Thats gonna be a bit of a problem. My TD-W9980 has sadly a wave300 5G
> wifi driver, so I cannot test on it as it is broken and crashing the
> system (I've managed only make a few scans). For 2.4G wifi, I have only
> 150Mbps usb dongles, which are slow even without local interferences. My
> VDSL has only 22:2 which is OK even with vendor's firmware.
> 
> My only option for a benchmarking is the ethernet which is (with the
> vanilla openwrt driver) extremely slow. My backport increased the TX
> speed of the modem from about 4.5 MiByte/s to about 7.5 MiByte/s (TCP
> netcat pipe, ACKs on RX FIFO). Gonna try iperf tomorrow. The driver
> works even with NFS rootfs over it. Sometimes a kernel warning about
> timeout is printed, but the system works afterwards and this is only a
> RFC stage. Probably some spinlock is missing or irq gets acked at the
> wrong place. It _will_ be fixed.
> 
> What is interesting is my observation of long frames (4000-6000) which
> are sometimes coming from lantiq (observed in wireshark). My server is
> sending only classic ~1500 frames and I know the lantiq driver is
> limited to them too (+ tested in ip link set eth0 mtu 3000 -> error).

Can you please send me a capture of such a packet. Do you know how to
reproduce this? Is DSL also active when you see this? The datapath of
the DSL goes through the PPE which also handles Ethernet.

I am mostly interested in the MAC addresses and if there are any special
headers.

>> Are the IRQs on the 2. VPE used automatically or do you use it with irq
>> balanced?
>> Could you please provide the output of "cat /proc/interrupts"
>>
> The interupts are used automatically, but the distribution is quite
> random. I don't have irqbalance package compiled.
> 
> # cat /proc/interrupts
>            CPU0       CPU1
>   7:      31309      31096      MIPS   7  timer
>   8:        586        607      MIPS   0  IPI call
>   9:       5991      10371      MIPS   1  IPI resched
>  22:      14762          1       icu  22  spi_rx
>  23:       2496          1       icu  23  spi_tx
>  24:          0          0       icu  24  spi_err
>  62:          0          0       icu  62  1e101000.usb, dwc2_hsotg:usb1
>  63:          0        192       icu  63  mei_cpe
>  72:      11133          0       icu  72  vrx200_rx
>  73:          0      13833       icu  73  vrx200_tx
>  91:          0         81       icu  91  1e106000.usb, dwc2_hsotg:usb2
> 112:        745          0       icu 112  asc_tx
> 113:          0        222       icu 113  asc_rx
> 114:          0          0       icu 114  asc_err
> 126:          0          0       icu 126  gptu
> 127:          0          0       icu 127  gptu
> 128:          0          0       icu 128  gptu
> 129:          0          0       icu 129  gptu
> 130:          0          0       icu 130  gptu
> 131:          0          0       icu 131  gptu
> 161:          0          0       icu 161  ifx_pcie_rc0
> ERR:          1
> 
> (using napi polling decreases interrupt generation, so 11133 and 13833
> values are not real number of packets transmitted, the vanilla driver
> has more then twice as much as backported driver)
> 
> The affinity can be set in /proc/irq/$NUM, this can be used for testing
> the improvements cause by patch (the burst width can be written on the
> fly too).
> 
>> We should probably make use for scattered DMA in
>> the driver too. 
> 
> I would like to try, but I don't have any vrx200 SoC TRM datasheets and
> even with different kernel versions (from vendors) the picture is not
> complete.

scattered DMA is the same as support for the skb frag.

Hauke

Patch
diff mbox series

--- ./a/arch/mips/lantiq/xway/dma.c	2019-01-26 09:37:07.000000000 +0100
+++ ./b/arch/mips/lantiq/xway/dma.c	2019-01-30 05:04:42.750889682 +0100
@@ -194,6 +194,11 @@ 
 	ltq_dma_w32(p, LTQ_DMA_PS);
 	switch (p) {
 	case DMA_PORT_ETOP:
+
+		//TODO test without when ethernet driver is stable
+		ltq_dma_w32_mask(0x3c, (DMA_2W_BURST << 4) | (DMA_2W_BURST << 2),
+			LTQ_DMA_PCTRL);
+
 		/*
 		 * Tell the DMA engine to swap the endianness of data frames and
 		 * drop packets if the channel arbitration fails.