@probain said in Epyc VM to VM networking slow:
I restore the iptables again afterwards? Other than reboot
this worked for me
action | command |
---|---|
save | iptables-save > firewall.conf |
flush | iptables -F |
restore | cat firewall.conf | iptables-restore |
@probain said in Epyc VM to VM networking slow:
I restore the iptables again afterwards? Other than reboot
this worked for me
action | command |
---|---|
save | iptables-save > firewall.conf |
flush | iptables -F |
restore | cat firewall.conf | iptables-restore |
Just for completeness. I have the same issue with older AMD 6380 Opterons. The same hardware had full speed on esxi hypervisor. Also have full speed using harvester / rancher. I'm using xcp-ng for more than two years and have that issue since day one.
-----------------------------------------------------------
Server listening on 5201 (test #1 - dom0 to workstation)
-----------------------------------------------------------
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 5201 (test #2 - vm to workstation)
-----------------------------------------------------------
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 3.18 GBytes 2.73 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 5201 (test #3 dom0 to vm)
-----------------------------------------------------------
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 2.23 GBytes 1.91 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 5201 (test #4 vom to vm)
-----------------------------------------------------------
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 1.97 GBytes 1.69 Gbits/sec receiver
-----------------------------------------------------------
@probain said in Epyc VM to VM networking slow:
I restore the iptables again afterwards? Other than reboot
this worked for me
action | command |
---|---|
save | iptables-save > firewall.conf |
flush | iptables -F |
restore | cat firewall.conf | iptables-restore |
Here are the opterons with dropped firewall:
source | destination | OS | Kernel | Speed Average |
---|---|---|---|---|
vm | dom | debian 10 | 4.19.0-6-amd64 | 6.57 Gbits/sec |
dom | vm | debian 10 | 4.19.0-6-amd64 | 1.79 Gbits/sec |
vm | dom | truenas | 6.6.20 | 2.01 Gbits/sec |
dom | vm | truenas | 6.6.20 | 1.82 Gbits/sec |
host | vm | debian 10 | 4.19.0-6-amd64 | 5.32 Gbits/sec |
host | vm | truenas | 6.6.20 | 1.92 Gbits/sec |
host | dom | debian | 4.19.0+1 | 8.97 Gbits/sec |
May someone could graph their vm.
Comparing a slow vm with a full speed could bring light into darknes.
https://www.brendangregg.com/Articles/Linux_Kernel_Performance_Flame_Graphs.pdf
Just for completeness. I have the same issue with older AMD 6380 Opterons. The same hardware had full speed on esxi hypervisor. Also have full speed using harvester / rancher. I'm using xcp-ng for more than two years and have that issue since day one.
-----------------------------------------------------------
Server listening on 5201 (test #1 - dom0 to workstation)
-----------------------------------------------------------
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 5201 (test #2 - vm to workstation)
-----------------------------------------------------------
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 3.18 GBytes 2.73 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 5201 (test #3 dom0 to vm)
-----------------------------------------------------------
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 2.23 GBytes 1.91 Gbits/sec receiver
-----------------------------------------------------------
Server listening on 5201 (test #4 vom to vm)
-----------------------------------------------------------
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 1.97 GBytes 1.69 Gbits/sec receiver
-----------------------------------------------------------