<![CDATA[10gb backup only managing about 80Mb]]>I have a dedicated 10gb link directly connected between hosts for backup and replication.. i noticed the speeds were pretty slow.. the hosts are using local SSD but i would have thought i would get higher speeds on this.. they are using isolated ip adds so they only talk to each other... Am i missing something or can tweak anything to get higher speeds or is it the SSD causing the problem

MAny Thanks

]]>https://xcp-ng.org/forum/topic/11240/10gb-backup-only-managing-about-80mbRSS for NodeWed, 13 May 2026 09:25:17 GMTWed, 03 Sep 2025 10:00:45 GMT60<![CDATA[Reply to 10gb backup only managing about 80Mb on Tue, 23 Sep 2025 17:41:03 GMT]]>Impossible to tell yet, more in few months.

]]>https://xcp-ng.org/forum/post/97644https://xcp-ng.org/forum/post/97644Tue, 23 Sep 2025 17:41:03 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Tue, 23 Sep 2025 17:39:47 GMT]]>indeed.

What should we expect with smapiV3/QCOW2 ?

I won't take it for granted but, shall we get out the current ballpark ?

]]>https://xcp-ng.org/forum/post/97643https://xcp-ng.org/forum/post/97643Tue, 23 Sep 2025 17:39:47 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Tue, 23 Sep 2025 17:33:41 GMT]]>Because you are comparing apples and carrots. Live migrating a VM is moving RAM between hosts, not moving any data blocks stored on a storage repository (SR) or backup repo (BR). There are MANY more layers involved with blocks. Try to live migrate a VM with its storage in live, you'll see you'll be ballpark VM backup speed.

]]>https://xcp-ng.org/forum/post/97642https://xcp-ng.org/forum/post/97642Tue, 23 Sep 2025 17:33:41 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Tue, 23 Sep 2025 15:37:30 GMT]]>the 10Gb card can really be used at its full potential in XCP
c437144a-80a9-4d34-a0ab-b7e182bfff55-{1E695E07-AB95-41EC-B9F0-B60D6C9F10B1}.png

This is a graph when live migrating 4 VMs from one host to another... using the same VLAN on same BOND as backups transfers.

why can't we have these speeds in backups ? 😞

]]>https://xcp-ng.org/forum/post/97639https://xcp-ng.org/forum/post/97639Tue, 23 Sep 2025 15:37:30 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Tue, 23 Sep 2025 14:23:03 GMT]]>results from upgrading from 3 concurrency (yesterday) to 6 concurrency today
backup of 9 VMs, proceeded by XOA (was a delta not a full)
XOA is 4 vCPU, 8Gb RAM (tuned in systemd service to let 7Gb to xo-server, 1Gb to debian)
remote is a same LAN (10Gb/s) S3 remote, with 25Gb/s iSCSI storage

0674ec72-2513-4fb8-8b19-3c9f4bebe962-{5617553C-9A6A-47B8-8096-0E2D845D1470}.png

on XOA, I can see a peak of RX of 195.45MiB/s on VIF0, transmitting to S3 remote on VIF2 at lesser bandwith
e7080b70-bc64-45d1-bbe0-869c6dee8db6-image.png

simultaneously, on the S3 remote, I can see incoming traffic of maximum 114.34MiB/s on VIF3 (LAN), transmitting same speed on iSCSI (2 active paths, 2 lines of TX are the same bandwith consumption, half/half need to add them)
d77bc023-55e1-48c9-b4ff-05c5704ae522-image.png

per VM speed in the job report is between Speed: 37.34 MiB/s and Speed: 143.09 MiB/s

]]>https://xcp-ng.org/forum/post/97636https://xcp-ng.org/forum/post/97636Tue, 23 Sep 2025 14:23:03 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Tue, 23 Sep 2025 13:26:05 GMT]]>okay i'll up the concurrency, backup is happening in 35 minutes, i'll report back

]]>https://xcp-ng.org/forum/post/97628https://xcp-ng.org/forum/post/97628Tue, 23 Sep 2025 13:26:05 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Mon, 22 Sep 2025 22:22:53 GMT]]>@Pilow I think what you are seeing is the result of tapdisk single threaded nature (among other things master Dom0 related). I would suggest changing concurrency to 4 or 8 and see if the speed AT THE PORT is higher during backups. You may still only see <80MiB/s PER vm getting backed up, maybe less, but you may end with 4 or 8 backing up at 40 to 60MiB/s == high total bandwidth.

also note.. you 61.63MiB (note capital B for Mebibyte/s) is == 517.267 mb/s network speed megabite/second

]]>https://xcp-ng.org/forum/post/97610https://xcp-ng.org/forum/post/97610Mon, 22 Sep 2025 22:22:53 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Mon, 22 Sep 2025 18:37:23 GMT]]>@tjkreidl I have same results as you : ~80MB/s for backups over a 2x10Gb network bond.

Only way i managed to get overt his 'limit' is by using XOproxies, on another VLAN on this SAME bond
Don't ask me why, but bandwith tests (when you click TEST on a remote) tripled comparing to the remote on same VLAN as the XOA.

Isolating is a better best practive for backup networks, but also has the benefit of getting more bandwith ? strange.

My backups can now reach 100/110 MB/s (yeah tripled only in the test...)

]]>https://xcp-ng.org/forum/post/97602https://xcp-ng.org/forum/post/97602Mon, 22 Sep 2025 18:37:23 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Fri, 19 Sep 2025 22:10:07 GMT]]>@nikade Did the same. VLANs are great! We did use separate NICs for iSCSI storage. But the PMI and VMs, traffic was handled easily by the dual 10 GiB NICs, even with several hundred XenDesktop VMs hosted among three servers (typically around 8- VMs per server).

]]>https://xcp-ng.org/forum/post/97570https://xcp-ng.org/forum/post/97570Fri, 19 Sep 2025 22:10:07 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Thu, 18 Sep 2025 17:50:14 GMT]]>@utopianfish Or look for deals in places like amazon.com or bestbuy.com or even Ebay.com.

]]>https://xcp-ng.org/forum/post/97520https://xcp-ng.org/forum/post/97520Thu, 18 Sep 2025 17:50:14 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Wed, 17 Sep 2025 07:40:57 GMT]]>@utopianfish

Mikrotik CRS304-4XG-IN or CRS312-4C+8XG-RM

https://mikrotik.com/products/group/switches

]]>https://xcp-ng.org/forum/post/97457https://xcp-ng.org/forum/post/97457Wed, 17 Sep 2025 07:40:57 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Wed, 17 Sep 2025 06:43:05 GMT]]>@nikade ok thanks.. that’s begs the question.. where can I get a cheap 10gb switch.. not sfp. Would need to be rj45 connections

]]>https://xcp-ng.org/forum/post/97455https://xcp-ng.org/forum/post/97455Wed, 17 Sep 2025 06:43:05 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Tue, 16 Sep 2025 20:17:24 GMT]]>@tjkreidl I think the issue is that he's got no 10G switch, hence the direct connection πŸ™‚
But you live and you learn, best would be to pick up a cheap 10G switch and make it right!

]]>https://xcp-ng.org/forum/post/97448https://xcp-ng.org/forum/post/97448Tue, 16 Sep 2025 20:17:24 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Sun, 14 Sep 2025 20:12:44 GMT]]>@nikade Yeah, that is a far from optimal setup. It will force the data to flow through the management interface before being routed to the storage NICs.
Running iostat and xtop should show the load. A better configuration IMO would be putting the storage NICs on the switch and using a separate network or VLAN for the storage I/O traffic.
Storage I/O optimization takes some time and effort. The type, number, and RAID configuration of your storage device as well as speed of your host CPUs, eize and type of memory, and configuration of your VMs (if NUMA aware, for example) all will play a role.

]]>https://xcp-ng.org/forum/post/97353https://xcp-ng.org/forum/post/97353Sun, 14 Sep 2025 20:12:44 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Sun, 14 Sep 2025 18:19:17 GMT]]>@utopianfish I see, that explains a lot.

]]>https://xcp-ng.org/forum/post/97350https://xcp-ng.org/forum/post/97350Sun, 14 Sep 2025 18:19:17 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Sun, 14 Sep 2025 10:12:48 GMT]]>@nikade My 10gb nic are directly connected to my hosts.. i dont have a 10gb switch.. the mgmt is connected via switch ports...

]]>https://xcp-ng.org/forum/post/97333https://xcp-ng.org/forum/post/97333Sun, 14 Sep 2025 10:12:48 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Sun, 14 Sep 2025 09:45:09 GMT]]>@acebmxer said in 10gb backup only managing about 80Mb:

I could be wrong but from VMware world the management interface didnt transfer much data if at all. It was only used to communicate to vsphere and/or to the to the host. So no need to waste a 10gb port on something only only see kb worth of data.

Our previous server had 2x 1gb nics for management 1x 10gb nic for network 2x 10tgb nic for storage 1x 10gb nic for vmotion.

Tbh I do the same on our vmware hosts, 2x10G or 2x25G and then the management as a vlan interface on that vSwitch, aswell as the VLAN's used for storage, VM traffic and so on.

I find it much easier to keep the racks clean if we only have 2 connections from each hosts, rather than 4, since it kind of adds up really fast and makes the rack impossible to keep nice and clean when you have 15-20 machines in it + storage + switches + firewalls and all the inter-connections with other racks, ip-transit and so on.

Edit:
Except for vSAN hosts where the vSAN traffic needs atleast 1 dedicated interface, but those are the only exception.

]]>https://xcp-ng.org/forum/post/97331https://xcp-ng.org/forum/post/97331Sun, 14 Sep 2025 09:45:09 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Sun, 14 Sep 2025 03:11:05 GMT]]>I could be wrong but from VMware world the management interface didnt transfer much data if at all. It was only used to communicate to vsphere and/or to the to the host. So no need to waste a 10gb port on something only only see kb worth of data.

Our previous server had 2x 1gb nics for management 1x 10gb nic for network 2x 10tgb nic for storage 1x 10gb nic for vmotion.

]]>https://xcp-ng.org/forum/post/97330https://xcp-ng.org/forum/post/97330Sun, 14 Sep 2025 03:11:05 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Sat, 13 Sep 2025 23:39:46 GMT]]>That's also what we do in our prod.

]]>https://xcp-ng.org/forum/post/97327https://xcp-ng.org/forum/post/97327Sat, 13 Sep 2025 23:39:46 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Sat, 13 Sep 2025 21:32:38 GMT]]>@utopianfish said in 10gb backup only managing about 80Mb:

@nikade i think the problem is its using the mgmt interface to do the backup..its not touching the 10GB nics.. when i set it under Pools/Adanced/Backup to use the 10gb nic as default the job fails... setting it back to none the job is successful with a speed of 80 MiB/s.. so using the 1GB mgmt nic... how do i get the backups to use the dedicated 10gb link then. ?

May I ask why your management interface is not on the 10G nic? There is absolutely no downside to having that kind of setup.

We used this setup for 7 years on our Dell R630's without any issues at all. We had 2x10G NIC in our hosts and then put the management interface on top of the bond0 as a native vlan.
Then we just added our VLAN's on top on the bond0 and voila, all your interfaces benefits from the 10G nic's.

]]>https://xcp-ng.org/forum/post/97325https://xcp-ng.org/forum/post/97325Sat, 13 Sep 2025 21:32:38 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Thu, 04 Sep 2025 17:30:02 GMT]]>Use XO to connect on the host with the 10G network IPs addresses.

]]>https://xcp-ng.org/forum/post/97067https://xcp-ng.org/forum/post/97067Thu, 04 Sep 2025 17:30:02 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Thu, 04 Sep 2025 10:56:33 GMT]]>@nikade i think the problem is its using the mgmt interface to do the backup..its not touching the 10GB nics.. when i set it under Pools/Adanced/Backup to use the 10gb nic as default the job fails... setting it back to none the job is successful with a speed of 80 MiB/s.. so using the 1GB mgmt nic... how do i get the backups to use the dedicated 10gb link then. ?

]]>https://xcp-ng.org/forum/post/97051https://xcp-ng.org/forum/post/97051Thu, 04 Sep 2025 10:56:33 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Wed, 03 Sep 2025 19:14:24 GMT]]>@olivierlambert said in 10gb backup only managing about 80Mb:

I would have ask the same question πŸ˜„

Great minds and all that, you know πŸ˜‰

@utopianfish check if you have any kind of power options regarding "power saving" or "performance" modes you can change in the BIOS. That could make a big difference as well.

]]>https://xcp-ng.org/forum/post/97042https://xcp-ng.org/forum/post/97042Wed, 03 Sep 2025 19:14:24 GMT<![CDATA[Reply to 10gb backup only managing about 80Mb on Wed, 03 Sep 2025 15:22:41 GMT]]>IDK if the BIOS provides many power options, but you could make sure you are turbo boosting when needed. Because it's likely your CPU is both old but also not getting at 3Ghz at all.

]]>https://xcp-ng.org/forum/post/97037https://xcp-ng.org/forum/post/97037Wed, 03 Sep 2025 15:22:41 GMT