Remove backup bottleneck: please report
-
That's slow indeed
It's not trivial. A lot of things could cause that. However, you can test by:
- changing backup concurrency to find a sweet spot (one VM, then 2 VM etc.)
- give more memory to the dom0
- give more memory to the XO VM
- having an SSD on the backup storage
- having an SSD on the storage repository
-
I will for sure attempt and see how fast it is to backup only one VM at a time... actually I guess I don't know the answer to this but when XO does a delta backup to an NFS remote does it attempt to transfer all VM snapshots at the same time or does it do it sequentially one after the other?
-
-
Thank you so much for this info, I can't believe I didn't see this in all of my research. With the information from that document I take it back. I am getting full bandwidth since 12 machines get backed up at a time. The individual VM transfer speed in the backup reports was a bit misleading to me since I didn't realize that 12 are uploaded to storage at a time.
My initial finding still stands though, going http completely removed the one bottleneck that we had in our backup infrastructure and made it 3.5 times faster then before.
-
To get the complete speed, just take a look at XOA network stats while the backup is happening in⦠Xen Orchestra
-
Hi,
I'm very interested in trying this out.
Except I can't find how I should change the master URL?In XO when I click on the disconnect button in the pool view I receive an error.
-
@CIT same here. I was able to switch to http at settings -> server. Remove the server and add with
http://ip
Current Backup Speed without change on XCP-ng 8.2:
Duration: 28 minutes Size: 43.85 GiB Speed: 26.86 MiB/s
Speed should be limited to WD Red or my Gigabit Bandwidth to my NFS. The meassured speed is far below. x3 is expected (~80-100 MiB/s)
-
@ChuckNorrison Ah, thnx for updating... I edited my servers, hope to see some speed improvements!
-
-
-
Got about twice speed increase on single thread: 60-80 > 110-120MB with 10Gbit link.
But is this method recomended? I mean authorise now also work with http?
-
The thread is a bit old, since then we got NBD that could speed up things a lot.
-
yes i understand, just a interesting solution.