Backup speed
-
Hello and sorry for my bad English,
Just a feedback and thanks.
My new backup speed record: 430-450 MB per second! A CR job with 6 concurrency.
Thank you very much to both Xcp-Ng and Xen Orchestra team.
NICs: Everyting 10Gbps
Source: Netapp AFF A300 (full ssd)
Destination: Synology RS3614xs+ (without ssd disks. raid6)
Host: Intel Xeon E5-2690 v2 @ 3.00GHz (2 socket)http traffic instead of https with this suggestion.
-
Nice, how big is the boost between HTTP and HTTPS?
-
@olivierlambert with https, only single cpu core running 100% of XO vm. But with http all cpu core of XO vm running simultaneously.
So I give 8x3.0 GHz cpu to XO. It is never use more than 5 GB of RAM.
Also concurrent backup setting and XO on master host are improve the speed. -
Pinging @julien-f about your great feedback
-
@rizaemet-0 Thank you, this is really interesting, it suggest that HTTP encryption in XO is a CPU bottleneck.
It should be alleviated in the future, because in a couple of month, all backup jobs should run in separate process, which will better distribute load on multiple CPUs.
-
Hello.
I want to share a new backup speed record after a long time. Top speed 727.9 MBps. Avarage 680-700 MBps. 1 CR Job with 5 concurrency.
Speed is not constant because there are many virtual machines whose vdi-export time is shorter than snapshot time.XCP-ng 8.2, XO from source, xo-server 5.80.0, xo-web 5.84.0
-
That's probably since using more your cores (now there's a dedicated thread backup job).