XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Backup speed

    Scheduled Pinned Locked Moved Xen Orchestra
    7 Posts 3 Posters 1.0k Views 1 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • rizaemet 0R Offline
      rizaemet 0
      last edited by

      Hello and sorry for my bad English,
      Just a feedback and thanks.
      My new backup speed record: 430-450 MB per second! A CR job with 6 concurrency.
      Thank you very much to both Xcp-Ng and Xen Orchestra team.

      6410871b-38d9-46b4-b9d9-eae64d8f6b18-resim.png
      NICs: Everyting 10Gbps
      Source: Netapp AFF A300 (full ssd)
      Destination: Synology RS3614xs+ (without ssd disks. raid6)
      Host: Intel Xeon E5-2690 v2 @ 3.00GHz (2 socket)

      http traffic instead of https with this suggestion.

      1 Reply Last reply Reply Quote 1
      • olivierlambertO Offline
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        Nice, how big is the boost between HTTP and HTTPS?

        rizaemet 0R 1 Reply Last reply Reply Quote 0
        • rizaemet 0R Offline
          rizaemet 0 @olivierlambert
          last edited by

          olivierlambert with https, only single cpu core running 100% of XO vm. But with http all cpu core of XO vm running simultaneously.
          So I give 8x3.0 GHz cpu to XO. It is never use more than 5 GB of RAM.
          Also concurrent backup setting and XO on master host are improve the speed.

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            Pinging julien-f about your great feedback 🙂

            1 Reply Last reply Reply Quote 0
            • julien-fJ Offline
              julien-f Vates 🪐 Co-Founder XO Team
              last edited by

              rizaemet 0 Thank you, this is really interesting, it suggest that HTTP encryption in XO is a CPU bottleneck.

              It should be alleviated in the future, because in a couple of month, all backup jobs should run in separate process, which will better distribute load on multiple CPUs.

              1 Reply Last reply Reply Quote 2
              • rizaemet 0R Offline
                rizaemet 0
                last edited by

                Hello.

                I want to share a new backup speed record after a long time. Top speed 727.9 MBps. Avarage 680-700 MBps. 1 CR Job with 5 concurrency.
                Speed is not constant because there are many virtual machines whose vdi-export time is shorter than snapshot time.

                XCP-ng 8.2, XO from source, xo-server 5.80.0, xo-web 5.84.0

                3e3bcb9d-e93f-4f1c-a838-3e36f84f668d-resim.png

                1 Reply Last reply Reply Quote 0
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  That's probably since using more your cores (now there's a dedicated thread backup job).

                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post