XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Backup speed

    Scheduled Pinned Locked Moved Xen Orchestra
    7 Posts 3 Posters 1.8k Views 1 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • rizaemet 0R Offline
      rizaemet 0
      last edited by

      Hello and sorry for my bad English,
      Just a feedback and thanks.
      My new backup speed record: 430-450 MB per second! A CR job with 6 concurrency.
      Thank you very much to both Xcp-Ng and Xen Orchestra team.

      6410871b-38d9-46b4-b9d9-eae64d8f6b18-resim.png
      NICs: Everyting 10Gbps
      Source: Netapp AFF A300 (full ssd)
      Destination: Synology RS3614xs+ (without ssd disks. raid6)
      Host: Intel Xeon E5-2690 v2 @ 3.00GHz (2 socket)

      http traffic instead of https with this suggestion.

      1 Reply Last reply Reply Quote 1
      • olivierlambertO Offline
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        Nice, how big is the boost between HTTP and HTTPS?

        rizaemet 0R 1 Reply Last reply Reply Quote 0
        • rizaemet 0R Offline
          rizaemet 0 @olivierlambert
          last edited by

          @olivierlambert with https, only single cpu core running 100% of XO vm. But with http all cpu core of XO vm running simultaneously.
          So I give 8x3.0 GHz cpu to XO. It is never use more than 5 GB of RAM.
          Also concurrent backup setting and XO on master host are improve the speed.

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            Pinging @julien-f about your great feedback 🙂

            1 Reply Last reply Reply Quote 0
            • julien-fJ Offline
              julien-f Vates 🪐 Co-Founder XO Team
              last edited by

              @rizaemet-0 Thank you, this is really interesting, it suggest that HTTP encryption in XO is a CPU bottleneck.

              It should be alleviated in the future, because in a couple of month, all backup jobs should run in separate process, which will better distribute load on multiple CPUs.

              1 Reply Last reply Reply Quote 2
              • rizaemet 0R Offline
                rizaemet 0
                last edited by

                Hello.

                I want to share a new backup speed record after a long time. Top speed 727.9 MBps. Avarage 680-700 MBps. 1 CR Job with 5 concurrency.
                Speed is not constant because there are many virtual machines whose vdi-export time is shorter than snapshot time.

                XCP-ng 8.2, XO from source, xo-server 5.80.0, xo-web 5.84.0

                3e3bcb9d-e93f-4f1c-a838-3e36f84f668d-resim.png

                1 Reply Last reply Reply Quote 0
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  That's probably since using more your cores (now there's a dedicated thread backup job).

                  1 Reply Last reply Reply Quote 0

                  Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                  Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                  With your input, this post could be even better 💗

                  Register Login
                  • First post
                    Last post