XCP-ng

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups

    Backup speed

    Xen Orchestra
    3
    7
    478
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • rizaemet 0
      rizaemet 0 last edited by

      Hello and sorry for my bad English,
      Just a feedback and thanks.
      My new backup speed record: 430-450 MB per second! A CR job with 6 concurrency.
      Thank you very much to both Xcp-Ng and Xen Orchestra team.

      6410871b-38d9-46b4-b9d9-eae64d8f6b18-resim.png
      NICs: Everyting 10Gbps
      Source: Netapp AFF A300 (full ssd)
      Destination: Synology RS3614xs+ (without ssd disks. raid6)
      Host: Intel Xeon E5-2690 v2 @ 3.00GHz (2 socket)

      http traffic instead of https with this suggestion.

      1 Reply Last reply Reply Quote 1
      • olivierlambert
        olivierlambert Vates 🪐 Co-Founder🦸 CEO 🧑‍💼 last edited by

        Nice, how big is the boost between HTTP and HTTPS?

        rizaemet 0 1 Reply Last reply Reply Quote 0
        • rizaemet 0
          rizaemet 0 @olivierlambert last edited by

          @olivierlambert with https, only single cpu core running 100% of XO vm. But with http all cpu core of XO vm running simultaneously.
          So I give 8x3.0 GHz cpu to XO. It is never use more than 5 GB of RAM.
          Also concurrent backup setting and XO on master host are improve the speed.

          1 Reply Last reply Reply Quote 0
          • olivierlambert
            olivierlambert Vates 🪐 Co-Founder🦸 CEO 🧑‍💼 last edited by

            Pinging @julien-f about your great feedback 🙂

            1 Reply Last reply Reply Quote 0
            • julien-f
              julien-f Vates 🪐 Co-Founder🦸 XO Team 🔭 last edited by

              @rizaemet-0 Thank you, this is really interesting, it suggest that HTTP encryption in XO is a CPU bottleneck.

              It should be alleviated in the future, because in a couple of month, all backup jobs should run in separate process, which will better distribute load on multiple CPUs.

              1 Reply Last reply Reply Quote 2
              • rizaemet 0
                rizaemet 0 last edited by

                Hello.

                I want to share a new backup speed record after a long time. Top speed 727.9 MBps. Avarage 680-700 MBps. 1 CR Job with 5 concurrency.
                Speed is not constant because there are many virtual machines whose vdi-export time is shorter than snapshot time.

                XCP-ng 8.2, XO from source, xo-server 5.80.0, xo-web 5.84.0

                3e3bcb9d-e93f-4f1c-a838-3e36f84f668d-resim.png

                1 Reply Last reply Reply Quote 0
                • olivierlambert
                  olivierlambert Vates 🪐 Co-Founder🦸 CEO 🧑‍💼 last edited by

                  That's probably since using more your cores (now there's a dedicated thread backup job).

                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post