XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Show me your backup performance

    Scheduled Pinned Locked Moved Xen Orchestra
    11 Posts 2 Posters 446 Views 2 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Online
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by olivierlambert

      Hi,

      Please be more precise on what you are testing. Basic backup will use XVA format, which is done on the host side, while "Delta" backup will export VHD directly.

      XVA format will not support NBD export. Also, "multiple data blocks" is only for delta (VHD export), not XVA.

      Since they are vastly different mechanism, you should bench them differently 🙂

      K 1 Reply Last reply Reply Quote 0
      • K Offline
        KPS Top contributor @olivierlambert
        last edited by

        @olivierlambert
        As written above: These "benchmarks" are all about full-backups (XVA). I will repeat the benchmarks, as the performance did increase after changing to "store backups as multiple data blocks". Perhaps a caching thing...

        1 Reply Last reply Reply Quote 0
        • olivierlambertO Online
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by

          So in full backup, no "multiple data blocks" nor NBD possible, it's just a full XVA.

          But if you have more perf, it's interesting to bench more than twice to get an average 🙂

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Online
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            Oh and also, if you want to check potential bottlenecks, you must also try to connect in plain HTTP to your server in XO.

            K 1 Reply Last reply Reply Quote 0
            • K Offline
              KPS Top contributor @olivierlambert
              last edited by

              @olivierlambert said in Show me your backup performance:

              Oh and also, if you want to check potential bottlenecks, you must also try to connect in plain HTTP to your server in XO.

              This is already the case for all tests above. http instead of https for connection XO->XCP-ng

              1 Reply Last reply Reply Quote 0
              • olivierlambertO Online
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by

                Okay so you mostly tested everything for XVA, time to test the delta backup type 🙂 Adding also the HTTPS bench will be important so we can more clearly see the bottleneck depending on the CPU

                K 1 Reply Last reply Reply Quote 0
                • K Offline
                  KPS Top contributor @olivierlambert
                  last edited by

                  @olivierlambert
                  First Test: Changed http->https
                  Some additional CPU-load (Dom0: +1C 50% (stunnel), XO: + 1C at 50% (node))

                  Speed did degradade only minimal:

                  • Zstd Compression: 96 MB/s -> 92 MB/s; 10 min -> 11 min
                  • No Compression: 199 MB/s -> 113 MB/s 9 min -> 15 min

                  No real "statistics" - only single runs.

                  1 Reply Last reply Reply Quote 0
                  • olivierlambertO Online
                    olivierlambert Vates 🪐 Co-Founder CEO
                    last edited by

                    @KPS said in Show me your backup performance:

                    Intel Gold 6154 @3GHz

                    That's your CPU, right? Turbo at 3.7Ghz might explain the little diff in HTTP vs HTTPS

                    K 1 Reply Last reply Reply Quote 0
                    • K Offline
                      KPS Top contributor @olivierlambert
                      last edited by KPS

                      @olivierlambert said in Show me your backup performance:

                      That's your CPU, right? Turbo at 3.7Ghz might explain the little diff in HTTP vs HTTPS

                      Yes, this is it. Not the newest one (test-system for tests for a new prod environment in Q1).

                      You are talking about better benchmarking Delta, but I do not have any good idea on how to do repeatable delta-tests...

                      1 Reply Last reply Reply Quote 0
                      • olivierlambertO Online
                        olivierlambert Vates 🪐 Co-Founder CEO
                        last edited by

                        If you do a full every time, it's fine 🙂 (use no retention or full every time)

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post