XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    How fast are your backups

    Scheduled Pinned Locked Moved Backup
    16 Posts 6 Posters 3.2k Views 6 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Offline
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      XO tasks are currently here to solve this. It's still early and not entirely displayed, but this will come soon 🙂

      Also, 250-280MiB/s is already a great speed. What's your concurrency? Are you using NBD insecure or secure?

      We might also have something else for you to test at some point, using a "plugin" inside the host.

      1 Reply Last reply Reply Quote 1
      • K Offline
        KPS Top contributor @olivierlambert
        last edited by

        @olivierlambert
        "Concurrency" is my next step. I first wanted to find a good setup for "singe-stream-performance", but I am always happy to test new approaches!
        Plugin sounds good. Other backup-providers are taking that way, too.

        250MiB/s is good for small VMs, but not for big ones. My "non-XCP-setup" can do backups at 8-9 GiB/s

        1 Reply Last reply Reply Quote 0
        • olivierlambertO Offline
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by

          This might be dangerous for your SR in real life scenario: what if a backup is taking all the SR resources? We have to find a balance 🙂 But anyway, you can always restrict the backup speed in XO, so we'll continue to find ways to speed things up!

          1 Reply Last reply Reply Quote 1
          • planedropP Offline
            planedrop Top contributor
            last edited by

            I'm using SMB not NFS but the max I see is around 100MiB/s, so this is REALLY good speeds (I'm also on 10GbE across the board and on a NAS that can easily take in 2000MiB/s), very impressive speeds here.

            Do you have any concurrency configured though? I believe the default is 2 so that may be why you're seeing close to 2x what I am (I have it set to 1, don't really need more than that so I like to decrease overall load).

            Also on pretty beefy hosts.

            R 1 Reply Last reply Reply Quote 0
            • R Offline
              rjt @planedrop
              last edited by

              @planedrop what concurrency configuration settings are you referring to?

              • XOA config?

              • host network card config?

              • SMB concurrency?

              planedropP 1 Reply Last reply Reply Quote 0
              • R Offline
                rjt @olivierlambert
                last edited by

                @olivierlambert Amazon must have patched their Xen / XAPI to have much higher speeds?

                olivierlambertO 1 Reply Last reply Reply Quote 0
                • planedropP Offline
                  planedrop Top contributor @rjt
                  last edited by

                  @rjt The setting for backup concurrency within the XOA backup settings.

                  1 Reply Last reply Reply Quote 1
                  • olivierlambertO Offline
                    olivierlambert Vates 🪐 Co-Founder CEO @rjt
                    last edited by

                    @rjt AWS isn't using XAPI. Only XenServer and XCP-ng are using XAPI. It's mostly unrelated to Xen performance (at least not at this point).

                    1 Reply Last reply Reply Quote 1
                    • olivierlambertO olivierlambert moved this topic from Xen Orchestra on
                    • D Offline
                      danoontje
                      last edited by

                      I'm backing up delta's from 5 pools to a lustre filesystem with a concurrency of 10.
                      040a4e1f-3f00-4b93-b7c9-9f0ac5191429-image.png

                      1 Reply Last reply Reply Quote 0
                      • olivierlambertO Offline
                        olivierlambert Vates 🪐 Co-Founder CEO
                        last edited by olivierlambert

                        Not bad 🙂 More than 2Gbit/s!

                        1 Reply Last reply Reply Quote 0
                        • florentF Offline
                          florent Vates 🪐 XO Team @KPS
                          last edited by florent

                          @KPS Hi,
                          that is some nice performance, I guess the hardware under is beefy++

                          Did you try if NBD increase the speed ?
                          You need to enable NBD on the backup network, and then enable it in the delta backup :
                          f556d425-d66f-41b5-bf8b-c6c769fdbcb5-image.png

                          We have a few tasks in the pipeline to increase performance, leveraging our knowledge of both XCP and XO

                          Florent

                          1 Reply Last reply Reply Quote 1

                          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                          With your input, this post could be even better 💗

                          Register Login
                          • First post
                            Last post