XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    How fast are your backups

    Scheduled Pinned Locked Moved Backup
    16 Posts 6 Posters 1.2k Views 6 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • K Offline
      KPS Top contributor @olivierlambert
      last edited by

      @olivierlambert
      "Concurrency" is my next step. I first wanted to find a good setup for "singe-stream-performance", but I am always happy to test new approaches!
      Plugin sounds good. Other backup-providers are taking that way, too.

      250MiB/s is good for small VMs, but not for big ones. My "non-XCP-setup" can do backups at 8-9 GiB/s

      1 Reply Last reply Reply Quote 0
      • olivierlambertO Online
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        This might be dangerous for your SR in real life scenario: what if a backup is taking all the SR resources? We have to find a balance 🙂 But anyway, you can always restrict the backup speed in XO, so we'll continue to find ways to speed things up!

        1 Reply Last reply Reply Quote 1
        • planedropP Offline
          planedrop Top contributor
          last edited by

          I'm using SMB not NFS but the max I see is around 100MiB/s, so this is REALLY good speeds (I'm also on 10GbE across the board and on a NAS that can easily take in 2000MiB/s), very impressive speeds here.

          Do you have any concurrency configured though? I believe the default is 2 so that may be why you're seeing close to 2x what I am (I have it set to 1, don't really need more than that so I like to decrease overall load).

          Also on pretty beefy hosts.

          R 1 Reply Last reply Reply Quote 0
          • R Offline
            rjt @planedrop
            last edited by

            @planedrop what concurrency configuration settings are you referring to?

            • XOA config?

            • host network card config?

            • SMB concurrency?

            planedropP 1 Reply Last reply Reply Quote 0
            • R Offline
              rjt @olivierlambert
              last edited by

              @olivierlambert Amazon must have patched their Xen / XAPI to have much higher speeds?

              olivierlambertO 1 Reply Last reply Reply Quote 0
              • planedropP Offline
                planedrop Top contributor @rjt
                last edited by

                @rjt The setting for backup concurrency within the XOA backup settings.

                1 Reply Last reply Reply Quote 1
                • olivierlambertO Online
                  olivierlambert Vates 🪐 Co-Founder CEO @rjt
                  last edited by

                  @rjt AWS isn't using XAPI. Only XenServer and XCP-ng are using XAPI. It's mostly unrelated to Xen performance (at least not at this point).

                  1 Reply Last reply Reply Quote 1
                  • olivierlambertO olivierlambert moved this topic from Xen Orchestra on
                  • D Offline
                    danoontje
                    last edited by

                    I'm backing up delta's from 5 pools to a lustre filesystem with a concurrency of 10.
                    040a4e1f-3f00-4b93-b7c9-9f0ac5191429-image.png

                    1 Reply Last reply Reply Quote 0
                    • olivierlambertO Online
                      olivierlambert Vates 🪐 Co-Founder CEO
                      last edited by olivierlambert

                      Not bad 🙂 More than 2Gbit/s!

                      1 Reply Last reply Reply Quote 0
                      • florentF Offline
                        florent Vates 🪐 XO Team @KPS
                        last edited by florent

                        @KPS Hi,
                        that is some nice performance, I guess the hardware under is beefy++

                        Did you try if NBD increase the speed ?
                        You need to enable NBD on the backup network, and then enable it in the delta backup :
                        f556d425-d66f-41b5-bf8b-c6c769fdbcb5-image.png

                        We have a few tasks in the pipeline to increase performance, leveraging our knowledge of both XCP and XO

                        Florent

                        1 Reply Last reply Reply Quote 1
                        • First post
                          Last post