XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Perfomance during batch backup removal

    Scheduled Pinned Locked Moved Xen Orchestra
    10 Posts 3 Posters 277 Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Tristis OrisT Offline
      Tristis Oris Top contributor
      last edited by

      If remove a couple of Detached backups like 50+, XO became very slow or unavailble, till it done.
      Is it any workaround here or possible to fix that? For example separate removal task to the background job.

      florentF 1 Reply Last reply Reply Quote 0
      • olivierlambertO Offline
        olivierlambert Vates πŸͺ Co-Founder CEO
        last edited by

        That's weird, but we need some context on your XO version, source or XOA etc.

        Tristis OrisT 1 Reply Last reply Reply Quote 0
        • Tristis OrisT Offline
          Tristis Oris Top contributor @olivierlambert
          last edited by

          @olivierlambert
          XO, latest.
          i have that issue for last few years, so it not version related thing.

          Backup remotes is NFS mount with fstab, at XO configured as local path.

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates πŸͺ Co-Founder CEO
            last edited by

            Does it ring a bell @florent ?

            Also, why not using NFS directly in the remote instead of local mount + local path?

            Tristis OrisT 2 Replies Last reply Reply Quote 0
            • florentF Offline
              florent Vates πŸͺ XO Team @Tristis Oris
              last edited by

              @Tristis-Oris said in Perfomance during batch backup removal:

              If remove a couple of Detached backups like 50+, XO became very slow or unavailble, till it done.
              Is it any workaround here or possible to fix that? For example separate removal task to the background job.

              it is probably because there is a huge merging of older backup occurring. Can you check with htop which process is hogging the resources ?

              1 Reply Last reply Reply Quote 0
              • Tristis OrisT Offline
                Tristis Oris Top contributor @olivierlambert
                last edited by

                @olivierlambert as i remember, that was much faster.

                @florent i tried, but didn't see anything interesting. Need to find what else i can remove.

                When that usually happens - change backup plan for vm, so all previous backups became detached. Also if remove vm. I'm not sure is it any merge happens at that time?

                florentF 1 Reply Last reply Reply Quote 0
                • florentF Offline
                  florent Vates πŸͺ XO Team @Tristis Oris
                  last edited by

                  @Tristis-Oris merges occurs if you delete from an incremental backup chain, where the most recent one are still kept

                  To be sure, does it use a lot of resource to delete the backup from the most recent ?

                  Tristis OrisT 2 Replies Last reply Reply Quote 0
                  • Tristis OrisT Offline
                    Tristis Oris Top contributor @florent
                    last edited by Tristis Oris

                    @florent i never tried to remove a part of chain. Only all, when they became detached.

                    for example here i removed all backups for 1 vm.

                    193d2c73-7839-43a0-b858-ad5c415bcff4-ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅.png

                    1 Reply Last reply Reply Quote 0
                    • Tristis OrisT Offline
                      Tristis Oris Top contributor @florent
                      last edited by Tristis Oris

                      @florent victim is found.

                      before, no active tasks.
                      ae75518d-80c0-4426-89a9-18b8cb0f8ebd-ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅.png

                      63da9f3b-aec4-49d3-9efa-7b3cb7e78568-ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅.png

                      during removal.
                      730a03c0-104d-4148-94e7-01cc4f15a7bd-ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅.png

                      Any data at XO won't load. I can use side menu, but nothing more. Here i wait for 3-5min.
                      cf7186eb-8c0e-4d6a-bcbd-cd67c92aa9d6-ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅.png

                      done in 15-20min.
                      325e8c3f-1557-45e4-bc3c-dbfb477be248-ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅.png

                      1 Reply Last reply Reply Quote 0
                      • Tristis OrisT Offline
                        Tristis Oris Top contributor @olivierlambert
                        last edited by

                        @olivierlambert about local mount vs xo nfs. i made new tests, XO implementation works not worse than native. That really good result.

                        local nfs
                        Size: 5.98 GiB
                        Speed: 70.76 MiB/s - 81.33 MiB/s

                        xo nfs
                        Size: 5.98 GiB
                        Speed: 79.01 MiB/s - 82.22 MiB/s

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post