XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Setting "Protect from accidental deletion" breaks with backups and healtchecks

    Scheduled Pinned Locked Moved Backup
    16 Posts 4 Posters 394 Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P Offline
      probain
      last edited by probain

      Having the flag "Protect from accidental deletion" has since yesterday left me with plenty of restored VMs. In the backup logs, it indicates that this happens during the healthcheck.

      This has happened on 3 out of 6 VMs
      Update: The other 3 VMs were opt-out from Healthchecks. So that is why this didn't affect them.

      23a84083-7aa0-4405-81f2-30e630b5edd5-image.png

      commit: dd5f0cdaa9993fae25469bd1cb1d01d4f2123f44

       transfer
      Start: 2026-02-04 12:16
      End: 2026-02-04 12:16
      Duration: a few seconds
      Size: 2.01 GiB
      Speed: 81.14 MiB/s
       health check 
       transfer
      Start: 2026-02-04 12:16
      End: 2026-02-04 12:35
      Duration: 19 minutes
       vmstart 
      Start: 2026-02-04 12:35
      End: 2026-02-04 12:35
      Start: 2026-02-04 12:16
      End: 2026-02-04 12:35
      Error: forbidden operation: destroy is blocked: protected from accidental deletion
      Start: 2026-02-04 12:15
      End: 2026-02-04 12:35
      Duration: 20 minutes
      Error: forbidden operation: destroy is blocked: protected from accidental deletion
       Clean VM directory 
       cleanVm: incorrect backup size in metadata
       merge
      Start: 2026-02-04 12:40
      End: 2026-02-04 12:41
      Duration: a minute
      Start: 2026-02-04 12:40
      End: 2026-02-04 12:41
       Snapshot 
      Start: 2026-02-04 12:41
      End: 2026-02-04 12:41
      
      G 1 Reply Last reply Reply Quote 0
      • G Offline
        Greg_E @probain
        last edited by

        @probain

        Not that this is an answer, but what happens if you uncheck the deletion box, and delete them manually?

        P P 2 Replies Last reply Reply Quote 0
        • P Offline
          Pilow @Greg_E
          last edited by

          @Greg_E i think protection is doing its job. do not delete.
          but in case of healthcheck, the process should bypass that for the restored VM

          thoughts @bastien-nollet @florent ?

          florentF 1 Reply Last reply Reply Quote 0
          • florentF Offline
            florent Vates 🪐 XO Team @Pilow
            last edited by

            @Pilow clearly that is a bug

            P 1 Reply Last reply Reply Quote 1
            • P Offline
              probain @Greg_E
              last edited by

              @Greg_E

              Manually unchecking makes the problem go away..
              And I can also delete manually (after unchecking the HC-vms)

              1 Reply Last reply Reply Quote 0
              • P Offline
                Pilow @florent
                last edited by

                @florent I did healthchecks one month or two ago.. I do not remember precisely

                but I didn't have this bug.

                so either specific to OP installation, or there is a regression somewhere

                P 1 Reply Last reply Reply Quote 0
                • P Offline
                  probain @Pilow
                  last edited by

                  @Pilow

                  I didn't have this before yesterday, which is when I updated. And I update from source regularly. So the regression has happened since the last few (<1w) days.

                  I'll step backwards and see which commit introduced the bug.

                  florentF 1 Reply Last reply Reply Quote 0
                  • florentF Offline
                    florent Vates 🪐 XO Team @probain
                    last edited by

                    @probain we fixed VM that was incorrectly updating their blocked operations, so maybe it's a case that "it's so broken that it works", and fixing one issue means doing more work to fix the full list

                    1 Reply Last reply Reply Quote 1
                    • P Offline
                      probain
                      last edited by probain

                      @greg_e & @florent
                      I have gone back through the commits, and I believe it is 0a042d2f54a74ecc11a377809272337cb5c880d9 that introduces the bugg.
                      https://github.com/vatesfr/xen-orchestra/commit/0a042d2f54a74ecc11a377809272337cb5c880d9

                      My last known good and working commit is the one just prior to it, a831ac7b213eb6fc7f05fbd466407d5cf379cfe9.

                      Tried with the latest commit (as the time of writing). 91c5d98489b5981917ca0aabc28ac37acd448396. But this didn't fix it, unfortunately.

                      Filed a issue/bugg-report on github for this

                      https://github.com/vatesfr/xen-orchestra/issues/9472


                      @pilow
                      A lot of updates can, and do, happen in a month or two 😉


                      cloudrootab created this issue in vatesfr/xen-orchestra

                      closed Backup job failed: forbidden operation: destroy is blocked: protected from accidental deletion #9472

                      0 fbeauchamp committed to vatesfr/xen-orchestra
                      fix(xapi): correctly block operations
                      
                      blocked operation on vm creation does not seem to work
                      
                      also importIncrementalVm was not unlocking it at the end
                      G 1 Reply Last reply Reply Quote 1
                      • G Offline
                        Greg_E @probain
                        last edited by

                        @probain

                        I'm still on an older commit, being lazy and haven't had the time to update. Next week is Microsoft updates day, I may deal with XO the same day.

                        I run health checks on mine every night when they backup, so for me this could get big very fast. I think I'm going to continue to wait until there is more news on this issue, or I'll have to uncheck the accidental deletion box (not my desired choice). I'll let you know next week what I decided.

                        P florentF 2 Replies Last reply Reply Quote 0
                        • P Offline
                          probain @Greg_E
                          last edited by

                          @Greg_E
                          or just uncheck the "protection"-flag. But that get tedious very quickly. And I only had to do it on 6 VMs.

                          1 Reply Last reply Reply Quote 0
                          • florentF Offline
                            florent Vates 🪐 XO Team @Greg_E
                            last edited by

                            @Greg_E the fix is in review, it should be on master today

                            florentF 1 Reply Last reply Reply Quote 1
                            • florentF Offline
                              florent Vates 🪐 XO Team @florent
                              last edited by

                              the fix is merged into master

                              G P 2 Replies Last reply Reply Quote 1
                              • G Offline
                                Greg_E @florent
                                last edited by

                                @florent

                                Thanks. I'm still going to wait until next week, my schedule just doesn't give me the time right now. But nice to know that when I do update, it will be fixed and my laziness prevented a problem for me 😀

                                I think I'll get my pool updated today, only been waiting a week at this point.

                                1 Reply Last reply Reply Quote 1
                                • P Offline
                                  probain @florent
                                  last edited by

                                  @florent said in Setting "Protect from accidental deletion" breaks with backups and healtchecks:

                                  the fix is merged into master

                                  I can confirm that the problem has now been solved. And will mark the raised github-issue as closed as well.

                                  1 Reply Last reply Reply Quote 1
                                  • P Offline
                                    probain
                                    last edited by

                                    Also..
                                    Thank you for taking a look at it and solving it so quickly, @florent

                                    It is a quite nice interaction when reporting bugs that they are looked at and triaged. Not saying everything needs to be a priority 1. But I do appreciate being close to the process. And if I can help make things better by reporting bugs, in a hopefully constructive way. Then I'll continue to contribute my way.

                                    1 Reply Last reply Reply Quote 0
                                    • First post
                                      Last post