XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    backup mail report says INTERRUPTED but it's not ?

    Scheduled Pinned Locked Moved Backup
    15 Posts 4 Posters 252 Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • florentF Offline
      florent Vates ๐Ÿช XO Team @Pilow
      last edited by

      @Pilow the run logs ( in backups ) are marked as success ?

      P 1 Reply Last reply Reply Quote 0
      • P Offline
        Pilow @florent
        last edited by Pilow

        @florent yes they are, I screenshoted earlier in the thread

        1 Reply Last reply Reply Quote 0
        • Bastien NolletB Offline
          Bastien Nollet Vates ๐Ÿช XO Team
          last edited by Bastien Nollet

          Hi @pilow,

          Currently, I don't know what would cause this or why this would happen more frequently.

          Could you test on your own to add some delay before sending the report, to see if it's indeed a race condition?

          To do that, you just need to edit the file packages/xo-server-backup-reports/dist/index.js by adding these two lines:

          const delay = ms => new Promise(resolve => setTimeout(resolve, ms));
          await delay(10000);
          

          at the beginning of the _report function, like this:

            async _report(runJobId, {
              type
            } = {}, force) {
              const delay = ms => new Promise(resolve => setTimeout(resolve, ms));
              await delay(10000);
              if (type === 'call') {
                return;
              }
          

          then just restart xo-server.

          P 1 Reply Last reply Reply Quote 2
          • P Offline
            Pilow @Bastien Nollet
            last edited by

            @Bastien-Nollet said in backup mail report says INTERRUPTED but it's not ?:

            file packages/xo-server-backup-reports/dist/index.js by a

            modification done, will give feedback

            P olivierlambertO 2 Replies Last reply Reply Quote 2
            • P Offline
              Pilow @Pilow
              last edited by

              here is a first feedback of this annoying INTERRUPTED random issue (โ•ฏโ€ตโ–กโ€ฒ)โ•ฏ๏ธตโ”ปโ”โ”ป

              Started 12/10/2025 to appear (filtered view of mail inbox on word INTERRUPTED)
              d5aa943b-eff3-4b02-ac8e-97e04960ce2f-image.png

              All these backups are indeed SUCCESS in XOA, are present on the remotes, are restorable.
              We have 14 backup reports each day. As you can see, some days no interrupted, some days multiple ones.
              Backups are spanned from noon to late at night.

              Today (after applying your patch code) was either a good day, or patch succedeed ยฏ\_(ใƒ„)_/ยฏ
              27901574-a827-4710-abf9-dd0abb22f8fd-image.png

              Will keep looking for rogue INTERRUPTIONs

              1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates ๐Ÿช Co-Founder CEO @Pilow
                last edited by

                @Pilow Thanks, it's promising but we'll wait for more runs on your side ๐Ÿ™‚ If it's that, at least it's not a biggie in the end!

                1 Reply Last reply Reply Quote 2
                • Bastien NolletB Offline
                  Bastien Nollet Vates ๐Ÿช XO Team
                  last edited by

                  I agree, let's wait for more runs.

                  If it's indeed a race condition, we'll still have to figure out a better way to settle this than just adding delay

                  P 1 Reply Last reply Reply Quote 1
                  • P Offline
                    Pilow @Bastien Nollet
                    last edited by Pilow

                    @Bastien-Nollet new day without false INTERRUPTED
                    94dbb451-6567-4d1e-af0a-6d28573416bb-image.png

                    the scrutiny of backup email reports made me find a new bug in backups (not reports this time)
                    i'll create a new topic about the dreaded BACKUP FELL BACK TO A FULL --> can provoke it on purpose !

                    Bastien NolletB 1 Reply Last reply Reply Quote 0
                    • Bastien NolletB Offline
                      Bastien Nollet Vates ๐Ÿช XO Team @Pilow
                      last edited by

                      Thanks @Pilow for the tests.

                      We'll have to investigate this to fix it more properly than adding a ugly delay.

                      P 1 Reply Last reply Reply Quote 1
                      • P Offline
                        Pilow @Bastien Nollet
                        last edited by

                        @Bastien-Nollet another good day

                        I think i'll swap to feedback if problem is back than problem is not here anymore ๐Ÿ˜ƒ

                        6f10060d-d9fb-4a06-8129-3545e05205e4-image.png

                        on your side to find something sexier than delay ^^' but it seems to be a race condition

                        Bastien NolletB 1 Reply Last reply Reply Quote 0
                        • Bastien NolletB Offline
                          Bastien Nollet Vates ๐Ÿช XO Team @Pilow
                          last edited by

                          Hi @Pilow,

                          Thanks again for the feedback, I think now we have enough data to be sure it's indeed a race condition.

                          We noticed that the log you sent earlier in this topic is a backup job using a proxy. Could you tell if the backup jobs that ended up with a wrong status in the report were all using a proxy, or not all of them?

                          P 1 Reply Last reply Reply Quote 0
                          • P Offline
                            Pilow @Bastien Nollet
                            last edited by

                            @Bastien-Nollet 100% of our backup jobs are done by proxy
                            we offload that of main XOA that is purely for administration/management

                            1 Reply Last reply Reply Quote 1
                            • First post
                              Last post