XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    backup mail report says INTERRUPTED but it's not ?

    Scheduled Pinned Locked Moved Backup
    15 Posts 4 Posters 252 Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P Online
      Pilow @Pilow
      last edited by

      seeing more and more of this INTERRUPTED issue in mail reports.. anyone has this also ?

      florentF 1 Reply Last reply Reply Quote 0
      • florentF Offline
        florent Vates ๐Ÿช XO Team @Pilow
        last edited by

        @Pilow the run logs ( in backups ) are marked as success ?

        P 1 Reply Last reply Reply Quote 0
        • P Online
          Pilow @florent
          last edited by Pilow

          @florent yes they are, I screenshoted earlier in the thread

          1 Reply Last reply Reply Quote 0
          • Bastien NolletB Offline
            Bastien Nollet Vates ๐Ÿช XO Team
            last edited by Bastien Nollet

            Hi @pilow,

            Currently, I don't know what would cause this or why this would happen more frequently.

            Could you test on your own to add some delay before sending the report, to see if it's indeed a race condition?

            To do that, you just need to edit the file packages/xo-server-backup-reports/dist/index.js by adding these two lines:

            const delay = ms => new Promise(resolve => setTimeout(resolve, ms));
            await delay(10000);
            

            at the beginning of the _report function, like this:

              async _report(runJobId, {
                type
              } = {}, force) {
                const delay = ms => new Promise(resolve => setTimeout(resolve, ms));
                await delay(10000);
                if (type === 'call') {
                  return;
                }
            

            then just restart xo-server.

            P 1 Reply Last reply Reply Quote 2
            • P Online
              Pilow @Bastien Nollet
              last edited by

              @Bastien-Nollet said in backup mail report says INTERRUPTED but it's not ?:

              file packages/xo-server-backup-reports/dist/index.js by a

              modification done, will give feedback

              P olivierlambertO 2 Replies Last reply Reply Quote 2
              • P Online
                Pilow @Pilow
                last edited by

                here is a first feedback of this annoying INTERRUPTED random issue (โ•ฏโ€ตโ–กโ€ฒ)โ•ฏ๏ธตโ”ปโ”โ”ป

                Started 12/10/2025 to appear (filtered view of mail inbox on word INTERRUPTED)
                d5aa943b-eff3-4b02-ac8e-97e04960ce2f-image.png

                All these backups are indeed SUCCESS in XOA, are present on the remotes, are restorable.
                We have 14 backup reports each day. As you can see, some days no interrupted, some days multiple ones.
                Backups are spanned from noon to late at night.

                Today (after applying your patch code) was either a good day, or patch succedeed ยฏ\_(ใƒ„)_/ยฏ
                27901574-a827-4710-abf9-dd0abb22f8fd-image.png

                Will keep looking for rogue INTERRUPTIONs

                1 Reply Last reply Reply Quote 0
                • olivierlambertO Online
                  olivierlambert Vates ๐Ÿช Co-Founder CEO @Pilow
                  last edited by

                  @Pilow Thanks, it's promising but we'll wait for more runs on your side ๐Ÿ™‚ If it's that, at least it's not a biggie in the end!

                  1 Reply Last reply Reply Quote 2
                  • Bastien NolletB Offline
                    Bastien Nollet Vates ๐Ÿช XO Team
                    last edited by

                    I agree, let's wait for more runs.

                    If it's indeed a race condition, we'll still have to figure out a better way to settle this than just adding delay

                    P 1 Reply Last reply Reply Quote 1
                    • P Online
                      Pilow @Bastien Nollet
                      last edited by Pilow

                      @Bastien-Nollet new day without false INTERRUPTED
                      94dbb451-6567-4d1e-af0a-6d28573416bb-image.png

                      the scrutiny of backup email reports made me find a new bug in backups (not reports this time)
                      i'll create a new topic about the dreaded BACKUP FELL BACK TO A FULL --> can provoke it on purpose !

                      Bastien NolletB 1 Reply Last reply Reply Quote 0
                      • Bastien NolletB Offline
                        Bastien Nollet Vates ๐Ÿช XO Team @Pilow
                        last edited by

                        Thanks @Pilow for the tests.

                        We'll have to investigate this to fix it more properly than adding a ugly delay.

                        P 1 Reply Last reply Reply Quote 1
                        • P Online
                          Pilow @Bastien Nollet
                          last edited by

                          @Bastien-Nollet another good day

                          I think i'll swap to feedback if problem is back than problem is not here anymore ๐Ÿ˜ƒ

                          6f10060d-d9fb-4a06-8129-3545e05205e4-image.png

                          on your side to find something sexier than delay ^^' but it seems to be a race condition

                          Bastien NolletB 1 Reply Last reply Reply Quote 0
                          • Bastien NolletB Offline
                            Bastien Nollet Vates ๐Ÿช XO Team @Pilow
                            last edited by

                            Hi @Pilow,

                            Thanks again for the feedback, I think now we have enough data to be sure it's indeed a race condition.

                            We noticed that the log you sent earlier in this topic is a backup job using a proxy. Could you tell if the backup jobs that ended up with a wrong status in the report were all using a proxy, or not all of them?

                            P 1 Reply Last reply Reply Quote 0
                            • P Online
                              Pilow @Bastien Nollet
                              last edited by

                              @Bastien-Nollet 100% of our backup jobs are done by proxy
                              we offload that of main XOA that is purely for administration/management

                              1 Reply Last reply Reply Quote 1
                              • First post
                                Last post