XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Long-term retention of backups

    Scheduled Pinned Locked Moved Solved Backup
    23 Posts 7 Posters 4.4k Views 7 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • R Offline
      rmaclachlan @David
      last edited by

      Thank you for reporting this fix, after I removed the Number of weekly backups kept entry my backups are working again. Last night all our backups failed with the entries must be sorted in asc order 2025-01 2025-52 error.

      1 Reply Last reply Reply Quote 0
      • P Offline
        ph7
        last edited by

        I have now, on the new year, added a new schedule to see if there will be any difference

        1 Reply Last reply Reply Quote 0
        • C Offline
          chr1st0ph9 @David
          last edited by

          @David Thanks, my backups suddenly fail since today, after removing all retention settings except “daily backup”, they work perfectly as last year.

          1 Reply Last reply Reply Quote 0
          • P Offline
            ph7 @olivierlambert
            last edited by

            @olivierlambert said in Long-term retention of backups:

            @ph7 said in Long-term retention of backups:

            VM_LACKS_FEATURE

            This means there's no tools installed or working on that VM

            The original job is still not running
            I was thinking about this and came up with this cunning plan 🙂

            1. Shut down the VM to see if there is still a problem with the tools
            2. Run the original job manually

            No. it did not work, still failing entries must be sorted in asc order 2025-01 2025-52

            {
              "data": {
                "mode": "delta",
                "reportWhen": "failure",
                "backupReportTpl": "mjml"
              },
              "id": "1735908223694",
              "jobId": "6a12854b-cc07-4269-b780-fe87df6cd867",
              "jobName": "LongTerm-5+2",
              "message": "backup",
              "scheduleId": "4f8cc819-2cf7-42ac-94ae-ee005727ecf7",
              "start": 1735908223694,
              "status": "failure",
              "infos": [
                {
                  "data": {
                    "vms": [
                      "1b75faf0-f4db-5aa9-d204-9bee6f2abfd6"
                    ]
                  },
                  "message": "vms"
                }
              ],
              "tasks": [
                {
                  "data": {
                    "type": "VM",
                    "id": "1b75faf0-f4db-5aa9-d204-9bee6f2abfd6",
                    "name_label": "Debian"
                  },
                  "id": "1735908225556",
                  "message": "backup VM",
                  "start": 1735908225556,
                  "status": "failure",
                  "tasks": [
                    {
                      "id": "1735908225574",
                      "message": "clean-vm",
                      "start": 1735908225574,
                      "status": "success",
                      "end": 1735908225783,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908225605",
                      "message": "clean-vm",
                      "start": 1735908225605,
                      "status": "success",
                      "end": 1735908225828,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908226496",
                      "message": "snapshot",
                      "start": 1735908226496,
                      "status": "success",
                      "end": 1735908231603,
                      "result": "4cf9de45-ff3f-f1a1-8a86-7b5cb03c9dd5"
                    },
                    {
                      "data": {
                        "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908231603:0",
                      "message": "export",
                      "start": 1735908231603,
                      "status": "failure",
                      "end": 1735908231670,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "data": {
                        "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908231605",
                      "message": "export",
                      "start": 1735908231605,
                      "status": "failure",
                      "end": 1735908231657,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "id": "1735908232625",
                      "message": "clean-vm",
                      "start": 1735908232625,
                      "status": "success",
                      "end": 1735908232700,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908232656",
                      "message": "clean-vm",
                      "start": 1735908232656,
                      "status": "success",
                      "end": 1735908232767,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908232981",
                      "message": "snapshot",
                      "start": 1735908232981,
                      "status": "success",
                      "end": 1735908234120,
                      "result": "f614fec5-87a5-c227-4e0c-8fa76acbb271"
                    },
                    {
                      "data": {
                        "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908234121",
                      "message": "export",
                      "start": 1735908234121,
                      "status": "failure",
                      "end": 1735908234135,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "data": {
                        "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908234121:0",
                      "message": "export",
                      "start": 1735908234121,
                      "status": "failure",
                      "end": 1735908234129,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "id": "1735908234974",
                      "message": "clean-vm",
                      "start": 1735908234974,
                      "status": "success",
                      "end": 1735908235063,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908234994",
                      "message": "clean-vm",
                      "start": 1735908234994,
                      "status": "success",
                      "end": 1735908235091,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908235345",
                      "message": "snapshot",
                      "start": 1735908235345,
                      "status": "success",
                      "end": 1735908236519,
                      "result": "319c12f9-6f35-411d-2a99-b2c55f7d469b"
                    },
                    {
                      "data": {
                        "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908236520",
                      "message": "export",
                      "start": 1735908236520,
                      "status": "failure",
                      "end": 1735908236533,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "data": {
                        "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908236520:0",
                      "message": "export",
                      "start": 1735908236520,
                      "status": "failure",
                      "end": 1735908236527,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    }
                  ],
                  "warnings": [
                    {
                      "data": {
                        "attempt": 1,
                        "error": "all targets have failed, step: writer.prepare()"
                      },
                      "message": "Retry the VM backup due to an error"
                    },
                    {
                      "data": {
                        "attempt": 2,
                        "error": "all targets have failed, step: writer.prepare()"
                      },
                      "message": "Retry the VM backup due to an error"
                    }
                  ],
                  "end": 1735908237352,
                  "result": {
                    "errors": [
                      {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      },
                      {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    ],
                    "message": "all targets have failed, step: writer.prepare()",
                    "name": "Error",
                    "stack": "Error: all targets have failed, step: writer.prepare()\n    at IncrementalXapiVmBackupRunner._callWriters (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/_Abstract.mjs:64:13)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async IncrementalXapiVmBackupRunner._copy (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/IncrementalXapi.mjs:42:5)\n    at async IncrementalXapiVmBackupRunner.run (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/_AbstractXapi.mjs:396:9)\n    at async file:///root/xen-orchestra/@xen-orchestra/backups/_runners/VmsXapi.mjs:166:38"
                  }
                }
              ],
              "end": 1735908237354
            }
            

            Maybe I'm wrong but I think we have a problem here. Could have something to do with the new year.

            DanpD 1 Reply Last reply Reply Quote 0
            • DanpD Offline
              Danp Pro Support Team @ph7
              last edited by

              @ph7 This is being investigated by the XOA team. We will update this thread when more information is available.

              A 1 Reply Last reply Reply Quote 1
              • D DustinB referenced this topic on
              • A Offline
                al-indigo @Danp
                last edited by

                @Danp Any news?
                I have no delta-backups since new year and I don't know what will happen if I set retention "Backup retention" to 0.
                I don't see any options to disable retention temporarily so I disabled daily backups. We have full monthly backups, but daily and weekly stopped working and it's disturbing.
                We use open-source edition, no offence or pressure intended; just curious since maybe it's reasonable to delete all backups after next monthly full-backup is complete

                DanpD 1 Reply Last reply Reply Quote 0
                • DanpD Offline
                  Danp Pro Support Team @al-indigo
                  last edited by

                  @al-indigo I believe that a fix should be out by EOM.

                  A 2 Replies Last reply Reply Quote 0
                  • A Offline
                    al-indigo @Danp
                    last edited by

                    @Danp Could you please tell what will happen if I set "0" in retention field and enable backups again? Will it erase all my delta-backups there?
                    54226b89-ae07-4056-925d-797d4ff50b0a-image.png

                    DanpD 1 Reply Last reply Reply Quote 0
                    • DanpD Offline
                      Danp Pro Support Team @al-indigo
                      last edited by

                      @al-indigo AFAIK, the backup retention settings from the schedule won't be affected by changing the LTR values to zeros.

                      1 Reply Last reply Reply Quote 0
                      • A Offline
                        al-indigo @Danp
                        last edited by

                        @Danp Do you have any updates on fix release estimation?

                        DanpD 1 Reply Last reply Reply Quote 0
                        • DanpD Offline
                          Danp Pro Support Team @al-indigo
                          last edited by

                          @al-indigo The fix is included in XOA 5.103.0, which was released last week.

                          https://github.com/vatesfr/xen-orchestra/blob/master/CHANGELOG.md

                          [Backup/LTR] Fix computation for the last week of the year (PR #8269)

                          A 1 Reply Last reply Reply Quote 1
                          • A Offline
                            al-indigo @Danp
                            last edited by

                            @Danp Thank you very much! Missed it

                            1 Reply Last reply Reply Quote 1
                            • olivierlambertO olivierlambert marked this topic as a question on
                            • olivierlambertO olivierlambert has marked this topic as solved on

                            Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                            Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                            With your input, this post could be even better 💗

                            Register Login
                            • First post
                              Last post