XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Long-term retention of backups

    Scheduled Pinned Locked Moved Solved Backup
    23 Posts 7 Posters 902 Views 7 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • R Offline
      rmaclachlan @David
      last edited by

      Thank you for reporting this fix, after I removed the Number of weekly backups kept entry my backups are working again. Last night all our backups failed with the entries must be sorted in asc order 2025-01 2025-52 error.

      1 Reply Last reply Reply Quote 0
      • P Offline
        ph7
        last edited by

        I have now, on the new year, added a new schedule to see if there will be any difference

        1 Reply Last reply Reply Quote 0
        • C Offline
          chr1st0ph9 @David
          last edited by

          @David Thanks, my backups suddenly fail since today, after removing all retention settings except “daily backup”, they work perfectly as last year.

          1 Reply Last reply Reply Quote 0
          • P Offline
            ph7 @olivierlambert
            last edited by

            @olivierlambert said in Long-term retention of backups:

            @ph7 said in Long-term retention of backups:

            VM_LACKS_FEATURE

            This means there's no tools installed or working on that VM

            The original job is still not running
            I was thinking about this and came up with this cunning plan 🙂

            1. Shut down the VM to see if there is still a problem with the tools
            2. Run the original job manually

            No. it did not work, still failing entries must be sorted in asc order 2025-01 2025-52

            {
              "data": {
                "mode": "delta",
                "reportWhen": "failure",
                "backupReportTpl": "mjml"
              },
              "id": "1735908223694",
              "jobId": "6a12854b-cc07-4269-b780-fe87df6cd867",
              "jobName": "LongTerm-5+2",
              "message": "backup",
              "scheduleId": "4f8cc819-2cf7-42ac-94ae-ee005727ecf7",
              "start": 1735908223694,
              "status": "failure",
              "infos": [
                {
                  "data": {
                    "vms": [
                      "1b75faf0-f4db-5aa9-d204-9bee6f2abfd6"
                    ]
                  },
                  "message": "vms"
                }
              ],
              "tasks": [
                {
                  "data": {
                    "type": "VM",
                    "id": "1b75faf0-f4db-5aa9-d204-9bee6f2abfd6",
                    "name_label": "Debian"
                  },
                  "id": "1735908225556",
                  "message": "backup VM",
                  "start": 1735908225556,
                  "status": "failure",
                  "tasks": [
                    {
                      "id": "1735908225574",
                      "message": "clean-vm",
                      "start": 1735908225574,
                      "status": "success",
                      "end": 1735908225783,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908225605",
                      "message": "clean-vm",
                      "start": 1735908225605,
                      "status": "success",
                      "end": 1735908225828,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908226496",
                      "message": "snapshot",
                      "start": 1735908226496,
                      "status": "success",
                      "end": 1735908231603,
                      "result": "4cf9de45-ff3f-f1a1-8a86-7b5cb03c9dd5"
                    },
                    {
                      "data": {
                        "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908231603:0",
                      "message": "export",
                      "start": 1735908231603,
                      "status": "failure",
                      "end": 1735908231670,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "data": {
                        "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908231605",
                      "message": "export",
                      "start": 1735908231605,
                      "status": "failure",
                      "end": 1735908231657,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "id": "1735908232625",
                      "message": "clean-vm",
                      "start": 1735908232625,
                      "status": "success",
                      "end": 1735908232700,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908232656",
                      "message": "clean-vm",
                      "start": 1735908232656,
                      "status": "success",
                      "end": 1735908232767,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908232981",
                      "message": "snapshot",
                      "start": 1735908232981,
                      "status": "success",
                      "end": 1735908234120,
                      "result": "f614fec5-87a5-c227-4e0c-8fa76acbb271"
                    },
                    {
                      "data": {
                        "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908234121",
                      "message": "export",
                      "start": 1735908234121,
                      "status": "failure",
                      "end": 1735908234135,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "data": {
                        "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908234121:0",
                      "message": "export",
                      "start": 1735908234121,
                      "status": "failure",
                      "end": 1735908234129,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "id": "1735908234974",
                      "message": "clean-vm",
                      "start": 1735908234974,
                      "status": "success",
                      "end": 1735908235063,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908234994",
                      "message": "clean-vm",
                      "start": 1735908234994,
                      "status": "success",
                      "end": 1735908235091,
                      "result": {
                        "merge": false
                      }
                    },
                    {
                      "id": "1735908235345",
                      "message": "snapshot",
                      "start": 1735908235345,
                      "status": "success",
                      "end": 1735908236519,
                      "result": "319c12f9-6f35-411d-2a99-b2c55f7d469b"
                    },
                    {
                      "data": {
                        "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908236520",
                      "message": "export",
                      "start": 1735908236520,
                      "status": "failure",
                      "end": 1735908236533,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    },
                    {
                      "data": {
                        "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                        "isFull": true,
                        "type": "remote"
                      },
                      "id": "1735908236520:0",
                      "message": "export",
                      "start": 1735908236520,
                      "status": "failure",
                      "end": 1735908236527,
                      "result": {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    }
                  ],
                  "warnings": [
                    {
                      "data": {
                        "attempt": 1,
                        "error": "all targets have failed, step: writer.prepare()"
                      },
                      "message": "Retry the VM backup due to an error"
                    },
                    {
                      "data": {
                        "attempt": 2,
                        "error": "all targets have failed, step: writer.prepare()"
                      },
                      "message": "Retry the VM backup due to an error"
                    }
                  ],
                  "end": 1735908237352,
                  "result": {
                    "errors": [
                      {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      },
                      {
                        "generatedMessage": false,
                        "code": "ERR_ASSERTION",
                        "actual": false,
                        "expected": true,
                        "operator": "strictEqual",
                        "message": "entries must be sorted in asc order 2025-01 2025-52",
                        "name": "AssertionError",
                        "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                      }
                    ],
                    "message": "all targets have failed, step: writer.prepare()",
                    "name": "Error",
                    "stack": "Error: all targets have failed, step: writer.prepare()\n    at IncrementalXapiVmBackupRunner._callWriters (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/_Abstract.mjs:64:13)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async IncrementalXapiVmBackupRunner._copy (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/IncrementalXapi.mjs:42:5)\n    at async IncrementalXapiVmBackupRunner.run (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/_AbstractXapi.mjs:396:9)\n    at async file:///root/xen-orchestra/@xen-orchestra/backups/_runners/VmsXapi.mjs:166:38"
                  }
                }
              ],
              "end": 1735908237354
            }
            

            Maybe I'm wrong but I think we have a problem here. Could have something to do with the new year.

            DanpD 1 Reply Last reply Reply Quote 0
            • DanpD Offline
              Danp Pro Support Team @ph7
              last edited by

              @ph7 This is being investigated by the XOA team. We will update this thread when more information is available.

              A 1 Reply Last reply Reply Quote 1
              • D DustinB referenced this topic on
              • A Offline
                al-indigo @Danp
                last edited by

                @Danp Any news?
                I have no delta-backups since new year and I don't know what will happen if I set retention "Backup retention" to 0.
                I don't see any options to disable retention temporarily so I disabled daily backups. We have full monthly backups, but daily and weekly stopped working and it's disturbing.
                We use open-source edition, no offence or pressure intended; just curious since maybe it's reasonable to delete all backups after next monthly full-backup is complete

                DanpD 1 Reply Last reply Reply Quote 0
                • DanpD Offline
                  Danp Pro Support Team @al-indigo
                  last edited by

                  @al-indigo I believe that a fix should be out by EOM.

                  A 2 Replies Last reply Reply Quote 0
                  • A Offline
                    al-indigo @Danp
                    last edited by

                    @Danp Could you please tell what will happen if I set "0" in retention field and enable backups again? Will it erase all my delta-backups there?
                    54226b89-ae07-4056-925d-797d4ff50b0a-image.png

                    DanpD 1 Reply Last reply Reply Quote 0
                    • DanpD Offline
                      Danp Pro Support Team @al-indigo
                      last edited by

                      @al-indigo AFAIK, the backup retention settings from the schedule won't be affected by changing the LTR values to zeros.

                      1 Reply Last reply Reply Quote 0
                      • A Offline
                        al-indigo @Danp
                        last edited by

                        @Danp Do you have any updates on fix release estimation?

                        DanpD 1 Reply Last reply Reply Quote 0
                        • DanpD Offline
                          Danp Pro Support Team @al-indigo
                          last edited by

                          @al-indigo The fix is included in XOA 5.103.0, which was released last week.

                          https://github.com/vatesfr/xen-orchestra/blob/master/CHANGELOG.md

                          [Backup/LTR] Fix computation for the last week of the year (PR #8269)

                          A 1 Reply Last reply Reply Quote 1
                          • A Offline
                            al-indigo @Danp
                            last edited by

                            @Danp Thank you very much! Missed it

                            1 Reply Last reply Reply Quote 1
                            • olivierlambertO olivierlambert marked this topic as a question on
                            • olivierlambertO olivierlambert has marked this topic as solved on
                            • First post
                              Last post