XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Long-term retention of backups

    Scheduled Pinned Locked Moved Solved Backup
    23 Posts 7 Posters 4.4k Views 7 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P Offline
      ph7
      last edited by

      I have now, on the new year, added a new schedule to see if there will be any difference

      1 Reply Last reply Reply Quote 0
      • C Offline
        chr1st0ph9 @David
        last edited by

        @David Thanks, my backups suddenly fail since today, after removing all retention settings except “daily backup”, they work perfectly as last year.

        1 Reply Last reply Reply Quote 0
        • P Offline
          ph7 @olivierlambert
          last edited by

          @olivierlambert said in Long-term retention of backups:

          @ph7 said in Long-term retention of backups:

          VM_LACKS_FEATURE

          This means there's no tools installed or working on that VM

          The original job is still not running
          I was thinking about this and came up with this cunning plan 🙂

          1. Shut down the VM to see if there is still a problem with the tools
          2. Run the original job manually

          No. it did not work, still failing entries must be sorted in asc order 2025-01 2025-52

          {
            "data": {
              "mode": "delta",
              "reportWhen": "failure",
              "backupReportTpl": "mjml"
            },
            "id": "1735908223694",
            "jobId": "6a12854b-cc07-4269-b780-fe87df6cd867",
            "jobName": "LongTerm-5+2",
            "message": "backup",
            "scheduleId": "4f8cc819-2cf7-42ac-94ae-ee005727ecf7",
            "start": 1735908223694,
            "status": "failure",
            "infos": [
              {
                "data": {
                  "vms": [
                    "1b75faf0-f4db-5aa9-d204-9bee6f2abfd6"
                  ]
                },
                "message": "vms"
              }
            ],
            "tasks": [
              {
                "data": {
                  "type": "VM",
                  "id": "1b75faf0-f4db-5aa9-d204-9bee6f2abfd6",
                  "name_label": "Debian"
                },
                "id": "1735908225556",
                "message": "backup VM",
                "start": 1735908225556,
                "status": "failure",
                "tasks": [
                  {
                    "id": "1735908225574",
                    "message": "clean-vm",
                    "start": 1735908225574,
                    "status": "success",
                    "end": 1735908225783,
                    "result": {
                      "merge": false
                    }
                  },
                  {
                    "id": "1735908225605",
                    "message": "clean-vm",
                    "start": 1735908225605,
                    "status": "success",
                    "end": 1735908225828,
                    "result": {
                      "merge": false
                    }
                  },
                  {
                    "id": "1735908226496",
                    "message": "snapshot",
                    "start": 1735908226496,
                    "status": "success",
                    "end": 1735908231603,
                    "result": "4cf9de45-ff3f-f1a1-8a86-7b5cb03c9dd5"
                  },
                  {
                    "data": {
                      "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                      "isFull": true,
                      "type": "remote"
                    },
                    "id": "1735908231603:0",
                    "message": "export",
                    "start": 1735908231603,
                    "status": "failure",
                    "end": 1735908231670,
                    "result": {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    }
                  },
                  {
                    "data": {
                      "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                      "isFull": true,
                      "type": "remote"
                    },
                    "id": "1735908231605",
                    "message": "export",
                    "start": 1735908231605,
                    "status": "failure",
                    "end": 1735908231657,
                    "result": {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    }
                  },
                  {
                    "id": "1735908232625",
                    "message": "clean-vm",
                    "start": 1735908232625,
                    "status": "success",
                    "end": 1735908232700,
                    "result": {
                      "merge": false
                    }
                  },
                  {
                    "id": "1735908232656",
                    "message": "clean-vm",
                    "start": 1735908232656,
                    "status": "success",
                    "end": 1735908232767,
                    "result": {
                      "merge": false
                    }
                  },
                  {
                    "id": "1735908232981",
                    "message": "snapshot",
                    "start": 1735908232981,
                    "status": "success",
                    "end": 1735908234120,
                    "result": "f614fec5-87a5-c227-4e0c-8fa76acbb271"
                  },
                  {
                    "data": {
                      "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                      "isFull": true,
                      "type": "remote"
                    },
                    "id": "1735908234121",
                    "message": "export",
                    "start": 1735908234121,
                    "status": "failure",
                    "end": 1735908234135,
                    "result": {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    }
                  },
                  {
                    "data": {
                      "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                      "isFull": true,
                      "type": "remote"
                    },
                    "id": "1735908234121:0",
                    "message": "export",
                    "start": 1735908234121,
                    "status": "failure",
                    "end": 1735908234129,
                    "result": {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    }
                  },
                  {
                    "id": "1735908234974",
                    "message": "clean-vm",
                    "start": 1735908234974,
                    "status": "success",
                    "end": 1735908235063,
                    "result": {
                      "merge": false
                    }
                  },
                  {
                    "id": "1735908234994",
                    "message": "clean-vm",
                    "start": 1735908234994,
                    "status": "success",
                    "end": 1735908235091,
                    "result": {
                      "merge": false
                    }
                  },
                  {
                    "id": "1735908235345",
                    "message": "snapshot",
                    "start": 1735908235345,
                    "status": "success",
                    "end": 1735908236519,
                    "result": "319c12f9-6f35-411d-2a99-b2c55f7d469b"
                  },
                  {
                    "data": {
                      "id": "446f82eb-2794-4c01-bd71-e247abd6a39c",
                      "isFull": true,
                      "type": "remote"
                    },
                    "id": "1735908236520",
                    "message": "export",
                    "start": 1735908236520,
                    "status": "failure",
                    "end": 1735908236533,
                    "result": {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    }
                  },
                  {
                    "data": {
                      "id": "0927f4dc-4476-4ac3-959a-bc37e85956df",
                      "isFull": true,
                      "type": "remote"
                    },
                    "id": "1735908236520:0",
                    "message": "export",
                    "start": 1735908236520,
                    "status": "failure",
                    "end": 1735908236527,
                    "result": {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    }
                  }
                ],
                "warnings": [
                  {
                    "data": {
                      "attempt": 1,
                      "error": "all targets have failed, step: writer.prepare()"
                    },
                    "message": "Retry the VM backup due to an error"
                  },
                  {
                    "data": {
                      "attempt": 2,
                      "error": "all targets have failed, step: writer.prepare()"
                    },
                    "message": "Retry the VM backup due to an error"
                  }
                ],
                "end": 1735908237352,
                "result": {
                  "errors": [
                    {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    },
                    {
                      "generatedMessage": false,
                      "code": "ERR_ASSERTION",
                      "actual": false,
                      "expected": true,
                      "operator": "strictEqual",
                      "message": "entries must be sorted in asc order 2025-01 2025-52",
                      "name": "AssertionError",
                      "stack": "AssertionError [ERR_ASSERTION]: entries must be sorted in asc order 2025-01 2025-52\n    at getOldEntries (file:///root/xen-orchestra/@xen-orchestra/backups/_getOldEntries.mjs:116:18)\n    at IncrementalRemoteWriter._prepare (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_writers/IncrementalRemoteWriter.mjs:96:24)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)"
                    }
                  ],
                  "message": "all targets have failed, step: writer.prepare()",
                  "name": "Error",
                  "stack": "Error: all targets have failed, step: writer.prepare()\n    at IncrementalXapiVmBackupRunner._callWriters (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/_Abstract.mjs:64:13)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async IncrementalXapiVmBackupRunner._copy (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/IncrementalXapi.mjs:42:5)\n    at async IncrementalXapiVmBackupRunner.run (file:///root/xen-orchestra/@xen-orchestra/backups/_runners/_vmRunners/_AbstractXapi.mjs:396:9)\n    at async file:///root/xen-orchestra/@xen-orchestra/backups/_runners/VmsXapi.mjs:166:38"
                }
              }
            ],
            "end": 1735908237354
          }
          

          Maybe I'm wrong but I think we have a problem here. Could have something to do with the new year.

          DanpD 1 Reply Last reply Reply Quote 0
          • DanpD Offline
            Danp Pro Support Team @ph7
            last edited by

            @ph7 This is being investigated by the XOA team. We will update this thread when more information is available.

            A 1 Reply Last reply Reply Quote 1
            • D DustinB referenced this topic on
            • A Offline
              al-indigo @Danp
              last edited by

              @Danp Any news?
              I have no delta-backups since new year and I don't know what will happen if I set retention "Backup retention" to 0.
              I don't see any options to disable retention temporarily so I disabled daily backups. We have full monthly backups, but daily and weekly stopped working and it's disturbing.
              We use open-source edition, no offence or pressure intended; just curious since maybe it's reasonable to delete all backups after next monthly full-backup is complete

              DanpD 1 Reply Last reply Reply Quote 0
              • DanpD Offline
                Danp Pro Support Team @al-indigo
                last edited by

                @al-indigo I believe that a fix should be out by EOM.

                A 2 Replies Last reply Reply Quote 0
                • A Offline
                  al-indigo @Danp
                  last edited by

                  @Danp Could you please tell what will happen if I set "0" in retention field and enable backups again? Will it erase all my delta-backups there?
                  54226b89-ae07-4056-925d-797d4ff50b0a-image.png

                  DanpD 1 Reply Last reply Reply Quote 0
                  • DanpD Offline
                    Danp Pro Support Team @al-indigo
                    last edited by

                    @al-indigo AFAIK, the backup retention settings from the schedule won't be affected by changing the LTR values to zeros.

                    1 Reply Last reply Reply Quote 0
                    • A Offline
                      al-indigo @Danp
                      last edited by

                      @Danp Do you have any updates on fix release estimation?

                      DanpD 1 Reply Last reply Reply Quote 0
                      • DanpD Offline
                        Danp Pro Support Team @al-indigo
                        last edited by

                        @al-indigo The fix is included in XOA 5.103.0, which was released last week.

                        https://github.com/vatesfr/xen-orchestra/blob/master/CHANGELOG.md

                        [Backup/LTR] Fix computation for the last week of the year (PR #8269)

                        A 1 Reply Last reply Reply Quote 1
                        • A Offline
                          al-indigo @Danp
                          last edited by

                          @Danp Thank you very much! Missed it

                          1 Reply Last reply Reply Quote 1
                          • olivierlambertO olivierlambert marked this topic as a question on
                          • olivierlambertO olivierlambert has marked this topic as solved on

                          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                          With your input, this post could be even better 💗

                          Register Login
                          • First post
                            Last post