XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    XO error/warning: Clean VM directory. unhandled error while checking alias.

    Scheduled Pinned Locked Moved Backup
    15 Posts 5 Posters 163 Views 5 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A Offline
      Andrew Top contributor @olivierlambert
      last edited by

      @julienxovates Let me know if you want me to test a different branch.

      julienXOvatesJ 1 Reply Last reply Reply Quote 0
      • FagnerMoraesF Offline
        FagnerMoraes
        last edited by

        I Need some Help too.
        2267ddc0-f8ab-44d0-aa2a-361cf64bca5f-image.jpeg

        1 Reply Last reply Reply Quote 0
        • FagnerMoraesF Offline
          FagnerMoraes
          last edited by

          He is deleting the backups.

          0f6fe215-cc94-4bae-9c8e-c2fd88ccc7a1-image.jpeg

          1 Reply Last reply Reply Quote 0
          • julienXOvatesJ Online
            julienXOvates Vates 🪐 XO Team @Andrew
            last edited by

            Hi @andrew
            Can you provide some logs ? also assuming you have this issue in the "latest" branch only ?

            A 1 Reply Last reply Reply Quote 0
            • A Offline
              Andrew Top contributor @julienXOvates
              last edited by

              @julienXOvates Correct, latest XO branch is the problem. It was fine before...

              {
                "data": {
                  "mode": "delta",
                  "reportWhen": "never"
                },
                "id": "1780192695536",
                "jobId": "d6c0a656-62c5-4c39-a57a-f246b39f1cef",
                "jobName": "minio-test",
                "message": "backup",
                "scheduleId": "bd4ef436-fd85-4f16-bf9e-71d1d0c8586f",
                "start": 1780192695536,
                "status": "success",
                "tasks": [
                  {
                    "id": "0mpt4ron3-juzrilzvn0s",
                    "start": 1780192697727,
                    "status": "success",
                    "tasks": [
                      {
                        "id": "0mpt4ron9-pxah6gpi19",
                        "start": 1780192697733,
                        "status": "success",
                        "end": 1780192698044,
                        "result": {
                          "merge": false,
                          "size": 0
                        },
                        "message": "clean-vm"
                      },
                      {
                        "id": "0mpt4rpwm-ujzdf5a8ad",
                        "start": 1780192699366,
                        "status": "success",
                        "end": 1780192700817,
                        "result": "0d3f6e5e-fd58-7368-7d54-c892809927b6",
                        "message": "snapshot"
                      },
                      {
                        "id": "0mpt4rr0x-sfehspx3ey",
                        "start": 1780192700817,
                        "status": "success",
                        "tasks": [
                          {
                            "id": "0mpt4rsdg-t05980lobz",
                            "start": 1780192702564,
                            "status": "success",
                            "end": 1780192702622,
                            "result": {
                              "size": 43008
                            },
                            "message": "transfer"
                          },
                          {
                            "id": "0mpt4rts7-5p0b0d1r94y",
                            "start": 1780192704391,
                            "status": "success",
                            "tasks": [
                              {
                                "id": "0mpt4rtvx-0rtl320os8g",
                                "start": 1780192704525,
                                "status": "success",
                                "end": 1780192704782,
                                "message": "merge"
                              }
                            ],
                            "warnings": [
                              {
                                "data": {
                                  "alias": "/xo-vm-backups/a081f208-4e40-2ca5-c68e-86106af5a8ef/vdis/d6c0a656-62c5-4c39-a57a-f246b39f1cef/cbb7809e-8296-4dc6-8200-ed1f42e50c68/20260531T015641Z.alias.vhd",
                                  "err": {
                                    "$fault": "client",
                                    "$metadata": {
                                      "httpStatusCode": 404,
                                      "requestId": "18B483D548936DAB",
                                      "extendedRequestId": "a18350611414fa9366e109699727e695e309120afc9803fcaff78a199f9bc4d6",
                                      "attempts": 1,
                                      "totalRetryDelay": 0
                                    },
                                    "name": "NotFound",
                                    "message": "UnknownError"
                                  }
                                },
                                "message": "unhandled error while checking alias"
                              }
                            ],
                            "end": 1780192704964,
                            "result": {
                              "merge": true,
                              "size": 8235471872
                            },
                            "message": "clean-vm"
                          }
                        ],
                        "end": 1780192704964,
                        "message": "export",
                        "data": {
                          "id": "9890e0c4-ba3a-4810-8245-a49fdf16b16e",
                          "isFull": false,
                          "type": "remote"
                        }
                      }
                    ],
                    "infos": [
                      {
                        "message": "Transfer data using NBD"
                      },
                      {
                        "message": "will delete snapshot data"
                      },
                      {
                        "data": {
                          "vdiRef": "OpaqueRef:50cca589-9c8c-478c-dac8-56debab464bb"
                        },
                        "message": "Snapshot data has been deleted"
                      }
                    ],
                    "end": 1780192704964,
                    "message": "backup VM",
                    "data": {
                      "id": "a081f208-4e40-2ca5-c68e-86106af5a8ef",
                      "type": "VM",
                      "name_label": "Utest"
                    }
                  }
                ],
                "end": 1780192704964,
                "infos": [
                  {
                    "data": {
                      "vms": [
                        "a081f208-4e40-2ca5-c68e-86106af5a8ef"
                      ]
                    },
                    "message": "vms"
                  }
                ]
              }
              
              May 30 21:58:24 xo2 xo-server[1180]: 2026-05-31T01:58:24.525Z xo:backups:MixinBackupWriter INFO Disk chain needs merging { count: 1 }
              May 30 21:58:24 xo2 xo-server[1180]: 2026-05-31T01:58:24.526Z xo:backups:MixinBackupWriter INFO merging disk chain {
              May 30 21:58:24 xo2 xo-server[1180]:   chain: [
              May 30 21:58:24 xo2 xo-server[1180]:     '/xo-vm-backups/a081f208-4e40-2ca5-c68e-86106af5a8ef/vdis/d6c0a656-62c5-4c39-a57a-f246b39f1cef/cbb7809e-8296-4dc6-8200-ed1f42e50c68/20260531T015641Z.alias.vhd',
              May 30 21:58:24 xo2 xo-server[1180]:     '/xo-vm-backups/a081f208-4e40-2ca5-c68e-86106af5a8ef/vdis/d6c0a656-62c5-4c39-a57a-f246b39f1cef/cbb7809e-8296-4dc6-8200-ed1f42e50c68/20260531T015759Z.alias.vhd'
              May 30 21:58:24 xo2 xo-server[1180]:   ]
              May 30 21:58:24 xo2 xo-server[1180]: }
              May 30 21:58:24 xo2 xo-server[1180]: 2026-05-31T01:58:24.788Z xo:backups:MixinBackupWriter WARN unhandled error while checking alias {
              May 30 21:58:24 xo2 xo-server[1180]:   alias: '/xo-vm-backups/a081f208-4e40-2ca5-c68e-86106af5a8ef/vdis/d6c0a656-62c5-4c39-a57a-f246b39f1cef/cbb7809e-8296-4dc6-8200-ed1f42e50c68/20260531T015641Z.alias.vhd',
              May 30 21:58:24 xo2 xo-server[1180]:   err: NotFound: UnknownError
              May 30 21:58:24 xo2 xo-server[1180]:       at S3RestXmlProtocol.handleError (/opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@aws-sdk/core/dist-cjs/submodules/protocols/index.js:1850:27)
              May 30 21:58:24 xo2 xo-server[1180]:       at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
              May 30 21:58:24 xo2 xo-server[1180]:       at async S3RestXmlProtocol.deserializeResponse (/opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@smithy/core/dist-cjs/submodules/protocols/index.js:424:13)
              May 30 21:58:24 xo2 xo-server[1180]:       at async /opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@smithy/core/dist-cjs/submodules/schema/index.js:27:24
              May 30 21:58:24 xo2 xo-server[1180]:       at async /opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:387:20
              May 30 21:58:24 xo2 xo-server[1180]:       at async /opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@smithy/core/dist-cjs/submodules/retry/index.js:172:50
              May 30 21:58:24 xo2 xo-server[1180]:       at async /opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:64:28
              May 30 21:58:24 xo2 xo-server[1180]:       at async /opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:91:20
              May 30 21:58:24 xo2 xo-server[1180]:       at async /opt/xo/xo-builds/xen-orchestra-202605291150/node_modules/@aws-sdk/middleware-logger/dist-cjs/index.js:5:26
              May 30 21:58:24 xo2 xo-server[1180]:       at async S3Handler._getSize (/opt/xo/xo-builds/xen-orchestra-202605291150/@xen-orchestra/fs/dist/s3.js:304:20) {
              May 30 21:58:24 xo2 xo-server[1180]:     '$fault': 'client',
              May 30 21:58:24 xo2 xo-server[1180]:     '$retryable': undefined,
              May 30 21:58:24 xo2 xo-server[1180]:     '$metadata': {
              May 30 21:58:24 xo2 xo-server[1180]:       httpStatusCode: 404,
              May 30 21:58:24 xo2 xo-server[1180]:       requestId: '18B483D548936DAB',
              May 30 21:58:24 xo2 xo-server[1180]:       extendedRequestId: 'a18350611414fa9366e109699727e695e309120afc9803fcaff78a199f9bc4d6',
              May 30 21:58:24 xo2 xo-server[1180]:       cfId: undefined,
              May 30 21:58:24 xo2 xo-server[1180]:       attempts: 1,
              May 30 21:58:24 xo2 xo-server[1180]:       totalRetryDelay: 0
              May 30 21:58:24 xo2 xo-server[1180]:     }
              May 30 21:58:24 xo2 xo-server[1180]:   }
              May 30 21:58:24 xo2 xo-server[1180]: }
              May 30 21:58:24 xo2 xo-server[1180]: 2026-05-31T01:58:24.964Z xo:backups:worker INFO backup has ended
              
              P 1 Reply Last reply Reply Quote 0
              • P Online
                pierrebrunet Vates 🪐 XO Team @Andrew
                last edited by

                @Andrew @fagnermoraes Hi,
                A fix is ongoing here: https://github.com/vatesfr/xen-orchestra/pull/9925

                @fagnermoraes can you provide your logs please?

                pierrebrunet289 opened this pull request in vatesfr/xen-orchestra

                open fix: move try/catch inside initializations #9925

                1 Reply Last reply Reply Quote 0
                • FagnerMoraesF Offline
                  FagnerMoraes
                  last edited by

                  @pierrebrunet

                  This is just a backup test that shows the same problem as in production.
                  The file is uploaded to the folder, then the verification error and file corruption alert are displayed.
                  Since the routine retains 3 copies, it ended up deleting the files that were working, and with the error I was left without backups.
                  I had to export the VMs to have at least one copy.
                  All packages are up to date and it is on the latest commit version.

                  {
                    "data": {
                      "mode": "full",
                      "reportWhen": "never"
                    },
                    "id": "1780237144366",
                    "jobId": "90c1a9ac-be57-4084-a009-abea039c324e",
                    "jobName": "Teste-BKP-RNP",
                    "message": "backup",
                    "scheduleId": "b603f95a-c230-4bb8-baf1-05d7b1906ae1",
                    "start": 1780237144366,
                    "status": "success",
                    "tasks": [
                      {
                        "id": "0mptv8soh-y67yux15fk",
                        "start": 1780237166129,
                        "status": "success",
                        "tasks": [
                          {
                            "id": "0mptv8u2z-z07gqebx7e8",
                            "start": 1780237167947,
                            "status": "success",
                            "end": 1780237245751,
                            "result": "7e51389c-fece-1b94-2a69-e097684f90d5",
                            "message": "snapshot"
                          },
                          {
                            "id": "0mptvai62-dj05w24lbzp",
                            "start": 1780237245818,
                            "status": "success",
                            "tasks": [
                              {
                                "id": "0mptvai6g-wo1kemu62r",
                                "start": 1780237245832,
                                "status": "success",
                                "end": 1780239711489,
                                "result": {
                                  "size": 125955945472
                                },
                                "message": "transfer"
                              }
                            ],
                            "end": 1780239711655,
                            "message": "export",
                            "data": {
                              "id": "4e24de58-14a2-4cff-ae46-985c30831302",
                              "type": "remote",
                              "isFull": true
                            }
                          },
                          {
                            "id": "0mptwroqq-oooeciwkcqg",
                            "start": 1780239727106,
                            "status": "success",
                            "warnings": [
                              {
                                "data": {
                                  "error": {
                                    "generatedMessage": false,
                                    "code": "ERR_ASSERTION",
                                    "actual": true,
                                    "expected": false,
                                    "operator": "strictEqual",
                                    "diff": "simple"
                                  }
                                },
                                "message": "Issue while checking XVA"
                              },
                              {
                                "data": {
                                  "error": {
                                    "generatedMessage": false,
                                    "code": "ERR_ASSERTION",
                                    "actual": true,
                                    "expected": false,
                                    "operator": "strictEqual",
                                    "diff": "simple"
                                  }
                                },
                                "message": "Checksum file not valid, not blocking"
                              },
                              {
                                "data": {
                                  "path": "/xo-vm-backups/695455b5-8e41-661f-d647-409620ee434e/20260501T140136Z.xva"
                                },
                                "message": "XVA might be broken"
                              },
                              {
                                "data": {
                                  "error": {
                                    "generatedMessage": false,
                                    "code": "ERR_ASSERTION",
                                    "actual": true,
                                    "expected": false,
                                    "operator": "strictEqual",
                                    "diff": "simple"
                                  }
                                },
                                "message": "Issue while checking XVA"
                              },
                              {
                                "data": {
                                  "error": {
                                    "generatedMessage": false,
                                    "code": "ERR_ASSERTION",
                                    "actual": true,
                                    "expected": false,
                                    "operator": "strictEqual",
                                    "diff": "simple"
                                  }
                                },
                                "message": "Checksum file not valid, not blocking"
                              },
                              {
                                "data": {
                                  "path": "/xo-vm-backups/695455b5-8e41-661f-d647-409620ee434e/20260531T142045Z.xva"
                                },
                                "message": "XVA might be broken"
                              },
                              {
                                "data": {
                                  "files": [
                                    "20260501T140136Z.json",
                                    "20260501T140136Z.xva",
                                    "20260501T140136Z.xva.checksum"
                                  ]
                                },
                                "message": "This files may be corrupted but not yet to be removed"
                              },
                              {
                                "data": {
                                  "files": [
                                    "20260531T142045Z.json",
                                    "20260531T142045Z.xva",
                                    "20260531T142045Z.xva.checksum"
                                  ]
                                },
                                "message": "This files may be corrupted but not yet to be removed"
                              }
                            ],
                            "end": 1780239727137,
                            "result": {
                              "merge": false,
                              "size": 0
                            },
                            "message": "clean-vm"
                          }
                        ],
                        "end": 1780239727183,
                        "message": "backup VM",
                        "data": {
                          "id": "695455b5-8e41-661f-d647-409620ee434e",
                          "type": "VM",
                          "name_label": "vm-giz-01"
                        }
                      }
                    ],
                    "end": 1780239727186,
                    "infos": [
                      {
                        "data": {
                          "vms": [
                            "695455b5-8e41-661f-d647-409620ee434e"
                          ]
                        },
                        "message": "vms"
                      }
                    ]
                  }
                  
                  1 Reply Last reply Reply Quote 0
                  • FagnerMoraesF Offline
                    FagnerMoraes
                    last edited by

                    @pierrebrunet
                    Production backup.
                    backup.txt

                    P 1 Reply Last reply Reply Quote 0
                    • P Online
                      pierrebrunet Vates 🪐 XO Team @FagnerMoraes
                      last edited by

                      @FagnerMoraes There is now a fix in latest channel now, but you will need to run backup again.

                      A 1 Reply Last reply Reply Quote 0
                      • FagnerMoraesF Offline
                        FagnerMoraes
                        last edited by FagnerMoraes

                        @pierrebrunet I updated and did a backup test with a smaller VM. It worked; it's no longer deleting the VMs backup. It still issues an alert about possible file corruption, but I restored it using XOCE and it restored normally.
                        Thank you for your help.

                        1 Reply Last reply Reply Quote 2
                        • A Offline
                          Andrew Top contributor @pierrebrunet
                          last edited by

                          @pierrebrunet I still see the same error....

                           Clean VM directory 
                           unhandled error while checking alias
                          
                          P 2 Replies Last reply Reply Quote 0
                          • P Online
                            pierrebrunet Vates 🪐 XO Team @Andrew
                            last edited by pierrebrunet

                            An issue was identified in backup jobs running in incremental with commit 100f113 or release 6.5.0. If one of your incremental backup chains was corrupted, it lead to a cleaning of vdis folder resulting into backup lose.

                            Please update your source at least to 4552fb9 or your XOA to 6.5.1.

                            If you encountered issues about a warning with aliases, you are concerned. You need to run your backup jobs again to have your backups back on track.

                            1 Reply Last reply Reply Quote 1
                            • P Online
                              pierrebrunet Vates 🪐 XO Team @Andrew
                              last edited by

                              @Andrew The warning may still appear indeed but I think it is another issue or maybe a good warning to check your backups. Can you provide the new logs please?

                              1 Reply Last reply Reply Quote 0

                              Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                              Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                              With your input, this post could be even better 💗

                              Register Login
                              • First post
                                Last post