Can't copy or move VM from host with xen 6.5 to host xcp-ng 8.2

[lukasz_s]

Hi

Could someone help me with troubleshooting that problem.
I've been trying to move or copy (doesn't matter for me , i really need this vm to be migrated to new host

Old host is xen 6.5 , new one is xcp-ng 8.2
xo-server 5.116.4
xo-web 5.119.1

VM i wish to migrate is one of Windows 10 vm's.

Trying to migrate (option migrate in vm tab) , during process vm is stopped and got this error:

vm.migrate
{
  "vm": "98361714-d7da-ea55-196b-3bad93f23422",
  "mapVifsNetworks": {
    "a5a0ec18-ce3a-bbab-ccc3-788b9b5de01a": "ce58e435-49d3-0fff-6be2-a4f8bc45f39a"
  },
  "migrationNetwork": "e38d287c-238c-830d-ef4a-b57150cb1e16",
  "sr": "ee68ade2-858d-efe1-d4af-60bf2075adba",
  "targetHost": "5577ea5e-9882-4f04-82f6-f2fe6db9b2f2"
}
{
  "code": 21,
  "data": {
    "objectId": "98361714-d7da-ea55-196b-3bad93f23422",
    "code": "HANDLE_INVALID"
  },
  "message": "operation failed",
  "name": "XoError",
  "stack": "XoError: operation failed
    at operationFailed (/home/node/xen-orchestra/packages/xo-common/api-errors.js:26:11)
    at file:///home/node/xen-orchestra/packages/xo-server/src/api/vm.mjs:567:15
    at Xo.migrate (file:///home/node/xen-orchestra/packages/xo-server/src/api/vm.mjs:553:3)
    at Api.#callApiMethod (file:///home/node/xen-orchestra/packages/xo-server/src/xo-mixins/api.mjs:417:20)"
}

Another try was to make copy of vm (copy option on vm tab), without compression and what i got is:

vm.copy
{
  "vm": "98361714-d7da-ea55-196b-3bad93f23422",
  "sr": "ee68ade2-858d-efe1-d4af-60bf2075adba",
  "name": "Windows 10 (administracja)_COPY"
}
{
  "message": "no opaque ref found",
  "name": "Error",
  "stack": "Error: no opaque ref found
    at extractOpaqueRef (/home/node/xen-orchestra/@xen-orchestra/xapi/_extractOpaqueRef.js:8:19)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Xapi._importVm (file:///home/node/xen-orchestra/packages/xo-server/src/xapi/index.mjs:676:19)
    at Xapi.remoteCopyVm (file:///home/node/xen-orchestra/packages/xo-server/src/xapi/index.mjs:375:50)
    at Xo.copy (file:///home/node/xen-orchestra/packages/xo-server/src/api/vm.mjs:841:7)
    at Api.#callApiMethod (file:///home/node/xen-orchestra/packages/xo-server/src/xo-mixins/api.mjs:417:20)"
}

I checked if vm has dynamic min/max and static memory same values.
There is no any iso mounted to that host.

It's strange because all of others Windows vm's , had no troubles with copying them to new host.

Could some one narrow me what else to check , what log to observe ?

[Danp]

Sound likes this issue -- https://github.com/vatesfr/xen-orchestra/issues/3506

julien-f created this issue in vatesfr/xen-orchestra

closed Issue when migrating VM #3506

[lukasz_s]

@Danp said in Can't copy or move VM from host with xen 6.5 to host xcp-ng 8.2:

https://github.com/vatesfr/xen-orchestra/issues/3506

Thanks for reply.

I tried to use "continous replication" but i got this error:

Error: INTERNAL_ERROR(Db_exn.Empty_key_in_map)

i tried to use XO restore from backup to new host and got this error:

backupNg.importVmBackup
{
  "id": "2fc3d5cc-5f53-4df0-88b0-32a83c059f5f//xo-vm-backups/98361714-d7da-ea55-196b-3bad93f23422/20230628T145640Z.json",
  "settings": {
    "mapVdisSrs": {},
    "newMacAddresses": false
  },
  "sr": "ee68ade2-858d-efe1-d4af-60bf2075adba"
}
{
  "code": "IMPORT_ERROR",
  "params": [
    "INTERNAL_ERROR: [ Xmlrpc.Parse_error(\"open_tag(value)\", \"close_tag(name)\", _) ]"
  ],
  "url": "",
  "task": {
    "uuid": "df77e19f-211e-3279-eb50-aaa93f732190",
    "name_label": "[XO] VM import",
    "name_description": "",
    "allowed_operations": [],
    "current_operations": {},
    "created": "20230705T13:30:51Z",
    "finished": "20230705T13:30:51Z",
    "status": "failure",
    "resident_on": "OpaqueRef:532e2a15-4159-45b4-9e43-ff974c3a840c",
    "progress": 1,
    "type": "<none/>",
    "result": "",
    "error_info": [
      "IMPORT_ERROR",
      "INTERNAL_ERROR: [ Xmlrpc.Parse_error(\"open_tag(value)\", \"close_tag(name)\", _) ]"
    ],
    "other_config": {},
    "subtask_of": "OpaqueRef:NULL",
    "subtasks": [],
    "backtrace": "(((process xapi)(filename lib/backtrace.ml)(line 210))((process xapi)(filename ocaml/xapi/import.ml)(line 2021))((process xapi)(filename ocaml/xapi/server_helpers.ml)(line 92)))"
  },

[Danp]

Similar issue found here, but no solution given. Maybe @stormi will have some additional thoughts on this.

[olivierlambert]

Or @julien-f maybe, dunno

[lukasz_s]

when trying migration i've got only this error in xensource.log on xen 6.5 host:

Server_helpers.exec exception_handler: Got exception INTERNAL_ERROR: [ Not_found ]

when trying to copy vm:

VM export R:8d962d9e711d|dispatcher] Server_helpers.exec exception_handler: Got exception CLIENT_ERROR: [ INTERNAL_ERROR: [ Unix.Unix_error(31, "write", "") ] ]

|xapi] Unhandled Api_errors.Server_error(CLIENT_ERROR, [ INTERNAL_ERROR: [ Unix.Unix_error(31, "write", "") ] ])

i wonder if this error could be connected with fact that this is only of my vms was crated years ago on xen 6.5 with template Windows 7 (than vm was upgraded to windows 10 when it became available) which template is absent on xcp-ng 8.2 (it has only windows 10 templates)
Other vms are windows10 templates and there was no problem to copy them to xcp-ng.

any thoughts on this ?

[julien-f]

@olivierlambert This looks like a host error, not an XO one.

[olivierlambert]

@lukasz_s what about warm migration?

[lukasz_s]

it's strange , target exist for sure all other vm's were copied to that sr on new host:

vm.warmMigration
{
  "deleteSourceVm": false,
  "sr": "1949fb9f-8730-508c-558d-dd7fe531b0c3",
  "startDestinationVm": false,
  "vm": "98361714-d7da-ea55-196b-3bad93f23422"
}
{
  "message": "Vm target of warm migration not found for 98361714-d7da-ea55-196b-3bad93f23422 on SR 1949fb9f-8730-508c-558d-dd7fe531b0c3 ",
  "name": "Error",
  "stack": "Error: Vm target of warm migration not found for 98361714-d7da-ea55-196b-3bad93f23422 on SR 1949fb9f-8730-508c-558d-dd7fe531b0c3 
    at MigrateVm.warmMigrateVm (file:///home/node/xen-orchestra/packages/xo-server/src/xo-mixins/migrate-vm.mjs:98:13)
    at Xo.warmMigration (file:///home/node/xen-orchestra/packages/xo-server/src/api/vm.mjs:608:3)
    at Api.#callApiMethod (file:///home/node/xen-orchestra/packages/xo-server/src/xo-mixins/api.mjs:417:20)"
}

[olivierlambert]

I would restart the toolstack on the both sides, in case there's a host issue.

[lukasz_s]

restarting toolstack does nothing

[dave.opc]

@lukasz_s

If your Windows system restarts with no issues, you can try and go to Control Panel - File History - System Image Backup and create a copy of your system. Then create a new VM on 8.2 and Restore it there

[lukasz_s]

thanks for all advices
just moved all services to new vm, that makes topic is closed.

for last try i updated xen 6.5 to 7.4 but problem remains