Mar 20 15:36:41 ruess090 xapi: [debug||677 |xapi events D:4bbca7a2cf61|xenops] Caught Not_found listening to events from xapi. Restarting thread after 15 seconds.
Mar 20 15:36:43 ruess090 xapi: [debug||976543 HTTPS 10.1.1.70->:::80|host.call_plugin R:2cacfbf25781|audit] Host.call_plugin host = '90290216-f6e3-44e9-87d1-fb13b81d56a7 (ruess090)'; plugin = 'updater.py'; fn = 'check_update' args = [ 'hidden' ]
Mar 20 15:36:46 ruess090 xapi: [ info||976544 /var/lib/xcp/xapi|post_cli|cli] xe vm-start vm=_testEXCH2 username=root password=(omitted)
Mar 20 15:36:46 ruess090 xapi: [ info||976544 /var/lib/xcp/xapi|session.login_with_password D:88ff9669fc62|xapi_session] Session.create trackid=203d353cd3c154f5b146a35ba426e403 pool=false uname=root originator=cli is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Mar 20 15:36:46 ruess090 xapi: [debug||976545 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:ce9d78a596fe created by task D:88ff9669fc62
Mar 20 15:36:46 ruess090 xapi: [ info||976544 /var/lib/xcp/xapi|dispatch:VM.start D:733aadce085c|dispatcher] spawning a new thread to handle the current task (trackid=203d353cd3c154f5b146a35ba426e403)
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|audit] VM.start: VM = '33f2a399-a6b4-1bb4-7b6f-01d11ba4e271 (_testEXCH2)'
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|workload_balancing] Wlb check failed: WLB_NOT_INITIALIZED
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xapi_vm_helpers] Using wlb recommendations for choosing a host has been disabled or wlb is not available. Using original algorithm
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xapi_vm_helpers] VM group feature is disabled, ignore VM anti-affinity during VM start
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xapi_vm_helpers] Attempting to select host for VM (OpaqueRef:2af627fb-08f9-d45d-a778-bc51d317fea4) in a group of equally optimal hosts [ OpaqueRef:d7772236-4941-dfec-880b-18650d72b27f;OpaqueRef:9c0b49d6-edd2-b4b0-3bc5-9af9b0b6838e;OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3 ]
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xapi_vm_helpers] Checking whether VM OpaqueRef:2af627fb-08f9-d45d-a778-bc51d317fea4 can run on host OpaqueRef:9c0b49d6-edd2-b4b0-3bc5-9af9b0b6838e
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xapi_vm_helpers] host ruess090; available_memory = 236225503232; memory_required = 13023313920
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xapi_vm_helpers] All fine, VM OpaqueRef:2af627fb-08f9-d45d-a778-bc51d317fea4 can run on host OpaqueRef:9c0b49d6-edd2-b4b0-3bc5-9af9b0b6838e!
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xapi_ha_vm_failover] assert_configuration_change_preserves_ha_plan c = configuration_change = { old_vms_leaving = [  ]; new_vms_arriving = [ 9c0b49d6 (ruess090) 2af627fb (_testEXCH2) ]; hosts_to_disable = [  ]; num_failures = no change; new_vms = [  ] }
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|audit] Reserve resources for VM OpaqueRef:2af627fb-08f9-d45d-a778-bc51d317fea4 on host OpaqueRef:9c0b49d6-edd2-b4b0-3bc5-9af9b0b6838e
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|vgpuops] vGPUs allocated to VM (OpaqueRef:2af627fb-08f9-d45d-a778-bc51d317fea4) are:
Mar 20 15:36:46 ruess090 xapi: [debug||976548 HTTPS 10.1.1.54->:::80|VM.assert_can_boot_here R:dccfd1fa6a38|audit] VM.assert_can_boot_here: VM = 'ad90d8d5-d3da-f8bd-fec1-6c53df9fe941 (ruess012)'; host = 'b440d524-6cff-4039-a316-3f16566f4dc6 (ruess092)'
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xenops] Sending VM OpaqueRef:2af627fb-08f9-d45d-a778-bc51d317fea4 configuration to xenopsd
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] VM.assert_can_boot_here R:dccfd1fa6a38 failed with exception Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:ffcffc5b-c864-c619-c3af-b2fb53e5792c ])
Mar 20 15:36:46 ruess090 xapi: [error||976546 |Async.VM.start R:51fa6027b2f9|xenops] Caught exception starting VM: Not_found
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] Raised Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:ffcffc5b-c864-c619-c3af-b2fb53e5792c ])
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] 1/7 xapi Raised at file ocaml/xapi/helpers.ml, line 1071
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xenops] VM 33f2a399-a6b4-1bb4-7b6f-01d11ba4e271 set_resident_on
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] 2/7 xapi Called from file ocaml/xapi/xapi_vm.ml, line 68
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] 3/7 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] 4/7 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] 5/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] 6/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace] 7/7 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976548 :::80|dispatch:VM.assert_can_boot_here D:3c5693a54772|backtrace]
Mar 20 15:36:46 ruess090 xapi: [debug||976550 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.slave_login D:530e811aca99 created by task R:51fa6027b2f9
Mar 20 15:36:46 ruess090 xapi: [ info||976550 /var/lib/xcp/xapi|session.slave_login D:00499d5f2d94|xapi_session] Session.create trackid=e80346919cfc496da9c1ceb6c008f2d1 pool=true uname= originator=xapi is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Mar 20 15:36:46 ruess090 xapi: [debug||976551 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:51f63c427493 created by task D:00499d5f2d94
Mar 20 15:36:46 ruess090 xapi: [debug||976552 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.logout D:f8a1105325da created by task D:cbc490602a0f
Mar 20 15:36:46 ruess090 xapi: [ info||976552 /var/lib/xcp/xapi|session.logout D:2094b1c6ac07|xapi_session] Session.destroy trackid=dfc3af0d31842f6c3b98c8174bb06fd5
Mar 20 15:36:46 ruess090 xapi: [debug||976553 HTTPS 10.1.1.54->:::80|VM.assert_can_boot_here R:70db9f8487b9|audit] VM.assert_can_boot_here: VM = 'a1a00f11-90ca-d77c-0f3c-e86dcb1f34f3 (ruess055)'; host = '3dfd5226-54c9-4106-8599-94c57072e0bb (ruess091)'
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] VM.assert_can_boot_here R:70db9f8487b9 failed with exception Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:d7772236-4941-dfec-880b-18650d72b27f; OpaqueRef:ed2aa7c6-6e3d-0bee-3e59-3971810744be ])
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] Raised Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:d7772236-4941-dfec-880b-18650d72b27f; OpaqueRef:ed2aa7c6-6e3d-0bee-3e59-3971810744be ])
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] 1/7 xapi Raised at file ocaml/xapi/helpers.ml, line 1071
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] 2/7 xapi Called from file ocaml/xapi/xapi_vm.ml, line 68
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] 3/7 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] 4/7 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] 5/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] 6/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace] 7/7 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976553 :::80|dispatch:VM.assert_can_boot_here D:b9b6f3783d7d|backtrace]
Mar 20 15:36:46 ruess090 xapi: [debug||976555 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.slave_login D:2d877b2cae36 created by task D:cbc490602a0f
Mar 20 15:36:46 ruess090 xapi: [ info||976555 /var/lib/xcp/xapi|session.slave_login D:99fbaf7e7010|xapi_session] Session.create trackid=183f04ea5f235c0d246c5b0af968713a pool=true uname= originator=xapi is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Mar 20 15:36:46 ruess090 xapi: [debug||976556 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:7844e04a6d86 created by task D:99fbaf7e7010
Mar 20 15:36:46 ruess090 xapi: [debug||976557 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:VM.atomic_set_resident_on D:1c40a994d145 created by task R:51fa6027b2f9
Mar 20 15:36:46 ruess090 xapi: [ info||976557 /var/lib/xcp/xapi|dispatch:VM.atomic_set_resident_on D:1c40a994d145|taskhelper] task VM.atomic_set_resident_on R:837f720b9a6c (uuid:dd1cef92-9a8a-0a76-66ca-a2aef89170bf) created (trackid=e80346919cfc496da9c1ceb6c008f2d1) by task R:51fa6027b2f9
Mar 20 15:36:46 ruess090 xapi: [debug||976557 /var/lib/xcp/xapi|VM.atomic_set_resident_on R:837f720b9a6c|audit] VM.atomic_set_resident_on: VM = '33f2a399-a6b4-1bb4-7b6f-01d11ba4e271 (_testEXCH2)'
Mar 20 15:36:46 ruess090 xapi: [debug||976558 HTTPS 10.1.1.54->:::80|VM.assert_can_boot_here R:caa56181a1ba|audit] VM.assert_can_boot_here: VM = 'f5956d43-b20a-b36e-d07f-5844de2eff10 (ruess056)'; host = 'b440d524-6cff-4039-a316-3f16566f4dc6 (ruess092)'
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] VM.assert_can_boot_here R:caa56181a1ba failed with exception Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:3e92a4f7-5427-f51f-39d8-f0a47b78c4e5 ])
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] Raised Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:3e92a4f7-5427-f51f-39d8-f0a47b78c4e5 ])
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] 1/7 xapi Raised at file ocaml/xapi/helpers.ml, line 1071
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] 2/7 xapi Called from file ocaml/xapi/xapi_vm.ml, line 68
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] 3/7 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] 4/7 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] 5/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] 6/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace] 7/7 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976558 :::80|dispatch:VM.assert_can_boot_here D:ed4797e99f6f|backtrace]
Mar 20 15:36:46 ruess090 xapi: [debug||976560 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.logout D:a3056fd0a1ce created by task R:51fa6027b2f9
Mar 20 15:36:46 ruess090 xapi: [ info||976560 /var/lib/xcp/xapi|session.logout D:87d6a49d35fd|xapi_session] Session.destroy trackid=e80346919cfc496da9c1ceb6c008f2d1
Mar 20 15:36:46 ruess090 xapi: [debug||976561 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:event.from D:da8714ffd100 created by task D:cbc490602a0f
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xenops] Signalling xenapi event thread to re-register, and xenopsd events to sync
Mar 20 15:36:46 ruess090 xapi: [ info||976546 |Async.VM.start R:51fa6027b2f9|xenops] xenops: UPDATES.refresh_vm 33f2a399-a6b4-1bb4-7b6f-01d11ba4e271
Mar 20 15:36:46 ruess090 xenopsd-xc: [debug||38663 |Async.VM.start R:51fa6027b2f9|xenops_server] UPDATES.refresh_vm 33f2a399-a6b4-1bb4-7b6f-01d11ba4e271
Mar 20 15:36:46 ruess090 xenopsd-xc: [debug||38663 |Async.VM.start R:51fa6027b2f9|xenops_server] VM_DB.signal 33f2a399-a6b4-1bb4-7b6f-01d11ba4e271
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xenops] Client.UPDATES.inject_barrier 44
Mar 20 15:36:46 ruess090 xenopsd-xc: [debug||38664 |Async.VM.start R:51fa6027b2f9|xenops_server] UPDATES.inject_barrier 33f2a399-a6b4-1bb4-7b6f-01d11ba4e271 44
Mar 20 15:36:46 ruess090 xapi: [debug||673 |org.xen.xapi.xenops.classic events D:bd7975bdd24c|xenops] Processing barrier 44
Mar 20 15:36:46 ruess090 xenopsd-xc: [debug||38665 |org.xen.xapi.xenops.classic events D:bd7975bdd24c|xenops_server] UPDATES.remove_barrier 44
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|xenops] triggering xapi event thread to re-register via event injection
Mar 20 15:36:46 ruess090 xapi: [debug||976562 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:event.inject D:db7dc3befa4c created by task D:4bbca7a2cf61
Mar 20 15:36:46 ruess090 xapi: [ info||976562 /var/lib/xcp/xapi|session_check D:ca3940b76c61|session_check] Session check failed: the client used an illegal or expired session ref 'OpaqueRef:c03b2d99-2ded-9066-ad97-8796f2a98213'
Mar 20 15:36:46 ruess090 xapi: [error||976562 /var/lib/xcp/xapi|dispatch:event.inject D:db7dc3befa4c|backtrace] session_check D:ca3940b76c61 failed with exception Server_error(SESSION_INVALID, [ OpaqueRef:c03b2d99-2ded-9066-ad97-8796f2a98213 ])
Mar 20 15:36:46 ruess090 xapi: [error||976562 /var/lib/xcp/xapi|dispatch:event.inject D:db7dc3befa4c|backtrace] Raised Server_error(SESSION_INVALID, [ OpaqueRef:c03b2d99-2ded-9066-ad97-8796f2a98213 ])
Mar 20 15:36:46 ruess090 xapi: [error||976562 /var/lib/xcp/xapi|dispatch:event.inject D:db7dc3befa4c|backtrace] 1/4 xapi Raised at file ocaml/xapi/session_check.ml, line 89
Mar 20 15:36:46 ruess090 xapi: [error||976562 /var/lib/xcp/xapi|dispatch:event.inject D:db7dc3befa4c|backtrace] 2/4 xapi Called from file ocaml/xapi/server_helpers.ml, line 75
Mar 20 15:36:46 ruess090 xapi: [error||976562 /var/lib/xcp/xapi|dispatch:event.inject D:db7dc3befa4c|backtrace] 3/4 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976562 /var/lib/xcp/xapi|dispatch:event.inject D:db7dc3befa4c|backtrace] 4/4 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976562 /var/lib/xcp/xapi|dispatch:event.inject D:db7dc3befa4c|backtrace]
Mar 20 15:36:46 ruess090 xapi: [error||976546 |Async.VM.start R:51fa6027b2f9|xenops] Waking up the xapi event thread: SESSION_INVALID [ OpaqueRef:c03b2d99-2ded-9066-ad97-8796f2a98213 ]
Mar 20 15:36:46 ruess090 xapi: [ warn||976546 |Async.VM.start R:51fa6027b2f9|xapi_event] Event queue length degraded. Number of events kept: 257 (less than old_max_queue_length=500)
Mar 20 15:36:46 ruess090 xapi: [debug||976546 |Async.VM.start R:51fa6027b2f9|message_forwarding] Message_forwarding.Forward.VM.clear_reservations VM=OpaqueRef:2af627fb-08f9-d45d-a778-bc51d317fea4
Mar 20 15:36:46 ruess090 xapi: [ warn||976546 |Async.VM.start R:51fa6027b2f9|xapi_event] Event queue length degraded. Number of events kept: 258 (less than old_max_queue_length=500)
Mar 20 15:36:46 ruess090 xapi: message repeated 2 times: [ [ warn||976546 |Async.VM.start R:51fa6027b2f9|xapi_event] Event queue length degraded. Number of events kept: 258 (less than old_max_queue_length=500)]
Mar 20 15:36:46 ruess090 xapi: [ warn||976546 |Async.VM.start R:51fa6027b2f9|xapi_event] Event queue length degraded. Number of events kept: 262 (less than old_max_queue_length=500)
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] Async.VM.start R:51fa6027b2f9 failed with exception Not_found
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] Raised Not_found
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 1/36 xapi Raised at file list.ml, line 191
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 2/36 xapi Called from file ocaml/xapi/map_check.ml, line 62
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 3/36 xapi Called from file ocaml/xapi/map_check.ml, line 69
Mar 20 15:36:46 ruess090 xapi: [ info||976544 /var/lib/xcp/xapi|session.logout D:5503478d4c04|xapi_session] Session.destroy trackid=203d353cd3c154f5b146a35ba426e403
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|cli] Converting exception INTERNAL_ERROR: [ Not_found ] into a CLI response
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 4/36 xapi Called from file list.ml, line 191
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 5/36 xapi Called from file src/lib/jsonrpc.ml, line 153
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 6/36 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3887
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 7/36 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3497
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 8/36 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3606
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 9/36 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3894
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 10/36 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3497
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 11/36 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3606
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] Raised Server_error(INTERNAL_ERROR, [ Not_found ])
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 1/45 xapi Raised at file list.ml, line 191
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 12/36 xapi Called from file ocaml/xapi/xapi_vm.ml, line 347
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 13/36 xapi Called from file ocaml/xapi/message_forwarding.ml, line 141
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 2/45 xapi Called from file ocaml/xapi/map_check.ml, line 62
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 14/36 xapi Called from file ocaml/xapi/message_forwarding.ml, line 1548
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 3/45 xapi Called from file ocaml/xapi/map_check.ml, line 69
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 4/45 xapi Called from file list.ml, line 191
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 5/45 xapi Called from file src/lib/jsonrpc.ml, line 153
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 15/36 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 16/36 xapi Called from file map.ml, line 137
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 6/45 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3887
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 17/36 xapi Called from file ocaml/database/schema.ml, line 294
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 7/45 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3497
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 18/36 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 8/45 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3606
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 9/45 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3894
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 19/36 xapi Called from file ocaml/xapi/message_forwarding.ml, line 1928
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 10/45 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3497
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 11/45 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3606
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 12/45 xapi Called from file ocaml/xapi/xapi_vm.ml, line 347
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 20/36 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 21/36 xapi Called from file map.ml, line 137
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 22/36 xapi Called from file ocaml/database/schema.ml, line 298
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 13/45 xapi Called from file ocaml/xapi/message_forwarding.ml, line 141
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 23/36 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 14/45 xapi Called from file ocaml/xapi/message_forwarding.ml, line 1548
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 15/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 24/36 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 16/45 xapi Called from file map.ml, line 137
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 17/45 xapi Called from file ocaml/database/schema.ml, line 294
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 25/36 xapi Called from file lib/backtrace.ml, line 114
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 18/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 26/36 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 27/36 xapi Called from file ocaml/xapi/message_forwarding.ml, line 1910
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 19/45 xapi Called from file ocaml/xapi/message_forwarding.ml, line 1928
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 20/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 28/36 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 21/45 xapi Called from file map.ml, line 137
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 29/36 xapi Called from file lib/backtrace.ml, line 114
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 30/36 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 31/36 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 32/36 xapi Called from file map.ml, line 137
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 22/45 xapi Called from file ocaml/database/schema.ml, line 298
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 33/36 xapi Called from file ocaml/database/db_cache_types.ml, line 511
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 34/36 xapi Called from file ocaml/xapi/eventgen.ml, line 110
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 35/36 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace] 36/36 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 23/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976546 ||backtrace]
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 24/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 25/45 xapi Called from file lib/backtrace.ml, line 114
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 26/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 27/45 xapi Called from file ocaml/xapi/message_forwarding.ml, line 1910
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 28/45 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 29/45 xapi Called from file lib/backtrace.ml, line 114
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 30/45 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 31/45 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 32/45 xapi Called from file ocaml/xapi-cli-server/cli_util.ml, line 134
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 33/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 34/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 35/45 xapi Called from file ocaml/xapi-cli-server/cli_operations.ml, line 3436
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 36/45 xapi Called from file ocaml/xapi-cli-server/cli_operations.ml, line 3450
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 37/45 xapi Called from file ocaml/xapi-cli-server/cli_operations.ml, line 3310
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 38/45 xapi Called from file ocaml/xapi-cli-server/cli_operations.ml, line 3364
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 39/45 xapi Called from file ocaml/xapi-cli-server/cli_operations.ml, line 3374
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 40/45 xapi Called from file ocaml/xapi-cli-server/cli_operations.ml, line 3908
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 41/45 xapi Called from file ocaml/xapi-cli-server/xapi_cli.ml, line 192
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 42/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 43/45 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 44/45 xapi Called from file ocaml/xapi-cli-server/xapi_cli.ml, line 173
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace] 45/45 xapi Called from file lib/backtrace.ml, line 177
Mar 20 15:36:46 ruess090 xapi: [error||976544 /var/lib/xcp/xapi|post_cli|backtrace]
Mar 20 15:36:46 ruess090 xapi: [debug||976565 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.logout D:2e2612d98e93 created by task D:cbc490602a0f
Mar 20 15:36:46 ruess090 xapi: [ info||976565 /var/lib/xcp/xapi|session.logout D:0448e8364e1c|xapi_session] Session.destroy trackid=183f04ea5f235c0d246c5b0af968713a
Mar 20 15:36:46 ruess090 xapi: [debug||976566 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.slave_login D:f5fffc870804 created by task D:cbc490602a0f
Mar 20 15:36:46 ruess090 xapi: [ info||976566 /var/lib/xcp/xapi|session.slave_login D:a49c791b4945|xapi_session] Session.create trackid=e4ca86f22396a96dc6b6bfdc0496cbbd pool=true uname= originator=xapi is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Mar 20 15:36:46 ruess090 xapi: [debug||976567 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:612b25c05d24 created by task D:a49c791b4945
Mar 20 15:36:46 ruess090 xapi: [debug||976569 HTTPS 10.1.1.54->:::80|VM.assert_can_boot_here R:e827fecd273e|audit] VM.assert_can_boot_here: VM = 'ad90d8d5-d3da-f8bd-fec1-6c53df9fe941 (ruess012)'; host = 'b440d524-6cff-4039-a316-3f16566f4dc6 (ruess092)'
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] VM.assert_can_boot_here R:e827fecd273e failed with exception Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:ffcffc5b-c864-c619-c3af-b2fb53e5792c ])
Mar 20 15:36:46 ruess090 xapi: [debug||976568 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:event.from D:868f4fa21b41 created by task D:cbc490602a0f
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] Raised Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:ffcffc5b-c864-c619-c3af-b2fb53e5792c ])
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] 1/7 xapi Raised at file ocaml/xapi/helpers.ml, line 1071
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] 2/7 xapi Called from file ocaml/xapi/xapi_vm.ml, line 68
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] 3/7 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] 4/7 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] 5/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] 6/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace] 7/7 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976569 :::80|dispatch:VM.assert_can_boot_here D:d12b5bc8eef0|backtrace]
Mar 20 15:36:46 ruess090 xapi: [debug||976571 HTTPS 10.1.1.54->:::80|VM.assert_can_boot_here R:5e4fece40c68|audit] VM.assert_can_boot_here: VM = 'a1a00f11-90ca-d77c-0f3c-e86dcb1f34f3 (ruess055)'; host = '3dfd5226-54c9-4106-8599-94c57072e0bb (ruess091)'
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] VM.assert_can_boot_here R:5e4fece40c68 failed with exception Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:d7772236-4941-dfec-880b-18650d72b27f; OpaqueRef:ed2aa7c6-6e3d-0bee-3e59-3971810744be ])
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] Raised Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:d7772236-4941-dfec-880b-18650d72b27f; OpaqueRef:ed2aa7c6-6e3d-0bee-3e59-3971810744be ])
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] 1/7 xapi Raised at file ocaml/xapi/helpers.ml, line 1071
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] 2/7 xapi Called from file ocaml/xapi/xapi_vm.ml, line 68
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] 3/7 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] 4/7 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] 5/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] 6/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace] 7/7 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976571 :::80|dispatch:VM.assert_can_boot_here D:7b3ec36d3151|backtrace]
Mar 20 15:36:46 ruess090 xapi: [debug||976573 HTTPS 10.1.1.54->:::80|VM.assert_can_boot_here R:14aadc60a25d|audit] VM.assert_can_boot_here: VM = 'f5956d43-b20a-b36e-d07f-5844de2eff10 (ruess056)'; host = 'b440d524-6cff-4039-a316-3f16566f4dc6 (ruess092)'
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] VM.assert_can_boot_here R:14aadc60a25d failed with exception Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:3e92a4f7-5427-f51f-39d8-f0a47b78c4e5 ])
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] Raised Server_error(VM_HOST_INCOMPATIBLE_VERSION, [ OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3; OpaqueRef:3e92a4f7-5427-f51f-39d8-f0a47b78c4e5 ])
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] 1/7 xapi Raised at file ocaml/xapi/helpers.ml, line 1071
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] 2/7 xapi Called from file ocaml/xapi/xapi_vm.ml, line 68
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] 3/7 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] 4/7 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] 5/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] 6/7 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace] 7/7 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:46 ruess090 xapi: [error||976573 :::80|dispatch:VM.assert_can_boot_here D:90aadadca3ef|backtrace]
Mar 20 15:36:47 ruess090 xenopsd-xc: [debug||5 ||mem_stats] stats header: xenopsd-xc_ocaml_free,xenopsd-xc_ocaml_maybe_live,xenopsd-xc_rss,xenopsd-xc_fdsize,xenopsd-xc_threads,xenopsd-xc_vmdata,xenopsd-xc_vmlck,xenopsd-xc_vmpte,xenopsd-xc_vmpin,xenopsd-xc_vmsize,xenopsd-xc_vmstk,xenopsd-xc_ocaml_allocation_rate,xenopsd-xc_ocaml_total,xenopsd-xc_mem_extra
Mar 20 15:36:47 ruess090 xenopsd-xc: [debug||5 ||mem_stats] stats values: 1836,1075,21076,128,117,1016928,0,660,0,1055960,132,16979949,4960,61036
Mar 20 15:36:47 ruess090 xapi: [debug||963460 HTTPS 10.1.1.91->:::80|post_root|dummytaskhelper] task dispatch:event.from D:b121198c7295 created by task D:4edaa1717f23
Mar 20 15:36:48 ruess090 squeezed: [debug||4 ||squeeze_xen] watch /data/updated <- Fri Mar 20 14:36:48 2026
Mar 20 15:36:48 ruess090 xapi: [debug||976575 HTTPS 10.1.1.70->:::80|VM.get_secureboot_readiness R:a693f19c2e57|audit] VM.get_secureboot_readiness: self = '33f2a399-a6b4-1bb4-7b6f-01d11ba4e271 (_testEXCH2)'
Mar 20 15:36:48 ruess090 squeezed: [debug||4 ||squeeze_xen] watch /data/updated <- Fri Mar 20 14:36:48 2026
Mar 20 15:36:48 ruess090 xapi: [debug||138 pool_db_backup_thread|Pool DB sync D:f96145c7a9ec|pool_db_sync] Starting DB synchronise with host OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3
Mar 20 15:36:48 ruess090 xapi: [debug||976576 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.slave_login D:a4790882e6f5 created by task D:f96145c7a9ec
Mar 20 15:36:48 ruess090 xapi: [ info||976576 /var/lib/xcp/xapi|session.slave_login D:8bfa300c1622|xapi_session] Session.create trackid=78a8b44ef72129299eb5264bb0a900c9 pool=true uname= originator=xapi is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Mar 20 15:36:48 ruess090 xapi: [debug||976577 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:a121587c3a07 created by task D:8bfa300c1622
Mar 20 15:36:48 ruess090 xapi: [debug||976578 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:host.request_backup D:41e3c6c63fea created by task D:f96145c7a9ec
Mar 20 15:36:48 ruess090 xapi: [debug||976578 /var/lib/xcp/xapi|host.request_backup D:f80c977fc96e|message_forwarding] Host.request_backup: host = 'b440d524-6cff-4039-a316-3f16566f4dc6 (ruess092)'
Mar 20 15:36:48 ruess090 xapi: [ info||976578 /var/lib/xcp/xapi|host.request_backup D:f80c977fc96e|xapi_session] Session.create trackid=56e9813bf28cc36d3125582c5ba873b9 pool=true uname= originator=xapi is_local_superuser=true auth_user_sid= parent=trackid=78a8b44ef72129299eb5264bb0a900c9
Mar 20 15:36:48 ruess090 xapi: [debug||976579 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:cb177011a95d created by task D:f80c977fc96e
Mar 20 15:36:48 ruess090 xapi: [debug||976578 /var/lib/xcp/xapi|host.request_backup D:f80c977fc96e|xmlrpc_client] stunnel pid: 878690 (cached) connected to 10.1.1.92:443
Mar 20 15:36:48 ruess090 xapi: [debug||976580 HTTPS 10.1.1.92->:::80|get_pool_xml_db_sync|pool_db_sync] received request to write out db as xml
Mar 20 15:36:48 ruess090 xapi: [ info||976581 HTTP 127.0.0.1->:::80|session.slave_login D:1c81fff579f9|xapi_session] Session.create trackid=235613d0314888ded367e8ee5281372a pool=true uname= originator=xapi is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Mar 20 15:36:48 ruess090 xapi: [debug||976582 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:6921ea88f484 created by task D:1c81fff579f9
Mar 20 15:36:48 ruess090 xapi: [debug||976580 HTTPS 10.1.1.92->:::80|Dumping database as XML R:a5cd52765b1f|pool_db_sync] sending headers
Mar 20 15:36:48 ruess090 xapi: [debug||976580 HTTPS 10.1.1.92->:::80|Dumping database as XML R:a5cd52765b1f|pool_db_sync] writing database xml
Mar 20 15:36:48 ruess090 xapi: [debug||976580 HTTPS 10.1.1.92->:::80|Dumping database as XML R:a5cd52765b1f|pool_db_sync] finished writing database xml
Mar 20 15:36:48 ruess090 xapi: [ info||976583 HTTP 127.0.0.1->:::80|session.logout D:b72985372653|xapi_session] Session.destroy trackid=235613d0314888ded367e8ee5281372a
Mar 20 15:36:48 ruess090 xapi: [ info||976578 /var/lib/xcp/xapi|host.request_backup D:f80c977fc96e|xapi_session] Session.destroy trackid=56e9813bf28cc36d3125582c5ba873b9
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] host.request_backup D:f80c977fc96e failed with exception Server_error(RESTORE_INCOMPATIBLE_VERSION, [  ])
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] Raised Server_error(RESTORE_INCOMPATIBLE_VERSION, [  ])
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 1/11 xapi Raised at file ocaml/xapi-client/client.ml, line 7
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 2/11 xapi Called from file ocaml/xapi-client/client.ml, line 19
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 3/11 xapi Called from file ocaml/xapi-client/client.ml, line 10783
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 4/11 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 5/11 xapi Called from file ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml, line 39
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 6/11 xapi Called from file ocaml/xapi/message_forwarding.ml, line 144
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 7/11 xapi Called from file ocaml/xapi/rbac.ml, line 228
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 8/11 xapi Called from file ocaml/xapi/rbac.ml, line 238
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 9/11 xapi Called from file ocaml/xapi/server_helpers.ml, line 78
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 10/11 xapi Called from file ocaml/xapi/server_helpers.ml, line 97
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace] 11/11 xapi Called from file ocaml/libs/log/debug.ml, line 258
Mar 20 15:36:48 ruess090 xapi: [error||976578 /var/lib/xcp/xapi|dispatch:host.request_backup D:41e3c6c63fea|backtrace]
Mar 20 15:36:48 ruess090 xapi: [debug||976584 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.logout D:2920ab1175d3 created by task D:f96145c7a9ec
Mar 20 15:36:48 ruess090 xapi: [ info||976584 /var/lib/xcp/xapi|session.logout D:89e1e4d394e1|xapi_session] Session.destroy trackid=78a8b44ef72129299eb5264bb0a900c9
Mar 20 15:36:48 ruess090 xapi: [error||138 pool_db_backup_thread|Pool DB sync D:f96145c7a9ec|pool_db_sync] Failed to synchronise DB with host OpaqueRef:8376b24f-70ee-b6ac-34f0-c3646c7f7ed3: Server_error(RESTORE_INCOMPATIBLE_VERSION, [  ])
Mar 20 15:36:48 ruess090 squeezed: [debug||4 ||squeeze_xen] watch /data/updated <- Fri Mar 20 15:36:48 2026
Mar 20 15:36:56 ruess090 xapi: [debug||976587 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.slave_login D:0c8e6422129a created by task D:4bbca7a2cf61
Mar 20 15:36:56 ruess090 xapi: [ info||976587 /var/lib/xcp/xapi|session.slave_login D:e7b056627674|xapi_session] Session.create trackid=acc21199845c7f32f2723c7f756707fd pool=true uname= originator=xapi is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Mar 20 15:36:56 ruess090 xapi: [debug||976588 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:pool.get_all D:b450a80c2133 created by task D:e7b056627674
Mar 20 15:36:56 ruess090 xapi: [error||677 |xapi events D:4bbca7a2cf61|xenops] events_from_xapi: missing from the cache: [ 08c63604-ce12-a0a0-74f4-66b92d003bb5; 19c83915-d391-41fc-812b-81cc51e70293; 33f2a399-a6b4-1bb4-7b6f-01d11ba4e271; 7f2ca42d-842b-3946-3a00-f5fc521262a6; aebcdd06-3a8d-afd4-4dcf-1f5d85f9b4e8; cfdb0716-f085-e945-b8ad-62a5630ee97e ]
Mar 20 15:36:56 ruess090 xapi: [debug||677 |xapi events D:4bbca7a2cf61|dummytaskhelper] task timeboxed_rpc D:b9c5438f488a created by task D:4bbca7a2cf61
Mar 20 15:36:56 ruess090 xapi: [debug||976589 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:event.from D:6474745d37f5 created by task D:4bbca7a2cf61
Mar 20 15:36:56 ruess090 xapi: [debug||677 |xapi events D:4bbca7a2cf61|xenops] Event on VM 7f2ca42d-842b-3946-3a00-f5fc521262a6; resident_here = true
Mar 20 15:36:56 ruess090 xapi: [debug||677 |xapi events D:4bbca7a2cf61|xenops] Event on VM 19c83915-d391-41fc-812b-81cc51e70293; resident_here = true
Mar 20 15:36:56 ruess090 xapi: [debug||677 |xapi events D:4bbca7a2cf61|xenops] Event on VM 275d2444-c747-c04a-333f-8f79a182177b; resident_here = true
Mar 20 15:36:56 ruess090 xapi: [error||677 |xapi events D:4bbca7a2cf61|xenops] Caught Not_found while processing XenAPI event for VM OpaqueRef:0c693876-d00f-17e2-bfd5-41cf0dcb3840
Mar 20 15:36:56 ruess090 xapi: [debug||976590 /var/lib/xcp/xapi|post_root|dummytaskhelper] task dispatch:session.logout D:eabe89e44029 created by task D:4bbca7a2cf61
Mar 20 15:36:56 ruess090 xapi: [ info||976590 /var/lib/xcp/xapi|session.logout D:1ae6413fe0e3|xapi_session] Session.destroy trackid=acc21199845c7f32f2723c7f756707fd
Mar 20 15:36:56 ruess090 xapi: [debug||677 |xapi events D:4bbca7a2cf61|xenops] Caught Not_found listening to events from xapi. Restarting thread after 15 seconds.
Mar 20 15:36:59 ruess090 xapi: [debug||976591 HTTPS 10.1.1.70->:::80|VM.get_secureboot_readiness R:d18f74158379|audit] VM.get_secureboot_readiness: self = '7f2ca42d-842b-3946-3a00-f5fc521262a6 (ruess095)'