XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    VM's from ESXi, live migration not possible

    Scheduled Pinned Locked Moved Solved Migrate to XCP-ng
    21 Posts 3 Posters 8.4k Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • OhSoNoobO Offline
      OhSoNoob @olivierlambert
      last edited by

      @olivierlambert
      SRS2022_Test:

      [12:02 hxctx05 ~]# xe vm-param-list uuid=351b9e5b-c5b8-3893-6942-1bcd58d7c9e1
      uuid ( RO)                                  : 351b9e5b-c5b8-3893-6942-1bcd58d7c9e1
                                  name-label ( RW): SRV2022_Test
                            name-description ( RW):
                                user-version ( RW): 1
                               is-a-template ( RW): false
                         is-default-template ( RW): false
                               is-a-snapshot ( RO): false
                                 snapshot-of ( RO): <not in database>
                                   snapshots ( RO):
                               snapshot-time ( RO): 19700101T00:00:00Z
                               snapshot-info ( RO):
                                      parent ( RO): <not in database>
                                    children ( RO):
                           is-control-domain ( RO): false
                                 power-state ( RO): running
                               memory-actual ( RO): 8592023552
                               memory-target ( RO): 0
                             memory-overhead ( RO): 73400320
                           memory-static-max ( RW): 8589934592
                          memory-dynamic-max ( RW): 8589934592
                          memory-dynamic-min ( RW): 8589934592
                           memory-static-min ( RW): 1073741824
                            suspend-VDI-uuid ( RW): <not in database>
                             suspend-SR-uuid ( RW): <not in database>
                                VCPUs-params (MRW):
                                   VCPUs-max ( RW): 4
                            VCPUs-at-startup ( RW): 4
                      actions-after-shutdown ( RW): Destroy
                        actions-after-reboot ( RW): Restart
                         actions-after-crash ( RW): Restart
                               console-uuids (SRO): 7bb85a23-6c56-61f2-45b1-645f913b0419
                                         hvm ( RO): true
                                    platform (MRW): timeoffset: -25200; device-model: qemu-upstream-uefi; secureboot: false; videoram: 8; hpet: true; viridian_apic_assist: true; apic: true; device_id: 0002; cores-per-socket: 2; viridian_crash_ctl: true; pae: true; vga: std; nx: true; viridian_time_ref_count: true; viridian_stimer: true; viridian: true; acpi: 1; viridian_reference_tsc: true
                          allowed-operations (SRO): changing_dynamic_range; migrate_send; pool_migrate; changing_VCPUs_live; suspend; hard_reboot; hard_shutdown; clean_reboot; clean_shutdown; pause; checkpoint; snapshot
                          current-operations (SRO):
                          blocked-operations (MRW):
                         allowed-VBD-devices (SRO): 1; 2; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17; 18; 19; 20; 21; 22; 23; 24; 25; 26; 27; 28; 29; 30; 31; 32; 33; 34; 35; 36; 37; 38; 39; 40; 41; 42; 43; 44; 45; 46; 47; 48; 49; 50; 51; 52; 53; 54; 55; 56; 57; 58; 59; 60; 61; 62; 63; 64; 65; 66; 67; 68; 69; 70; 71; 72; 73; 74; 75; 76; 77; 78; 79; 80; 81; 82; 83; 84; 85; 86; 87; 88; 89; 90; 91; 92; 93; 94; 95; 96; 97; 98; 99; 100; 101; 102; 103; 104; 105; 106; 107; 108; 109; 110; 111; 112; 113; 114; 115; 116; 117; 118; 119; 120; 121; 122; 123; 124; 125; 126; 127; 128; 129; 130; 131; 132; 133; 134; 135; 136; 137; 138; 139; 140; 141; 142; 143; 144; 145; 146; 147; 148; 149; 150; 151; 152; 153; 154; 155; 156; 157; 158; 159; 160; 161; 162; 163; 164; 165; 166; 167; 168; 169; 170; 171; 172; 173; 174; 175; 176; 177; 178; 179; 180; 181; 182; 183; 184; 185; 186; 187; 188; 189; 190; 191; 192; 193; 194; 195; 196; 197; 198; 199; 200; 201; 202; 203; 204; 205; 206; 207; 208; 209; 210; 211; 212; 213; 214; 215; 216; 217; 218; 219; 220; 221; 222; 223; 224; 225; 226; 227; 228; 229; 230; 231; 232; 233; 234; 235; 236; 237; 238; 239; 240; 241; 242; 243; 244; 245; 246; 247; 248; 249; 250; 251; 252; 253; 254
                         allowed-VIF-devices (SRO): 1; 2; 3; 4; 5; 6
                              possible-hosts ( RO): a235982c-c51a-4578-82bb-51e8c6d37bed
                                 domain-type ( RW): hvm
                         current-domain-type ( RO): hvm
                             HVM-boot-policy ( RW): BIOS order
                             HVM-boot-params (MRW): firmware: uefi; order: cd
                       HVM-shadow-multiplier ( RW): 1.000
                                   PV-kernel ( RW):
                                  PV-ramdisk ( RW):
                                     PV-args ( RW):
                              PV-legacy-args ( RW):
                               PV-bootloader ( RW):
                          PV-bootloader-args ( RW):
                         last-boot-CPU-flags ( RO): vendor: GenuineIntel; features: 1fcbfbff-f7fa3223-2c100800-00000121-0000000f-009c0fab-00000008-00000000-00001000-bc000400-00000000-00000000-00000000-00000000-00000000-00000000-0c000004-00000000-00000000-00000000-00000000-00000000
                            last-boot-record ( RO): ''
                                 resident-on ( RO): a235982c-c51a-4578-82bb-51e8c6d37bed
                                    affinity ( RW): <not in database>
                                other-config (MRW): xo:351b9e5b: {"creation":{"date":"2024-04-17T19:51:42.647Z","template":"1c33af1c-e919-418c-ad45-85d7d6fb604a","user":"00b23cda-6f3e-42a0-ac32-8074336f5363"}}; base_template_name: Windows Server 2022 (64-bit); import_task: OpaqueRef:a775fe45-36e8-435f-8919-21dced27a55a; mac_seed: 8ca53f9c-82eb-d664-4346-74e8e3db8045; install-methods: cdrom
                                      dom-id ( RO): 10
                             recommendations ( RO): <restrictions><restriction field="memory-static-max" max="1649267441664"/><restriction field="vcpus-min" min="2"/><restriction field="vcpus-max" max="32"/><restriction field="has-vendor-device" value="true"/><restriction field="allow-network-sriov" value="1"/><restriction field="supports-bios" value="yes"/><restriction field="supports-uefi" value="yes"/><restriction field="supports-secure-boot" value="yes"/><restriction max="255" property="number-of-vbds"/><restriction max="7" property="number-of-vifs"/></restrictions>
                               xenstore-data (MRW): vm-data/mmio-hole-size: 268435456; vm-data:
                  ha-always-run ( RW) [DEPRECATED]: false
                         ha-restart-priority ( RW):
                                       blobs ( RO):
                                  start-time ( RO): 20240417T20:00:37Z
                                install-time ( RO): 20240417T19:51:44Z
                                VCPUs-number ( RO): 4
                           VCPUs-utilisation (MRO): 0: 0.008; 1: 0.004; 2: 0.003; 3: 0.003
                                  os-version (MRO): name: Microsoft Windows Server 2022 Standard|C:\Windows|\Device\Harddisk0\Partition3; distro: windows; major: 10; minor: 0; spmajor: 0; spminor: 0
                          PV-drivers-version (MRO): major: 9; minor: 3; micro: 2; build: 110
          PV-drivers-up-to-date ( RO) [DEPRECATED]: true
                                      memory (MRO):
                                       disks (MRO):
                                        VBDs (SRO): f32a601a-840e-98a3-08e3-95fb63acc547; 09eb4ebf-874c-4543-dc17-b57680628684
                                    networks (MRO): 0/ip: 10.1.3.196; 0/ipv4/0: 10.1.3.196; 0/ipv6/0: fe80:0000:0000:0000:8cf2:5497:8793:ed3a
                         PV-drivers-detected ( RO): true
                                       other (MRO): platform-feature-xs_reset_watches: 1; platform-feature-multiprocessor-suspend: 1; has-vendor-device: 0; feature-xs-batcmd: 1; feature-wuRebootRequired: 1; feature-updatetime: 1; feature-ts2: 1; feature-ts: 1; feature-suspend: 1; feature-static-ip-setting: 1; feature-shutdown: 1; feature-setcomputername: 1; feature-s4: 1; feature-s3: 1; feature-reboot: 1; feature-poweroff: 1; feature-laptop-slate-mode: 1; feature-balloon: 1; data-ts: 0
                                        live ( RO): true
                  guest-metrics-last-updated ( RO): 20240417T20:00:56Z
                         can-use-hotplug-vbd ( RO): true
                         can-use-hotplug-vif ( RO): true
                    cooperative ( RO) [DEPRECATED]: true
                                        tags (SRW):
                                   appliance ( RW): <not in database>
                           snapshot-schedule ( RW): <not in database>
                            is-vmss-snapshot ( RO): false
                                 start-delay ( RW): 0
                              shutdown-delay ( RW): 0
                                       order ( RW): 0
                                     version ( RO): 0
                               generation-id ( RO): 5943050155679112586:446876449901291824
                   hardware-platform-version ( RO): 0
                           has-vendor-device ( RW): false
                             requires-reboot ( RO): false
                             reference-label ( RO): windows-server-2022-64bit
                                bios-strings (MRO): bios-vendor: Xen; bios-version: ; system-manufacturer: Xen; system-product-name: HVM domU; system-version: ; system-serial-number: ; baseboard-manufacturer: ; baseboard-product-name: ; baseboard-version: ; baseboard-serial-number: ; baseboard-asset-tag: ; baseboard-location-in-chassis: ; enclosure-asset-tag: ; hp-rombios: ; oem-1: Xen; oem-2: MS_VM_CERT/SHA1/bdbeb6e0a816d43fa6d3fe8aaef04c2bad9d3e3d
      
      

      CTX035002:

      [12:03 hxctx05 ~]# xe vm-param-list uuid=e729854b-3956-97ca-c7f0-f2155099bfb2
      uuid ( RO)                                  : e729854b-3956-97ca-c7f0-f2155099bfb2
                                  name-label ( RW): CTX035002
                            name-description ( RW): from esxi
                                user-version ( RW): 1
                               is-a-template ( RW): false
                         is-default-template ( RW): false
                               is-a-snapshot ( RO): false
                                 snapshot-of ( RO): <not in database>
                                   snapshots ( RO):
                               snapshot-time ( RO): 19700101T00:00:00Z
                               snapshot-info ( RO):
                                      parent ( RO): <not in database>
                                    children ( RO):
                           is-control-domain ( RO): false
                                 power-state ( RO): running
                               memory-actual ( RO): 30066860032
                               memory-target ( RO): 30064771072
                             memory-overhead ( RO): 243269632
                           memory-static-max ( RW): 30064771072
                          memory-dynamic-max ( RW): 30064771072
                          memory-dynamic-min ( RW): 30064771072
                           memory-static-min ( RW): 30064771072
                            suspend-VDI-uuid ( RW): <not in database>
                             suspend-SR-uuid ( RW): <not in database>
                                VCPUs-params (MRW):
                                   VCPUs-max ( RW): 6
                            VCPUs-at-startup ( RW): 6
                      actions-after-shutdown ( RW): Destroy
                        actions-after-reboot ( RW): Restart
                         actions-after-crash ( RW): Restart
                               console-uuids (SRO): 13b8a928-e790-e724-2a80-919fd1fe8848
                                         hvm ( RO): true
                                    platform (MRW): timeoffset: 7200; device-model: qemu-upstream-uefi; nx: true; acpi: 1; apic: true; pae: true; hpet: true; viridian: true
                          allowed-operations (SRO): changing_dynamic_range; hard_reboot; hard_shutdown; clean_reboot; clean_shutdown; pause; snapshot
                          current-operations (SRO):
                          blocked-operations (MRW):
                         allowed-VBD-devices (SRO): 1; 2; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17; 18; 19; 20; 21; 22; 23; 24; 25; 26; 27; 28; 29; 30; 31; 32; 33; 34; 35; 36; 37; 38; 39; 40; 41; 42; 43; 44; 45; 46; 47; 48; 49; 50; 51; 52; 53; 54; 55; 56; 57; 58; 59; 60; 61; 62; 63; 64; 65; 66; 67; 68; 69; 70; 71; 72; 73; 74; 75; 76; 77; 78; 79; 80; 81; 82; 83; 84; 85; 86; 87; 88; 89; 90; 91; 92; 93; 94; 95; 96; 97; 98; 99; 100; 101; 102; 103; 104; 105; 106; 107; 108; 109; 110; 111; 112; 113; 114; 115; 116; 117; 118; 119; 120; 121; 122; 123; 124; 125; 126; 127; 128; 129; 130; 131; 132; 133; 134; 135; 136; 137; 138; 139; 140; 141; 142; 143; 144; 145; 146; 147; 148; 149; 150; 151; 152; 153; 154; 155; 156; 157; 158; 159; 160; 161; 162; 163; 164; 165; 166; 167; 168; 169; 170; 171; 172; 173; 174; 175; 176; 177; 178; 179; 180; 181; 182; 183; 184; 185; 186; 187; 188; 189; 190; 191; 192; 193; 194; 195; 196; 197; 198; 199; 200; 201; 202; 203; 204; 205; 206; 207; 208; 209; 210; 211; 212; 213; 214; 215; 216; 217; 218; 219; 220; 221; 222; 223; 224; 225; 226; 227; 228; 229; 230; 231; 232; 233; 234; 235; 236; 237; 238; 239; 240; 241; 242; 243; 244; 245; 246; 247; 248; 249; 250; 251; 252; 253; 254
                         allowed-VIF-devices (SRO): 1; 2; 3; 4; 5; 6
                              possible-hosts ( RO): 230365b3-4916-43bc-8a25-65c000b6937e; a235982c-c51a-4578-82bb-51e8c6d37bed
                                 domain-type ( RW): hvm
                         current-domain-type ( RO): hvm
                             HVM-boot-policy ( RW): BIOS order
                             HVM-boot-params (MRW): firmware: uefi; order: cdn
                       HVM-shadow-multiplier ( RW): 1.000
                                   PV-kernel ( RW):
                                  PV-ramdisk ( RW):
                                     PV-args ( RW):
                              PV-legacy-args ( RW):
                               PV-bootloader ( RW):
                          PV-bootloader-args ( RW):
                         last-boot-CPU-flags ( RO): vendor: GenuineIntel; features: 1fcbfbff-f7fa3223-2c100800-00000121-0000000f-009c0fab-00000008-00000000-00001000-bc000400-00000000-00000000-00000000-00000000-00000000-00000000-0c000004-00000000-00000000-00000000-00000000-00000000
                            last-boot-record ( RO): ''
                                 resident-on ( RO): 230365b3-4916-43bc-8a25-65c000b6937e
                                    affinity ( RW): <not in database>
                                other-config (MRW): mac_seed: b5a38321-902b-94c2-9df0-7a62fa53fca0; vgpu_pci: ; base_template_name: Other install media; install-methods: cdrom
                                      dom-id ( RO): 22
                             recommendations ( RO): <restrictions><restriction field="memory-static-max" max="137438953472" /><restriction field="vcpus-max" max="32" /><restriction property="number-of-vbds" max="255" /><restriction property="number-of-vifs" max="7" /><restriction field="has-vendor-device" value="false" /></restrictions>
                               xenstore-data (MRW): vm-data/mmio-hole-size: 268435456; vm-data:
                  ha-always-run ( RW) [DEPRECATED]: false
                         ha-restart-priority ( RW):
                                       blobs ( RO):
                                  start-time ( RO): 20240418T10:03:55Z
                                install-time ( RO): 19700101T00:00:00Z
                                VCPUs-number ( RO): 6
                           VCPUs-utilisation (MRO): 0: 0.712; 1: 0.751; 2: 0.760; 3: 0.730; 4: 0.670; 5: 0.696
                                  os-version (MRO): name: Microsoft Windows Server 2022 Standard|C:\WINDOWS|\Device\Harddisk0\Partition3; distro: windows; major: 10; minor: 0; spmajor: 0; spminor: 0
                          PV-drivers-version (MRO):
          PV-drivers-up-to-date ( RO) [DEPRECATED]: true
                                      memory (MRO):
                                       disks (MRO):
                                        VBDs (SRO): a61b6a43-9010-4d16-f6f2-dbd115ab63ba; 51ab5bd8-f039-e3cd-2592-99481b2c34ac
                                    networks (MRO): 0/ip: 10.1.3.228; 0/ipv4/0: 10.1.3.228; 0/ipv6/0: fe80:0000:0000:0000:4324:f2d3:7183:52db
                         PV-drivers-detected ( RO): true
                                       other (MRO): platform-feature-xs_reset_watches: 1; platform-feature-multiprocessor-suspend: 1; has-vendor-device: 0; feature-xs-batcmd: 1; feature-wuRebootRequired: 1; feature-updatetime: 1; feature-ts2: 1; feature-ts: 1; data-cant-suspend-reason: {"error":{"class":"GenericError","desc":"State blocked by non-migratable device '0000:00:07.0/nvme'","data":{}},"id":"qmp-000253-22"}; feature-static-ip-setting: 1; feature-shutdown: 1; feature-setcomputername: 1; feature-s4: 1; feature-s3: 1; feature-reboot: 1; feature-poweroff: 1; feature-laptop-slate-mode: 1; feature-balloon: 1; data-ts: 1
                                        live ( RO): true
                  guest-metrics-last-updated ( RO): 20240418T10:04:19Z
                         can-use-hotplug-vbd ( RO): unspecified
                         can-use-hotplug-vif ( RO): true
                    cooperative ( RO) [DEPRECATED]: true
                                        tags (SRW): 0350
                                   appliance ( RW): <not in database>
                           snapshot-schedule ( RW): <not in database>
                            is-vmss-snapshot ( RO): false
                                 start-delay ( RW): 0
                              shutdown-delay ( RW): 0
                                       order ( RW): 0
                                     version ( RO): 0
                               generation-id ( RO): 3441820287309222538:4765684607619708731
                   hardware-platform-version ( RO): 0
                           has-vendor-device ( RW): false
                             requires-reboot ( RO): false
                             reference-label ( RO):
                                bios-strings (MRO): bios-vendor: Xen; bios-version: ; system-manufacturer: Xen; system-product-name: HVM domU; system-version: ; system-serial-number: ; baseboard-manufacturer: ; baseboard-product-name: ; baseboard-version: ; baseboard-serial-number: ; baseboard-asset-tag: ; baseboard-location-in-chassis: ; enclosure-asset-tag: ; hp-rombios: ; oem-1: Xen; oem-2: MS_VM_CERT/SHA1/bdbeb6e0a816d43fa6d3fe8aaef04c2bad9d3e3d
      
      
      1 Reply Last reply Reply Quote 0
      • OhSoNoobO Offline
        OhSoNoob
        last edited by OhSoNoob

        Also just tried a warm migration with CTX035001 (also imported from ESXi, like CTX035002) but this doesn't change the ability to live migrate

        Output of this VM now is:

        [12:05 hxctx05 ~]# xe vm-param-list uuid=60fcb435-4436-5fab-a0f4-00011f534d7a
        uuid ( RO)                                  : 60fcb435-4436-5fab-a0f4-00011f534d7a
                                    name-label ( RW): CTX035001 - Warm migration - (20240418T100016Z)
                              name-description ( RW):
                                  user-version ( RW): 1
                                 is-a-template ( RW): false
                           is-default-template ( RW): false
                                 is-a-snapshot ( RO): false
                                   snapshot-of ( RO): <not in database>
                                     snapshots ( RO):
                                 snapshot-time ( RO): 19700101T00:00:00Z
                                 snapshot-info ( RO):
                                        parent ( RO): <not in database>
                                      children ( RO):
                             is-control-domain ( RO): false
                                   power-state ( RO): running
                                 memory-actual ( RO): 30066860032
                                 memory-target ( RO): 30064771072
                               memory-overhead ( RO): 243269632
                             memory-static-max ( RW): 30064771072
                            memory-dynamic-max ( RW): 30064771072
                            memory-dynamic-min ( RW): 30064771072
                             memory-static-min ( RW): 1073741824
                              suspend-VDI-uuid ( RW): <not in database>
                               suspend-SR-uuid ( RW): <not in database>
                                  VCPUs-params (MRW):
                                     VCPUs-max ( RW): 6
                              VCPUs-at-startup ( RW): 6
                        actions-after-shutdown ( RW): Destroy
                          actions-after-reboot ( RW): Restart
                           actions-after-crash ( RW): Restart
                                 console-uuids (SRO): 7384aa3f-fd71-db2e-2cee-2db7d64068e3
                                           hvm ( RO): true
                                      platform (MRW): timeoffset: 7200; device-model: qemu-upstream-uefi; secureboot: false; videoram: 8; hpet: true; viridian_apic_assist: true; apic: true; device_id: 0002; cores-per-socket: 2; viridian_crash_ctl: true; pae: true; vga: std; nx: true; viridian_time_ref_count: true; viridian_stimer: true; viridian: true; acpi: 1; viridian_reference_tsc: true
                            allowed-operations (SRO): changing_dynamic_range; hard_reboot; hard_shutdown; clean_reboot; clean_shutdown; pause; snapshot
                            current-operations (SRO):
                            blocked-operations (MRW):
                           allowed-VBD-devices (SRO): 1; 2; 3; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17; 18; 19; 20; 21; 22; 23; 24; 25; 26; 27; 28; 29; 30; 31; 32; 33; 34; 35; 36; 37; 38; 39; 40; 41; 42; 43; 44; 45; 46; 47; 48; 49; 50; 51; 52; 53; 54; 55; 56; 57; 58; 59; 60; 61; 62; 63; 64; 65; 66; 67; 68; 69; 70; 71; 72; 73; 74; 75; 76; 77; 78; 79; 80; 81; 82; 83; 84; 85; 86; 87; 88; 89; 90; 91; 92; 93; 94; 95; 96; 97; 98; 99; 100; 101; 102; 103; 104; 105; 106; 107; 108; 109; 110; 111; 112; 113; 114; 115; 116; 117; 118; 119; 120; 121; 122; 123; 124; 125; 126; 127; 128; 129; 130; 131; 132; 133; 134; 135; 136; 137; 138; 139; 140; 141; 142; 143; 144; 145; 146; 147; 148; 149; 150; 151; 152; 153; 154; 155; 156; 157; 158; 159; 160; 161; 162; 163; 164; 165; 166; 167; 168; 169; 170; 171; 172; 173; 174; 175; 176; 177; 178; 179; 180; 181; 182; 183; 184; 185; 186; 187; 188; 189; 190; 191; 192; 193; 194; 195; 196; 197; 198; 199; 200; 201; 202; 203; 204; 205; 206; 207; 208; 209; 210; 211; 212; 213; 214; 215; 216; 217; 218; 219; 220; 221; 222; 223; 224; 225; 226; 227; 228; 229; 230; 231; 232; 233; 234; 235; 236; 237; 238; 239; 240; 241; 242; 243; 244; 245; 246; 247; 248; 249; 250; 251; 252; 253; 254
                           allowed-VIF-devices (SRO): 1; 2; 3; 4; 5; 6
                                possible-hosts ( RO): 230365b3-4916-43bc-8a25-65c000b6937e; a235982c-c51a-4578-82bb-51e8c6d37bed
                                   domain-type ( RW): hvm
                           current-domain-type ( RO): hvm
                               HVM-boot-policy ( RW): BIOS order
                               HVM-boot-params (MRW): order: cnd; firmware: uefi
                         HVM-shadow-multiplier ( RW): 1.000
                                     PV-kernel ( RW):
                                    PV-ramdisk ( RW):
                                       PV-args ( RW):
                                PV-legacy-args ( RW):
                                 PV-bootloader ( RW):
                            PV-bootloader-args ( RW):
                           last-boot-CPU-flags ( RO): vendor: GenuineIntel; features: 1fcbfbff-f7fa3223-2c100800-00000121-0000000f-009c0fab-00000008-00000000-00001000-bc000400-00000000-00000000-00000000-00000000-00000000-00000000-0c000004-00000000-00000000-00000000-00000000-00000000
                              last-boot-record ( RO): ''
                                   resident-on ( RO): 230365b3-4916-43bc-8a25-65c000b6937e
                                      affinity ( RW): <not in database>
                                  other-config (MRW): xo:base_delta: 8a757bfb-e932-0284-e955-c3dddd5d1d4d; xo:backup:schedule: one-time; xo:backup:job: 68009e5a-fd8f-481f-94e7-ec11b197a2e3; xo:backup:sr: d47ab4ba-7e64-3ad3-e729-6d15719ca26a; xo:backup:datetime: 20240418T10:00:16Z; xo:backup:vm: 8a757bfb-e932-0284-e955-c3dddd5d1d4d; xo:8a757bfb: {"creation":{"date":"2024-04-18T09:20:43.171Z","template":"1c33af1c-e919-418c-ad45-85d7d6fb604a","user":"00b23cda-6f3e-42a0-ac32-8074336f5363"}}; base_template_name: Windows Server 2022 (64-bit); import_task: OpaqueRef:a775fe45-36e8-435f-8919-21dced27a55a; mac_seed: 154ecbda-6194-7f18-15ed-209815894afa; install-methods: cdrom; xo:copy_of: dc82eb93-fae9-4356-bda2-b71d37dd1440
                                        dom-id ( RO): 21
                               recommendations ( RO): <restrictions><restriction field="memory-static-max" max="1649267441664"/><restriction field="vcpus-min" min="2"/><restriction field="vcpus-max" max="32"/><restriction field="has-vendor-device" value="true"/><restriction field="allow-network-sriov" value="1"/><restriction field="supports-bios" value="yes"/><restriction field="supports-uefi" value="yes"/><restriction field="supports-secure-boot" value="yes"/><restriction max="255" property="number-of-vbds"/><restriction max="7" property="number-of-vifs"/></restrictions>
                                 xenstore-data (MRW): vm-data/mmio-hole-size: 268435456; vm-data:
                    ha-always-run ( RW) [DEPRECATED]: false
                           ha-restart-priority ( RW):
                                         blobs ( RO):
                                    start-time ( RO): 20240418T10:01:09Z
                                  install-time ( RO): 19700101T00:00:00Z
                                  VCPUs-number ( RO): 6
                             VCPUs-utilisation (MRO): 0: 0.014; 1: 0.019; 2: 0.012; 3: 0.014; 4: 0.012; 5: 0.010
                                    os-version (MRO): name: Microsoft Windows Server 2022 Standard|C:\WINDOWS|\Device\Harddisk0\Partition3; distro: windows; major: 10; minor: 0; spmajor: 0; spminor: 0
                            PV-drivers-version (MRO):
            PV-drivers-up-to-date ( RO) [DEPRECATED]: true
                                        memory (MRO):
                                         disks (MRO):
                                          VBDs (SRO): 3ff10668-2513-0308-61dc-6cb16eaccd7f
                                      networks (MRO): 0/ip: 10.1.3.192; 0/ipv4/0: 10.1.3.192; 0/ipv6/0: fe80:0000:0000:0000:3244:e07f:54d8:e112
                           PV-drivers-detected ( RO): true
                                         other (MRO): platform-feature-xs_reset_watches: 1; platform-feature-multiprocessor-suspend: 1; has-vendor-device: 0; feature-xs-batcmd: 1; feature-wuRebootRequired: 1; feature-updatetime: 1; feature-ts2: 1; feature-ts: 1; data-cant-suspend-reason: {"error":{"class":"GenericError","desc":"State blocked by non-migratable device '0000:00:07.0/nvme'","data":{}},"id":"qmp-000245-21"}; feature-static-ip-setting: 1; feature-shutdown: 1; feature-setcomputername: 1; feature-s4: 1; feature-s3: 1; feature-reboot: 1; feature-poweroff: 1; feature-laptop-slate-mode: 1; feature-balloon: 1; data-ts: 1
                                          live ( RO): true
                    guest-metrics-last-updated ( RO): 20240418T10:01:32Z
                           can-use-hotplug-vbd ( RO): unspecified
                           can-use-hotplug-vif ( RO): true
                      cooperative ( RO) [DEPRECATED]: true
                                          tags (SRW):
                                     appliance ( RW): <not in database>
                             snapshot-schedule ( RW): <not in database>
                              is-vmss-snapshot ( RO): false
                                   start-delay ( RW): 0
                                shutdown-delay ( RW): 0
                                         order ( RW): 0
                                       version ( RO): 0
                                 generation-id ( RO): 378209165448628250:411053949495876535
                     hardware-platform-version ( RO): 0
                             has-vendor-device ( RW): false
                               requires-reboot ( RO): false
                               reference-label ( RO): windows-server-2022-64bit
                                  bios-strings (MRO): bios-vendor: Xen; bios-version: ; system-manufacturer: Xen; system-product-name: HVM domU; system-version: ; system-serial-number: ; baseboard-manufacturer: ; baseboard-product-name: ; baseboard-version: ; baseboard-serial-number: ; baseboard-asset-tag: ; baseboard-location-in-chassis: ; enclosure-asset-tag: ; hp-rombios: ; oem-1: Xen; oem-2: MS_VM_CERT/SHA1/bdbeb6e0a816d43fa6d3fe8aaef04c2bad9d3e3d
        
        
        
        1 Reply Last reply Reply Quote 0
        • olivierlambertO Offline
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by

          @OhSoNoob said in VM's from ESXi, live migration not possible:

          data-cant-suspend-reason: {"error":{"class":"GenericError","desc":"State blocked by non-migratable device '0000:00:07.0/nvme'","data":{}},"id":"qmp-000253-22"}

          Are you using a PCI passthrough or something in the CTX VM? Because that's the issue here: inside the VM, there's a device that can't be suspended.

          OhSoNoobO 1 Reply Last reply Reply Quote 0
          • OhSoNoobO Offline
            OhSoNoob @olivierlambert
            last edited by

            @olivierlambert I am not using any kind of PCI passthrough, but it seems like the storage device for xcp-ng is not using the correct driver.

            This is the result of the migrated CTX servers (now using a different server as example, but the result is the same):

            02dc1378-09e6-4600-a1b3-9a1be2cbdecc-image.png

            With the test server:
            1288f4b8-9925-4d9b-b7b7-518424560d72-image.png

            however, just changing the storage driver doesn't seem to work. Any experience or tips with this?

            1 Reply Last reply Reply Quote 0
            • olivierlambertO Offline
              olivierlambert Vates 🪐 Co-Founder CEO
              last edited by olivierlambert

              Okay so the Xen PV driver for storage isn't working correctly in the problematic VM, so the storage can't be suspended to do a live migration. That's causing your issue 🙂

              I don't know why the device isn't working correctly (maybe try to reinstall the tools?), but as soon it does, live migrate should work.

              OhSoNoobO 1 Reply Last reply Reply Quote 0
              • OhSoNoobO Offline
                OhSoNoob @olivierlambert
                last edited by

                @olivierlambert The problem with fully installing the tools is our antivirus solution SentinelOne. Simply pausing the agent + reboot gave the XenTools the possibility to install succesfully. After a succesfull installation, enabling the SentinelOne agent again is possible without any other issues regarding the tools or drivers.

                G 1 Reply Last reply Reply Quote 2
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  Oh great news then!!! 🍾

                  So now you can live migrate and such, right?

                  OhSoNoobO 1 Reply Last reply Reply Quote 0
                  • OhSoNoobO Offline
                    OhSoNoob @olivierlambert
                    last edited by

                    @olivierlambert Yes! Live migration is now available and working. Which is great!

                    1 Reply Last reply Reply Quote 0
                    • olivierlambertO Offline
                      olivierlambert Vates 🪐 Co-Founder CEO
                      last edited by

                      Excellent news! Thank you very much for the feedback, it might be helpful for others 👍

                      Enjoy XCP-ng and XO!

                      1 Reply Last reply Reply Quote 0
                      • olivierlambertO olivierlambert marked this topic as a question on
                      • olivierlambertO olivierlambert has marked this topic as solved on
                      • G Offline
                        glatour @OhSoNoob
                        last edited by

                        @OhSoNoob said in VM's from ESXi, live migration not possible:

                        @olivierlambert The problem with fully installing the tools is our antivirus solution SentinelOne. Simply pausing the agent + reboot gave the XenTools the possibility to install succesfully. After a succesfull installation, enabling the SentinelOne agent again is possible without any other issues regarding the tools or drivers.

                        Thank you for that find, I was in the same boat.

                        1 Reply Last reply Reply Quote 1
                        • olivierlambertO Offline
                          olivierlambert Vates 🪐 Co-Founder CEO
                          last edited by

                          Oh wow, I couldn't think it would have been helpful that fast!! I think I might update our documentation page about Windows tools and this issue.

                          G 1 Reply Last reply Reply Quote 0
                          • olivierlambertO Offline
                            olivierlambert Vates 🪐 Co-Founder CEO
                            last edited by

                            Done: https://docs.xcp-ng.org/troubleshooting/windows-pv-tools/#not-all-pv-drivers-are-correctly-installed

                            G 1 Reply Last reply Reply Quote 0
                            • G Offline
                              glatour @olivierlambert
                              last edited by

                              @olivierlambert said in VM's from ESXi, live migration not possible:

                              Oh wow, I couldn't think it would have been helpful that fast!! I think I might update our documentation page about Windows tools and this issue.

                              Yes, take a look at ticket #7723929. There is also something about shrinking a Windows partition using Linux tools and avoid data loss that could be added to the doc.

                              olivierlambertO 1 Reply Last reply Reply Quote 0
                              • G Offline
                                glatour @olivierlambert
                                last edited by

                                @olivierlambert said in VM's from ESXi, live migration not possible:

                                Done: https://docs.xcp-ng.org/troubleshooting/windows-pv-tools/#not-all-pv-drivers-are-correctly-installed

                                wow that was fast, thank you!

                                1 Reply Last reply Reply Quote 0
                                • olivierlambertO Offline
                                  olivierlambert Vates 🪐 Co-Founder CEO @glatour
                                  last edited by olivierlambert

                                  @glatour Where would you add this in our doc? (the shrink tip)

                                  G 1 Reply Last reply Reply Quote 0
                                  • G Offline
                                    glatour @olivierlambert
                                    last edited by

                                    @olivierlambert said in VM's from ESXi, live migration not possible:

                                    @glatour Where would you add this in our doc? (the shrink tip)

                                    There: https://docs.xcp-ng.org/guides/shrink_virtual_drive/ under the Windows VMs part.

                                    1 Reply Last reply Reply Quote 0
                                    • olivierlambertO Offline
                                      olivierlambert Vates 🪐 Co-Founder CEO
                                      last edited by

                                      On it!

                                      1 Reply Last reply Reply Quote 0
                                      • olivierlambertO Offline
                                        olivierlambert Vates 🪐 Co-Founder CEO
                                        last edited by

                                        Done: https://docs.xcp-ng.org/guides/shrink_virtual_drive/#pre-requisites

                                        1 Reply Last reply Reply Quote 0

                                        Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                        Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                        With your input, this post could be even better 💗

                                        Register Login
                                        • First post
                                          Last post