Error importing vhd or VM

Gheppy

@olivierlambert
I have no internet for this network

olivierlambert

Then use xe CLI to import manually the XVA. But you'll need to update XOA with an internet access, in order to be on latest version.

Gheppy

@olivierlambert

I managed to import it with XCP-ng Center (it was easier that way). After the update to latest, the same problem.
xo-server 5.109.0 xo-web 5.111.0

Edit:
Downgrade to stable the same problem, but after 2 minutes of transfer
xo-server 5.107.5 xo-web 5.109.0

olivierlambert

Is it possible to have access to this VHD file?

Gheppy

@olivierlambert
Ill share this vhd

On XOA stable I exported the VM and imported and all is ok, but on XOA I cant export VHD file ( no options)

Edit:
On XOA latest, I exported the VM (xva) and imported with no success

olivierlambert

You can export a VHD in XO. On the SR/disk tab, you should have an "export" icon to get the VHD.

Gheppy

@olivierlambert
This is what I have on XO on SR/disk tab

And this on XOCE

olivierlambert

Yes, that's the export button. Are you on XOA Free for the first screenshot?

Gheppy

@olivierlambert
yes, I use XOA Free

olivierlambert

Can you try on XOA in trial? (if you trial expired, PM me your registered email so I can extend it)

Gheppy

I don't know how, but:

XOA trial export can be imported with XOCE commit cf4a1d7d40a16f08122ce7487dce7c8ab9d73513
XOCE export can not be imported with XOA trial
XOA trial export can not be imported with the same XOA trial

I tested this 3 times with the same result

Edit:
I update XOCE in this morning and:

XOCE commit cf4a1d7d40a16f08122ce7487dce7c8ab9d73513 export, now can be imported with XOCE same commit, but not with XOA trial
XOCE commit 675405f7ace55411b1ca0bbed8b9e31504fcc387 export can be imported with XOCE commit cf4a1d7d40a16f08122ce7487dce7c8ab9d73513, but not with XOA trial

I'll downgrade to XOCE commit 675405f7ace55411b1ca0bbed8b9e31504fcc387 to see what happens when I import XOCE commit cf4a1d7d40a16f08122ce7487dce7c8ab9d73513 export

Edit2:
It seems that the problem no longer appears after the commit cf4a1d7d40a16f08122ce7487dce7c8ab9d73513, for now
I still can't import with XOA trial, both VMs (XOA and XOCE) are on the same server.

Gheppy

With commit 9ff305d5db2028c989df4b362db828f5bbb5b1b3, I get this error and can't export VM or VHD

HTTP handler of vm.import
undefined
{
  "message": "Xapi#watchTask() requires events watching",
  "name": "Error",
  "stack": "Error: Xapi#watchTask() requires events watching
    at Xapi.watchTask (/opt/xen-orchestra/packages/xen-api/src/index.js:691:13)
    at Xapi.createTask (/opt/xen-orchestra/packages/xen-api/src/index.js:636:10)
    at runNextTicks (node:internal/process/task_queues:60:5)
    at processImmediate (node:internal/timers:447:9)
    at process.callbackTrampoline (node:internal/async_hooks:130:17)
    at Xapi._importVm (file:///opt/xen-orchestra/packages/xo-server/src/xapi/index.mjs:662:21)
    at Xapi.importVm (file:///opt/xen-orchestra/packages/xo-server/src/xapi/index.mjs:795:48)"
}

And I get this on tasks

julien-f

@Gheppy I've just pushed a fix for this, I'm still investigating some issues regarding VDI upload, I'll let you know.

https://github.com/vatesfr/xen-orchestra/commit/9f4fce9daa75b418d099928d1ab37a0b2cdd3078

0

julien-f committed to vatesfr/xen-orchestra

fix(xen-api): fix task watchers when initially not watching events

Introduced by bc61dd85c

julien-f

~~@Gheppy I've identified the root cause, I'm waiting for Node.js' devs feedback before pushing a fix.~~

~~In the meantime you can work-around it by setting this in your xo-server's config:~~

[http.listenOptions]
requestTimeout = 0

Edit: This work-around is broken (c.f. this GitHub issue) and should not be used. Also, it's no longer necessary, XO integrates the necessary work-around.

Gheppy

thank you

olivierlambert

Is it solving your issue @Gheppy ?

Gheppy

I didn't have time to test it, I will test it tomorrow

Edit:
I couldn't resist and I tested. Commit 817911a41eecdb3cc8a72db5f290ddacdd4f9873
VHD and XVA export is ok now.
But the import doesn't work, at XVA the log is below,
at VHD it's just this:

Import
NetworkError when attempting to fetch resource.

XVA

HTTP handler of vm.import
undefined
{
  "canceled": false,
  "method": "PUT",
  "url": "https://192.168.50.15/import/?sr_id=OpaqueRef%3A1b216555-dd05-4896-adff-97500b08d71d&session_id=OpaqueRef%3Accd20125-ca72-4a69-9414-9386774034c6&task_id=OpaqueRef%3A95850c5c-1a3d-4ae8-8d6e-c4b931fb6c2d",
  "timeout": false,
  "pool_master": {
    "uuid": "3761cfe9-d13f-400c-ac0b-79c749ddcea3",
    "name_label": "tb-vrs5",
    "name_description": "Default install",
    "memory_overhead": 1170796544,
    "allowed_operations": [
      "vm_migrate",
      "provision",
      "vm_resume",
      "evacuate",
      "vm_start"
    ],
    "current_operations": {},
    "API_version_major": 2,
    "API_version_minor": 16,
    "API_version_vendor": "XenSource",
    "API_version_vendor_implementation": {},
    "enabled": true,
    "software_version": {
      "product_version": "8.2.1",
      "product_version_text": "8.2",
      "product_version_text_short": "8.2",
      "platform_name": "XCP",
      "platform_version": "3.2.1",
      "product_brand": "XCP-ng",
      "build_number": "release/yangtze/master/58",
      "hostname": "localhost",
      "date": "2022-10-12",
      "dbv": "0.0.1",
      "xapi": "1.20",
      "xen": "4.13.4-9.28.1",
      "linux": "4.19.0+1",
      "xencenter_min": "2.16",
      "xencenter_max": "2.16",
      "network_backend": "openvswitch",
      "db_schema": "5.602"
    },
    "other_config": {
      "agent_start_time": "1675360550.",
      "boot_time": "1675235216.",
      "rpm_patch_installation_time": "1675234725.363",
      "iscsi_iqn": ""
    },
    "capabilities": [
      "xen-3.0-x86_64",
      "hvm-3.0-x86_32",
      "hvm-3.0-x86_32p",
      "hvm-3.0-x86_64",
      ""
    ],
    "cpu_configuration": {},
    "sched_policy": "credit",
    "supported_bootloaders": [
      "pygrub",
      "eliloader"
    ],
    "resident_VMs": [
      "OpaqueRef:18c56110-e1c1-425e-ada1-ac18153e3f5a",
      "OpaqueRef:ea3e623a-944f-4897-a80d-24e22eefe137",
      "OpaqueRef:c11aa056-f3a8-4fef-86be-a55b57215e2b",
      "OpaqueRef:b194d179-a0dc-449f-a55e-0032667f64ae",
      "OpaqueRef:8d927989-7ed7-4e95-b3ed-1f3d6601cc4e",
      "OpaqueRef:40eef76b-9536-4bed-b929-d219a2464f59"
    ],
    "logging": {},
    "PIFs": [
      "OpaqueRef:f55c4134-956b-417c-84e9-6c6c8ed8d1e7",
      "OpaqueRef:e43992a1-a4d0-4026-b827-f34013d0cd97",
      "OpaqueRef:ddd96672-8135-41e1-97ad-70a6bab87921",
      "OpaqueRef:7294bdb2-7ea9-4afe-a27c-10d25cb498d9",
      "OpaqueRef:39d7caf1-b53f-4f07-b876-00fdecd7287c"
    ],
    "suspend_image_sr": "OpaqueRef:5b74a9c8-494d-43a9-b4b8-9ddbc992b6f8",
    "crash_dump_sr": "OpaqueRef:5b74a9c8-494d-43a9-b4b8-9ddbc992b6f8",
    "crashdumps": [],
    "patches": [],
    "updates": [],
    "PBDs": [
      "OpaqueRef:e5e5918b-9fdc-4931-8b3a-7ce4f08f4c29",
      "OpaqueRef:81cf9cc0-688a-44c2-aec1-664e4fe77ab7",
      "OpaqueRef:5d84ab54-fbf8-4479-9c21-76283b7e388c",
      "OpaqueRef:44bc052f-7af8-40a7-b60b-eebc415cdf61",
      "OpaqueRef:2b01472b-dbe3-4b00-844d-f06111eb0e07",
      "OpaqueRef:0db30152-229c-45f0-81c9-966c81cbe0f2"
    ],
    "host_CPUs": [
      "OpaqueRef:707e527f-d2ea-4d5e-99cf-660acfdae26d",
      "OpaqueRef:a7f5b11f-aa52-4d98-a143-90ca164aa8a1",
      "OpaqueRef:b172ae9f-7ff6-4296-8ccb-bc75df962a87",
      "OpaqueRef:2069ecf8-c0d6-49c5-86b8-4f3dcf2a3e21",
      "OpaqueRef:8ed522bc-019c-466f-bff0-740bb71cb690",
      "OpaqueRef:fa402000-ecd8-43ad-88e7-7a1cfe714549",
      "OpaqueRef:d4efcdad-1b16-4965-b911-9b59aa2f4e3a",
      "OpaqueRef:3820e862-ad6a-421b-a440-0fdb34596297",
      "OpaqueRef:724c603c-dcfe-4364-9032-44ee0805601e",
      "OpaqueRef:12cad0c2-cbf0-4458-a63a-100fbe627214",
      "OpaqueRef:71d1ef1c-9acd-4941-8ce6-d05478494173",
      "OpaqueRef:1c11959a-fa41-4eb2-bcba-ea4ef231d5e5",
      "OpaqueRef:f9ac766e-542a-4d4d-b755-7e97f7d1141e",
      "OpaqueRef:d99b5d55-d953-4807-9daa-164c61fba58b",
      "OpaqueRef:64a5bb52-0086-4e61-b70b-3e8fb3798318",
      "OpaqueRef:50cdb2c8-4d9d-4064-b23d-6e5776e55009",
      "OpaqueRef:45f45e26-5586-417f-beba-64e0e6f35232",
      "OpaqueRef:331f85f6-d60a-4a85-b0e2-7bbd93b52045",
      "OpaqueRef:279bf7d9-8379-43c3-975e-6e4561038862",
      "OpaqueRef:28608bc2-9483-4ee9-ae6c-1bf62aeb034b",
      "OpaqueRef:aa918c64-5718-4be2-bba3-086584f0bc73",
      "OpaqueRef:e14ffa7b-89c3-4f2f-a8c3-d746d7cac735",
      "OpaqueRef:ccf57b68-a7cd-45d5-acbb-fd5503ef10f6",
      "OpaqueRef:efc70933-6b6d-45b3-8154-c07e4d0127c8"
    ],
    "cpu_info": {
      "cpu_count": "24",
      "socket_count": "2",
      "vendor": "GenuineIntel",
      "speed": "2399.945",
      "modelname": "Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz",
      "family": "6",
      "model": "63",
      "stepping": "2",
      "flags": "fpu de tsc msr pae mce cx8 apic sep mca cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall nx rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid pni pclmulqdq monitor est ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm cpuid_fault intel_ppin ssbd ibrs ibpb stibp fsgsbase bmi1 avx2 bmi2 erms xsaveopt",
      "features_pv": "1fc9cbf5-f6f83203-2991cbf5-00000023-00000001-00000329-00000000-00000000-00001000-8c000400-00000000-00000000-00000000-00000000-00000000-00000000-00000000-00000000",
      "features_hvm": "1fcbfbff-f7fa3223-2d93fbff-00000423-00000001-000007ab-00000000-00000000-00001000-9c000400-00000000-00000000-00000000-00000000-00000000-00000000-00000000-00000000",
      "features_hvm_host": "1fcbfbff-f7fa3223-2c100800-00000021-00000001-000007ab-00000000-00000000-00001000-9c000400-00000000-00000000-00000000-00000000-00000000-00000000-00000000-00000000",
      "features_pv_host": "1fc9cbf5-f6f83203-28100800-00000021-00000001-00000329-00000000-00000000-00001000-8c000400-00000000-00000000-00000000-00000000-00000000-00000000-00000000-00000000"
    },
    "hostname": "tb-vrs5",
    "address": "10.1.60.23",
    "metrics": "OpaqueRef:abfd9105-b98f-4f3e-a25d-f0ed6d2362f0",
    "license_params": {
      "restrict_vswitch_controller": "false",
      "restrict_lab": "false",
      "restrict_stage": "false",
      "restrict_storagelink": "false",
      "restrict_storagelink_site_recovery": "false",
      "restrict_web_selfservice": "false",
      "restrict_web_selfservice_manager": "false",
      "restrict_hotfix_apply": "false",
      "restrict_export_resource_data": "false",
      "restrict_read_caching": "false",
      "restrict_cifs": "false",
      "restrict_health_check": "false",
      "restrict_xcm": "false",
      "restrict_vm_memory_introspection": "false",
      "restrict_batch_hotfix_apply": "false",
      "restrict_management_on_vlan": "false",
      "restrict_ws_proxy": "false",
      "restrict_vlan": "false",
      "restrict_qos": "false",
      "restrict_pool_attached_storage": "false",
      "restrict_netapp": "false",
      "restrict_equalogic": "false",
      "restrict_pooling": "false",
      "enable_xha": "true",
      "restrict_marathon": "false",
      "restrict_email_alerting": "false",
      "restrict_historical_performance": "false",
      "restrict_wlb": "false",
      "restrict_rbac": "false",
      "restrict_dmc": "false",
      "restrict_checkpoint": "false",
      "restrict_cpu_masking": "false",
      "restrict_connection": "false",
      "platform_filter": "false",
      "regular_nag_dialog": "false",
      "restrict_vmpr": "false",
      "restrict_vmss": "false",
      "restrict_intellicache": "false",
      "restrict_gpu": "false",
      "restrict_dr": "false",
      "restrict_vif_locking": "false",
      "restrict_storage_xen_motion": "false",
      "restrict_vgpu": "false",
      "restrict_integrated_gpu_passthrough": "false",
      "restrict_vss": "false",
      "restrict_guest_agent_auto_update": "false",
      "restrict_pci_device_for_auto_update": "false",
      "restrict_xen_motion": "false",
      "restrict_guest_ip_setting": "false",
      "restrict_ad": "false",
      "restrict_nested_virt": "false",
      "restrict_live_patching": "false",
      "restrict_set_vcpus_number_live": "false",
      "restrict_pvs_proxy": "false",
      "restrict_igmp_snooping": "false",
      "restrict_rpu": "false",
      "restrict_pool_size": "false",
      "restrict_cbt": "false",
      "restrict_usb_passthrough": "false",
      "restrict_network_sriov": "false",
      "restrict_corosync": "true",
      "restrict_zstd_export": "false",
      "restrict_pool_secret_rotation": "false"
    },
    "ha_statefiles": [],
    "ha_network_peers": [],
    "blobs": {},
    "tags": [],
    "external_auth_type": "",
    "external_auth_service_name": "",
    "external_auth_configuration": {},
    "edition": "xcp-ng",
    "license_server": {
      "address": "localhost",
      "port": "27000"
    },
    "bios_strings": {
      "bios-vendor": "LENOVO",
      "bios-version": "-[-3.70]-",
      "system-manufacturer": "LENOVO",
      "system-product-name": "System x3650 M5: -[]-",
      "system-version": "11",
      "system-serial-number": "",
      "baseboard-manufacturer": "LENOVO",
      "baseboard-product-name": "",
      "baseboard-version": "NULL",
      "baseboard-serial-number": "",
      "oem-1": "Xen",
      "oem-2": "MS_VM_CERT/SHA1/bdbeb6e0a816d43fa6d3fe8aaef04c2bad9d3e3d",
      "oem-3": "LENOVO SystemX",
      "hp-rombios": ""
    },
    "power_on_mode": "",
    "power_on_config": {},
    "local_cache_sr": "OpaqueRef:5b74a9c8-494d-43a9-b4b8-9ddbc992b6f8",
    "chipset_info": {
      "iommu": "true"
    },
    "PCIs": [
      "OpaqueRef:e061855f-c434-44af-b3e5-96b9c734655b",
      "OpaqueRef:84f7e49c-0739-4e24-953a-218ba4a1c712",
      "OpaqueRef:792bb0aa-83a3-4c66-a608-b287266900e5",
      "OpaqueRef:76bdb3de-61f2-42aa-a80d-608ed487d5a3",
      "OpaqueRef:4f033009-b938-4886-929b-576e6b442028",
      "OpaqueRef:261a4a88-33b1-4ca7-be27-4db4044e89ba"
    ],
    "PGPUs": [
      "OpaqueRef:2bb134ac-3b00-4a56-b5d1-051b97c59f4b"
    ],
    "PUSBs": [],
    "ssl_legacy": false,
    "guest_VCPUs_params": {},
    "display": "enabled",
    "virtual_hardware_platform_versions": [
      0,
      1,
      2
    ],
    "control_domain": "OpaqueRef:c11aa056-f3a8-4fef-86be-a55b57215e2b",
    "updates_requiring_reboot": [],
    "features": [],
    "iscsi_iqn": "",
    "multipathing": false,
    "uefi_certificates": "",
    "certificates": [],
    "editions": [
      "xcp-ng"
    ]
  },
  "SR": {
    "uuid": "9320bdd2-9be6-d9b1-1e3b-d060177fc413",
    "name_label": "tb-vrs5-RAID",
    "name_description": "tb-vrs5-RAID",
    "allowed_operations": [
      "vdi_enable_cbt",
      "vdi_list_changed_blocks",
      "unplug",
      "plug",
      "pbd_create",
      "vdi_disable_cbt",
      "update",
      "pbd_destroy",
      "vdi_resize",
      "vdi_clone",
      "vdi_data_destroy",
      "scan",
      "vdi_snapshot",
      "vdi_mirror",
      "vdi_create",
      "vdi_destroy",
      "vdi_set_on_boot"
    ],
    "current_operations": {},
    "VDIs": [
      "OpaqueRef:f72dfdd7-d6af-4976-8e04-18f8f6f08900",
      "OpaqueRef:ccf8458a-d5be-4163-8e08-c50d27bdcaa5",
      "OpaqueRef:b458e649-f043-41a3-adcb-c9dd177145a9",
      "OpaqueRef:a4c0db8c-f0dd-41df-be23-9aacfdb16039",
      "OpaqueRef:6986f5bb-7d97-41e4-b945-63cecde195c3",
      "OpaqueRef:55a2cd20-15b9-4cf2-95d1-f8acd7449b85",
      "OpaqueRef:204e518b-cf86-44f2-9fe9-32bddda5dd2a",
      "OpaqueRef:1184bcae-05f8-40f4-84d2-312d711f15a5"
    ],
    "PBDs": [
      "OpaqueRef:0db30152-229c-45f0-81c9-966c81cbe0f2"
    ],
    "virtual_allocation": 440234147840,
    "physical_utilisation": 67782881280,
    "physical_size": 3531525472256,
    "type": "ext",
    "content_type": "user",
    "shared": false,
    "other_config": {
      "auto-scan": "true"
    },
    "tags": [],
    "sm_config": {
      "devserial": "scsi-3600605b00b82f0702a85425815de59da"
    },
    "blobs": {},
    "local_cache_enabled": false,
    "introduced_by": "OpaqueRef:NULL",
    "clustered": false,
    "is_tools_sr": false
  },
  "message": "HTTP connection abruptly closed",
  "name": "Error",
  "stack": "Error: HTTP connection abruptly closed
    at IncomingMessage.emitAbortedError (/opt/xen-orchestra/node_modules/http-request-plus/index.js:83:19)
    at Object.onceWrapper (node:events:627:28)
    at IncomingMessage.emit (node:events:513:28)
    at IncomingMessage.patchedEmit [as emit] (/opt/xen-orchestra/@xen-orchestra/log/configure.js:52:17)
    at IncomingMessage._destroy (node:_http_incoming:224:10)
    at _destroy (node:internal/streams/destroy:109:10)
    at IncomingMessage.destroy (node:internal/streams/destroy:71:5)
    at TLSSocket.socketCloseListener (node:_http_client:462:11)
    at TLSSocket.emit (node:events:525:35)
    at TLSSocket.patchedEmit [as emit] (/opt/xen-orchestra/@xen-orchestra/log/configure.js:52:17)
    at node:net:322:12
    at TCP.done (node:_tls_wrap:588:7)
    at TCP.callbackTrampoline (node:internal/async_hooks:130:17)"
}

Gheppy

@julien-f said in Error importing vhd or VM:

[http.listenOptions]
requestTimeout = 0

With this setting, it works in both directions - import and export. I am on commit 817911a41eecdb3cc8a72db5f290ddacdd4f9873

olivierlambert

Congrats to @julien-f about finding a NodeJS bug

Gheppy

@julien-f @olivierlambert
Thank you for your support,
I am on commit d2a1c02b92dc1bed38bdc7afc081c358dfd11d49 without the settings on xo-server config file and all is back to normal