<![CDATA[Problem with importing large VMDK disks]]>Hello,
I ran into a problem when importing VMDK disks using Xen Orchestra. Importing a large (100 GiB) VMDK disk runs out of RAM in the Debian virtual machine running Xen Orchestra. The import process basically ends and XO is unavailable or very slow and needs to be restarted. First I had a virtual with 4 GiB RAM for XO, then I tried to increase it to 8 GiB, but the problem happened again. When importing the VHD file (100 GiB as well), the problem does not seem to occur.

2d0b2aeb-e79c-474d-ab33-fd5815ae69ee-image.png

1df92c6f-2915-4f47-b8f6-dede89bfeab5-image.png

9959908f-7852-44be-8083-9c356244a83f-image.png

f2f26af1-5a53-421c-adaa-0910fa09eaf4-image.png

EDIT:
This is what the memory usage looks like when importing VHD - no problem, the import seems to complete fine:

c5f17e5a-0657-49c5-a10c-89ec0332d2a1-image.png

6b7496c2-1d6e-4ee1-922e-fea803549381-image.png

]]>https://xcp-ng.org/forum/topic/8464/problem-with-importing-large-vmdk-disksRSS for NodeTue, 08 Sep 2026 10:20:09 GMTMon, 26 Feb 2024 12:45:08 GMT60<![CDATA[Reply to Problem with importing large VMDK disks on Mon, 03 Jun 2024 15:56:24 GMT]]>To conclude this: @florent and I discussed the issue in a private conversation. I provided the vmdk file that was causing the problem. It turned out that the problem was caused by the vmdk thin file from VMware Workstation Pro, which has a slightly different structure than the vmdk files on ESXi hypervisors. Currently XO imports these files fine and the problem can be considered solved. Thank you very much @florent for your cooperation and help.

]]>https://xcp-ng.org/forum/post/78264https://xcp-ng.org/forum/post/78264Mon, 03 Jun 2024 15:56:24 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Thu, 29 Feb 2024 08:43:37 GMT]]>@abudef ouch
Would you be able to give me access to this vmdk file ? If you have a XOA, and with your authorization, I could download it through ssh and check here

]]>https://xcp-ng.org/forum/post/72478https://xcp-ng.org/forum/post/72478Thu, 29 Feb 2024 08:43:37 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Wed, 28 Feb 2024 17:02:12 GMT]]>@florent I reproduced the problem on a different environment. Try using a really large file or importing two at once.

56aa6fdf-f197-4258-9cb6-5e70091fb6d4-image.png

46b8b13c-9794-49b3-8e03-0f0a037c1235-image.png

6290f5eb-802a-4846-ac89-fceee4999e42-image.png

]]>https://xcp-ng.org/forum/post/72442https://xcp-ng.org/forum/post/72442Wed, 28 Feb 2024 17:02:12 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Wed, 28 Feb 2024 10:34:21 GMT]]>@abudef I tested with a 50GB file, and the RAM is not changing notably

]]>https://xcp-ng.org/forum/post/72395https://xcp-ng.org/forum/post/72395Wed, 28 Feb 2024 10:34:21 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Wed, 28 Feb 2024 10:31:40 GMT]]>@florent said in Problem with importing large VMDK disks:

thank you
I tried exporting and importing a vmdk locally , and didn't reproduce the memory leak. I will try again with an other configuration ( a slower XCP )

How big was the VMDK file you tried to import? Did the RAM usage grow during the import, as seen in the screenshot above?

In my case, the import was from a pc from which I was connected to XO, whose virtual was running directly on the XCP-ng server into whose local storage the file was being imported.

]]>https://xcp-ng.org/forum/post/72394https://xcp-ng.org/forum/post/72394Wed, 28 Feb 2024 10:31:40 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Wed, 28 Feb 2024 09:40:15 GMT]]>@abudef said in Problem with importing large VMDK disks:

@olivierlambert Thanks for the good news!

I've used VMware for years. ESXi as a server hypervisor and VMware Workstation Pro on the desktop. Even for some labs and test environments I got by with the free version of ESXi with limited APIs. The new licensing policy does not suit me and my companions at all and as a bonus Broadcom has cut the free version of ESXi. Bravo! I think Broadcom should get the award for best marketing of XCP-ng, H-V, Citrix etc. for 2024 🙂

On desktops, I need to keep VMware Workstation Pro for many reasons. That's why I was impressed by the videos @lawrencesystems made about XCP-ng & Xen Orchestra. The capabilities that are close to vSphere and vCentre, the ability to import and export VMDK so easily through XO blew me away. And to top it all off, transferring VMDK disks through XO works noticeably faster than migrating VMs between VMw WS and ESXi!

thank you
I tried exporting and importing a vmdk locally , and didn't reproduce the memory leak. I will try again with an other configuration ( a slower XCP )

]]>https://xcp-ng.org/forum/post/72378https://xcp-ng.org/forum/post/72378Wed, 28 Feb 2024 09:40:15 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Mon, 26 Feb 2024 22:24:50 GMT]]>@olivierlambert Thanks for the good news!

I've used VMware for years. ESXi as a server hypervisor and VMware Workstation Pro on the desktop. Even for some labs and test environments I got by with the free version of ESXi with limited APIs. The new licensing policy does not suit me and my companions at all and as a bonus Broadcom has cut the free version of ESXi. Bravo! I think Broadcom should get the award for best marketing of XCP-ng, H-V, Citrix etc. for 2024 🙂

On desktops, I need to keep VMware Workstation Pro for many reasons. That's why I was impressed by the videos @lawrencesystems made about XCP-ng & Xen Orchestra. The capabilities that are close to vSphere and vCentre, the ability to import and export VMDK so easily through XO blew me away. And to top it all off, transferring VMDK disks through XO works noticeably faster than migrating VMs between VMw WS and ESXi!

]]>https://xcp-ng.org/forum/post/72258https://xcp-ng.org/forum/post/72258Mon, 26 Feb 2024 22:24:50 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Mon, 26 Feb 2024 21:50:02 GMT]]>Yes, that's not a normal behavior. @florent is pretty busy ATM because we are about to release XO 5.92 soon, but after that, he'll come here 🙂

]]>https://xcp-ng.org/forum/post/72256https://xcp-ng.org/forum/post/72256Mon, 26 Feb 2024 21:50:02 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Mon, 26 Feb 2024 21:48:37 GMT]]>@planedrop These disk files belong to VMware Workstation Pro virtual machines, not ESXi. I converted the files to VHD as a workaround, but it would still be good to get a fix for XO.

]]>https://xcp-ng.org/forum/post/72255https://xcp-ng.org/forum/post/72255Mon, 26 Feb 2024 21:48:37 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Mon, 26 Feb 2024 20:11:24 GMT]]>You're importing the VMDK files themselves right, not migrating directly from ESXi? If migrating off ESXi, it may be worth trying the Import from VMware feature.

]]>https://xcp-ng.org/forum/post/72249https://xcp-ng.org/forum/post/72249Mon, 26 Feb 2024 20:11:24 GMT<![CDATA[Reply to Problem with importing large VMDK disks on Mon, 26 Feb 2024 12:49:09 GMT]]>Ping @florent

]]>https://xcp-ng.org/forum/post/72189https://xcp-ng.org/forum/post/72189Mon, 26 Feb 2024 12:49:09 GMT