Nested Virtualization in xcp-ng
-
Nested virtualization doesn’t work very well in Xen. For example, when I set up a small test playground, I had XCP-ng 8.3 as the primary host and another XCP-ng running on it as a nested host. When I then booted Debian 12 on the nested host, it caused the entire nested host to crash and reboot. On the other hand, Windows VMs on the nested host run quite well.
Later, when I was preparing a test lab, I installed ESXi 8.0U3e on a Dell server and then deployed four virtualized XCP-ng 8.3 hosts on top of it. A number of Linux and Windows VMs run on them without any issues.
Did you follow the official documentation for nested virtualization?
https://docs.xcp-ng.org/guides/xcpng-in-a-vm/#nested-xcp-ng-using-xcp-ng
Most importantly setting via command line on pool master:
xe vm-param-set uuid=<UUID> platform:exp-nested-hvm=trueand
xe vm-param-set uuid=<UUID> platform:nic_type="e1000" -
@MajorP93 Sure I did
-
-
@MajorP93 Overall it works, Windows VMs run more or less reliably, but I wasn’t able to resolve the nested host crashing when starting Debian. That’s why I put the free version of ESXi underneath the nested XCP-ng hosts, and that works reliably.
-
@abudef this causes some vms not to boot
-
@abudef this causes some vms not to boot
You mean that when you enable
Nested virtualizationin the VM settings under theAdvancedtab, the VM then fails to boot? -
@abudef exactly
-
@AlexanderK Nested virtualisation still need lot of development to be functional reliably - see https://www.youtube.com/watch?v=8jKGYY1Bi_o and https://www.youtube.com/watch?v=3MxWvVTmY1s
-
In theory Harvester supports nested virtualization, but I haven't tried it yet. Might be worth setting up a single host to try it. I think Proxmox also supports it, again might be worth a single host if that would handle the load.
-
@abudef Some quotes from the documentation to clarify the situation: https://docs.xcp-ng.org/compute/#-nested-virtualization
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login