Nested Virtualization of Windows Hyper-V on XCP-ng
-
@AlexanderK VMWare setup had UEFI BIOS, when I'm portable on my laptop I use Hyper-V built into Win10Pro, it also uses UEFI / Gen2, in XCP-ng I tried both BIOS and UEFI settings. BIOS doesn't boot, checked just for the record. UEFI booting works, but UEFI+Nested-V doesn't (causes Win10 to troubleshoot itself). So it doesn't seem like partition recognition problem, it feels like Windows + Virtual Hardware to me (but may be UEFI image also matters, in my experience in different envs yes it might).
-
@clockware ok i misunderstood...
-
Is there any updates on nested virtualization and hyper-v?
I've tried to run docker on windows 10 vm and didn't succeed on this.
-
Sadly, there's not a lot of market traction for it. Obviously, contributions are very welcome, otherwise, it won't make progress by itself (not until we continue to grow enough to tackle more stuff in our backlog at once. Note: we almost made +30% in headcount just in 2022, so it's moving fast, but still plenty to do and we can't do everything!)
-
@olivierlambert thank you for your comment.
-
I am finding myself in this really unfortunate situation. We want to use Microsoft Connected Cache which requires Hyper-V. Microsoft Connected Cache is a way to cache inTune installation packages to reduce internet usage.
-
Is there any news about Nested Hyper-V support?
-
I'm not aware about any progress on that direction. It's more like an upstream Xen Project question by the way, you might ask on the Xen Project Matrix community: https://xenproject.org/help/matrix/
-
@olivierlambert Okay. Thank you.
-
@olivierlambert thanks. I asked. No estimate.
-
Though a little old this is the only thread that seems applicable to my needs right now... Do we have any ideas on when this might become available in Xen?
I have a client that needs to use part of Hyper-V for an application they are using. Are there any workarounds? I see Proxmox seems to support this, but I haven't tested.
Thanks!
-
There was a talk in Xen Summit about what needs to be done to complete Nested Virtualization support, but I don't know if anyone in the Xen Project followed-up.
-
@stormi Bummer... Because I really could use the ability to run Hyper-V in a Windows Server VM... It's needed for a certain application that a client of mine uses.
-
@FTSSupport I'd first consider talking to the client and/or the clients vendor that is requiring this. Nested virtualization, even on setups that work, is NEVER recommended for something that requires good up time and reliability, so it might be best to avoid this.
I have had issues with nested virt in ProxMox as well, admittedly less than in XCP-ng, but it's still not good enough on either that I'd use it consistently.
Is there a reason the application needs Hyper-V? The reason I ask is, I've had something similar due to a vendor who required ESXi for their VMs. Turns out there was no good reason for that and we ended up having to spend a ton of money for no real benefit. Has created more headaches down the road too w/ lack of central backups, etc... and massive wasted resources (time, money, all of the above). The vendor has since said they'll help us move to XCP-ng, but it's a big process and there was no reason for ESXi in the first place.
So maybe, just maybe, there's a chance the vendor/application developer can be convinced otherwise? One of the points of virtualization is keeping options open.
-
@planedrop Just to keep things cohesive in these threads, I'm linking my response https://xcp-ng.org/forum/post/81103
But yeah I may take your advice and call the vendor.
-
i was searching for nested virtualization on windows vm because i wanted to install docker desktop and nested virtualization should have been enabled
-
@AlexanderK Right, which in some ways in similar in what I'm needing, because there are applications that need Hyper-V.
-
@FTSSupport Gotcha, yeah I think the first step would be finding out if there are workarounds from the vendor, then go from there if there aren't. May just require spinning up a physical Hyper-V box, but that would definitely suck. The entire idea of hypervisors was to not have to run so many different bare metal installs of things lol.
Good luck!
I may play around with nested Hyper-V here soon to see what I can get working, but honestly I'd still avoid it EVEN IF we can get it working stable, could be a headache to troubleshoot down the road.
-
@planedrop In general, the fact is that the current XCP-ng 8.3 RC1 and XenServer 8 simply do not support any kind of nested virtualization. For example, when I want to try a mock setup of say 5 hypervisors, I just don't buy or dedicate 5 hw servers and rather make virtualized hypervisors. And for the record, I'm referring to the lab environment for debugging configurations and scenarios, not production.
P. S.: In more legacy Xen, which is part of XCP-ng 8.2, nested virtualization works.
-
Sure but the solution to that is usually to buy a single server and then try each hypervisor on it in a lab type setup to see which you prefer the best.
I still agree that it would be nice to have 1 box that runs them all, for sure, but there aren't any that can actually do that.
