XCP-ng

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups

    UEFI Setting on VM for nested virtualization?

    Compute
    5
    17
    1473
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Noiden
      Noiden @XCP-ng-JustGreat last edited by

      @xcp-ng-justgreat Hello, I tried that, but got the same error. 😞

      I think on VMware you had to enable it in the BIOS settings,

      51677f42-f9fb-4fff-855e-610e55539381-image.png

      Don't I have to do that on this VM in XCP-ng also? But I can't find any way to get into the BIOS settings, is it because I have UEFI? Or should I not push "DEL" to get into the settings on boot?

      Thanks.

      1 Reply Last reply Reply Quote 0
      • olivierlambert
        olivierlambert Vates 🪐 Founder & CEO 🦸 last edited by

        There's no emulated BIOS with options in XCP-ng. If it's enabled on the VM (nested), it should work.

        If it doesn't, it might be a problem on the guest OS and the nested mechanism.

        Noiden 1 Reply Last reply Reply Quote 0
        • Noiden
          Noiden @olivierlambert last edited by

          @olivierlambert Ok, and nested should work with UEFI? Or should I change to BIOS?

          X 1 Reply Last reply Reply Quote 0
          • olivierlambert
            olivierlambert Vates 🪐 Founder & CEO 🦸 last edited by

            In theory, it's unrelated.

            1 Reply Last reply Reply Quote 0
            • X
              XCP-ng-JustGreat @Noiden last edited by

              @noiden @olivierlambert There are settings in the Tiano UEFI firmware. Can't remember if there is one to turn on guest virtualization. I believe the hotkey to enter is F2. On Windows, if you click the power, restart option while holding down the SHIFT key, it should provide you with advanced startup options one of which is to access UEFI firmware settings.

              Noiden 1 Reply Last reply Reply Quote 0
              • Noiden
                Noiden @XCP-ng-JustGreat last edited by

                @xcp-ng-justgreat I got in there, but there was no settings about that. I should troubleshoot some more, with Hyper-V itself. 🙂

                X 1 Reply Last reply Reply Quote 0
                • X
                  XCP-ng-JustGreat @Noiden last edited by

                  @noiden Assuming the setting preventing processor virtualization is not in UEFI firmware, then keep looking at those obscure new exploit protection settings. I know that disabling CFG solved the problem for us on a physical server where we needed to run Docker containers. I have personally used nested virtualization of a UEFI-booted XCP-ng guest, running on XCP-ng (very cool, it works!) and did not have any problems. Since Docker won't run without the Hyper-V virtualization engine running, I still believe the answer for you lies there.

                  1 Reply Last reply Reply Quote 1
                  • Noiden
                    Noiden last edited by

                    @xcp-ng-justgreat I have checked here, https://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen

                    But I can't really figure out where to set the options,

                    hap=1
                    nestedhvm=1
                    cpuid = ['0x1:ecx=0xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx']
                    

                    I have set theese variables on the VM under vm-param platform and other-config. But that does not help.

                    I have also disabled the CFG on the VM, still no luck though.

                    Thanks.

                    1 Reply Last reply Reply Quote 0
                    • H
                      Haribo112 last edited by

                      I'm currently struggling with the same problem; running Windows Server 2019 on XCP-ng 8.1.0 . I changed the settings hinted at by @XCP-ng-JustGreat but it did not work.

                      X 1 Reply Last reply Reply Quote 0
                      • X
                        XCP-ng-JustGreat @Haribo112 last edited by

                        @haribo112 @Noiden All, from within Windows, when you launch the task manager, performance tab, under CPU details, does it show you that virtualization is enabled? If yes, then the nested virtualization setting in XCP-ng appears to have worked. Try removing the Hyper-V roles and any related virtualization features and dependencies including your container support, reboot and then reinstall them and perform a finishing reboot. Coupled with disabling Control Flow Guard (CFG) for vmcompute.exe, I'm afraid that that's all I've got for you since that is what worked for us.

                        H 1 Reply Last reply Reply Quote 0
                        • H
                          Haribo112 @XCP-ng-JustGreat last edited by

                          @xcp-ng-justgreat I will try that sequence. Obviously, Virtualization Extensions are detected by Windows, or else I wouldn't be able to install the Hyper-V role at all. The CPU performance tab of task manager does not show what you indicated, as it already says "Virtual machine: yes" in that location.

                          Honestly I'm considering rebuilding my homelab as a Hyper-V cluster, but that sucks too because realistically you need a domain controller for that to function properly.

                          X 1 Reply Last reply Reply Quote 0
                          • X
                            XCP-ng-JustGreat @Haribo112 last edited by

                            @haribo112 @Noiden All, Looks like nested virtualization of Hyper-V within XCP-ng is a no go unless something changes in either or both XCP-ng and Hyper-V. Device driver for the Hyper-V virtual machine bus provider is the missing component that won't load. Seems this may be a problem only Microsoft can fix. 😞

                            8d8e6de5-5aa1-42f3-bcdf-8100a0d60459-image.png

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post