XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    GPU passthrough, Windows 11 guest, "Working properly" becomes "Code 43"

    Scheduled Pinned Locked Moved Compute
    29 Posts 4 Posters 11.6k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B Offline
      branpurn @olivierlambert
      last edited by branpurn

      @olivierlambert

      At risk of getting off topic the original issue, it sounds like I am correct in understanding guest tools are not relevant to the PCI passthrough.

      Fresh install Win 11, it may be worth capturing the initial error pre-display driver, as the way it is languaged might be different than a typical missing driver (unconfirmed)

      9ad95723-e9ab-4581-9929-e4d42e13024e-image.png

      -- Shortly hereafter, BSOD, VIDEO_TDR_FAILURE (I think Windows Update detected the GPU and tried to install driver)

      EDIT: Appears BSOD loop after WU on fresh Win 11 install grabbed the driver; I think this is similar to complete reinstall of driver on previous iteration of this Win 11 install, post-passthrough of the audio sub-device (Driver would likely not have been auto-grabbed previous install of Win 11 due to the sub-device not being present?)

      EDIT: Trying 'cloud reset' from Win 11 recovery partition options for the heck of it... EDIT: As one might expect, not as "clean" an install as a clean format and reinstall, even when selecting "remove everything" and "clean drive"-- assumedly driver, and thus BSOD, remain with that method.

      Anyway, getting into the weeds with Windows here. I don't think the solution lies on the OS side.

      B 1 Reply Last reply Reply Quote 0
      • B Offline
        branpurn @branpurn
        last edited by

        @branpurn

        Food for thought, here's all parameters for the guest,

        params=all.txt

        B 1 Reply Last reply Reply Quote 0
        • B Offline
          branpurn @branpurn
          last edited by branpurn

          @branpurn

          Same result with NVIDIA's Studio Driver, "The device is working properly" (though it's not, seemingly) then upon reboot, Code 43.

          Still somewhat confused as to why I have console display in XOA when "VGA" in 'Advanced' is set to 'Off'...

          1a628f46-f39c-4ec1-965b-28af8e8d3fea-image.png

          1 Reply Last reply Reply Quote 0
          • planedropP Offline
            planedrop Top contributor
            last edited by

            Just wanted to chime in here on my experience with GPU passthrough with an NVidia GPU.

            After doing a ton of testing and troubleshooting I never actually managed to get it to work within XCP-ng due to NVidia doing everything they can to prevent "consumer" cards from working in a virtual environment.

            I did once manage to get it working with Proxmox after literal months and 100+ hours of troubleshooting, but XCP-ng proved more difficult for this and I eventually gave up.

            I don't necessarily fault XCP-ng for this, it's not really a natively supported or enterprise type thing, as you'd just use vGPU for those situations in most cases.

            But after having a HUGE struggle with it on Proxmox and XCP-ng both I eventually gave up on trying to do it with consumer GPUs as the effort proved to not be worth it IMO.

            Not trying to come in here and do the typical "you just shouldn't do that" thing that so many do lol; but just giving some insight into my experience with it. NVidia works really hard to detect any form of virtual environment to block this sort of thing which is exactly what code 43 (generally) means, the driver detected the virtual environment and blocked it.

            T 1 Reply Last reply Reply Quote 0
            • olivierlambertO Offline
              olivierlambert Vates 🪐 Co-Founder CEO
              last edited by

              I think we had users where it worked (here on the forum) but I don't remember if it was on Windows 10 or 11 🤔

              1 Reply Last reply Reply Quote 0
              • T Offline
                topher @planedrop
                last edited by

                @planedrop That has also been my experience as well in the past. I have attempted this again recently because last year Nvidia changed the drivers in a way that code 43 should no longer be an issue with most GTX gpus that people would be trying to pass into a VM. There are many videos of this just working in Proxmox and VMware with those driver changes. I do not get the code 43 error when installing the device drivers in the VM, just BSOD as seen above and reboots. If there are special steps needed to make this work on XCP-NG it would be great if we could get that documented, the other thing is that both of these systems are running on AMD and there might be bios changes we need to make?. https://nvidia.custhelp.com/app/answers/detail/a_id/5173/~/geforce-gpu-passthrough-for-windows-virtual-machine-(beta)

                planedropP 1 Reply Last reply Reply Quote 0
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  A detail however: most of our known working use cases are with server-grade hardware.

                  T 1 Reply Last reply Reply Quote 0
                  • T Offline
                    topher @olivierlambert
                    last edited by

                    I have attempted this on an Intel v4 Xeon platform and had some of the same issues and could not get it working.

                    1 Reply Last reply Reply Quote 0
                    • olivierlambertO Offline
                      olivierlambert Vates 🪐 Co-Founder CEO
                      last edited by

                      Server grade also means server grade cards 🙂

                      T 1 Reply Last reply Reply Quote 0
                      • planedropP Offline
                        planedrop Top contributor @topher
                        last edited by

                        @topher Oh yeah I had totally forgotten about those changes. However, my understanding from that link is that you still need 2 GPUs installed in most cases for it to work right; whereas OP I believe only has a single GPU on the system.

                        B 1 Reply Last reply Reply Quote 0
                        • B Offline
                          branpurn @planedrop
                          last edited by

                          @planedrop

                          I have onboard Radeon graphics, and NVIDIA dGPU

                          planedropP 1 Reply Last reply Reply Quote 0
                          • planedropP Offline
                            planedrop Top contributor @branpurn
                            last edited by

                            @branpurn Gotcha.. Hmmmmmm

                            I really wish I could provide more guidance here but not sure I have that much left to add the conversation. I just know every time I've done GPU passthrough I've ran into issues similar to this, BSODs, code 43, etc.....

                            Not saying to give up, just trying to put it into perspective since I spent 100s of hours trying to get it going myself on a few different occurrences and hardly had any luck. I.e. be prepared to do a lot of work and spend a lot of time to get this going lol. I'm confident it's possible but getting there is the hard part.

                            B 1 Reply Last reply Reply Quote 0
                            • B Offline
                              branpurn @planedrop
                              last edited by

                              This post is deleted!
                              1 Reply Last reply Reply Quote 0
                              • T Offline
                                topher @olivierlambert
                                last edited by

                                @olivierlambert 🙄 😟 Yeah I guess that is true ... Nvidia Titan and Threadriper pro are at least workstation. It is just interesting that consumer GPU's are working on other platforms and not xen/XCP-NG.

                                1 Reply Last reply Reply Quote 1
                                • olivierlambertO Offline
                                  olivierlambert Vates 🪐 Co-Founder CEO
                                  last edited by

                                  That might change in the future 🙂 We are working on better chipset emulation that should help on many aspects 🙂

                                  1 Reply Last reply Reply Quote 2
                                  • gskgerG gskger referenced this topic on
                                  • First post
                                    Last post