Nvidia GPU Passthrough and Windows 10 nvlddmkm.sys error during driver install
-
Hello everybody!
I'm after some help. Using the PCI Passthrough instructions (https://xcp-ng.org/docs/compute.html#pci-passthrough) I've successfully managed to passthrough my Nvidia GPU to VMs. However, when installing the nvidia driver within a Windows 10 (21H2) VM it BSOD with the following error:
- Stop Code: VIDEO TDR FAILURE
- What failed: nvlddmkm.sys
Hardware specs:
- MSI Tomahawk B550
- AMD Ryzen 5600X
- 32GB RAM
- Nvidia GTX1070
XCP-NG:
- Version: 8.2.0
- Fully Patched as of 19/12/2021
If I install Windows 10 21H2 directly onto the bare metal the GPU driver installs and everything works without issue.
I've tried removing all traces for the drivers with DDU before reinstalling them again, but that doesn't seems to help.
Both UEFI (secure boot = off) and BIOS Windows 10 VMs have been tried, both resulting in the same BSOD error.
I also see the same results when swapping the GTX1070 for using another GPU, Nvidia GT710.I do have some success when I've used a Debian Bullseye 11 VM. Using the default drivers from a fresh Debian install the second physical monitor works. Exactly what I'm after for a Windows 10 VM.
However, as soon as I install the Nvidia driver within Debian the physical second monitor goes off. When I run nvidia-settings I can see the GPU and the monitor connected, but its like the monitor settings are forgotten resulting in no picture.
I need to do a bit more digging regarding this, but it could be to do with xorg...I've actually had this working within a Windows 10 VM on xcp-ng with the exact same GPU, but it was on Intel hardware. The Nvidia driver installed in the Windows 10 VM without issue. Could this be platform related?
Intel Hardware specs:
- ASRock z390 Pro4
- Intel i5 8500 with onboard GPU
- 16GB RAM
- Nvidia GTX1070
Any help would be very much appreciated. I'm happy to provide any logs that are required to get to help get to the bottom of this.