XCP-ng GPU Passthrough - No GPU found

misterpc23

@borzel It wasn't scary at all! Only downside is my gpu hasn't showed up so I'm thinking it is not supported (R370). Where could I find a list of GPU's that will work with PCI passthrough with XCP-NG? Thank you for any help

imtrobin

KVM is quite easy to spoof the VM so the nvidia drivers work. Is it possible to do easily for xcp?

https://lists.xenproject.org/archives/html/xen-devel/2016-07/msg01713.html

olivierlambert

You can pass the entire GPU if you like, it's no big deal. vGPU is another story.

imtrobin

I'm talking about GPU Passthrough, not vGPU. The GPU is passthrough fine but the nvidia driver results in code 43, meaning the driver detected it is running in a VM.

KVM bypass this by spoofing the VM, and it works, so can XCP do similar?

olivierlambert

IDK what it means to spoofing the VM. If you can tell what's needed exactly, maybe we could do something

imtrobin

In KVM, I need to do these

turn on cpu hidden state

https://wiki.archlinux.org/index.php/PCI_passthrough_via_OVMF#"Error_43:_Driver_failed_to_load"_on_Nvidia_GPUs_passed_to_Windows_VMs

Assign the gpu to vfio directly (I guess we may not need to do this here)
Blacklist the nvidia drivers like this

https://techblog.jeppson.org/2018/03/windows-vm-gtx-1070-gpu-passthrough-proxmox-5/

https://forum.proxmox.com/threads/gpu-passthrough-tutorial-reference.34303/

imtrobin

Hi, so some people have been able to do it

https://gridforums.nvidia.com/default/topic/9108/#

https://gridforums.nvidia.com/default/topic/8934/#

Pejcik

Hello,

My idea was to passthrough GPU to specific VM. According to many informations from the Internet, I'm doing this like that:

/opt/xensource/libexec/xen-cmdline --set-dom0 "xen-pciback.hide=(03:00.0)(03:00.1)"
but still even after reboot I see it on lspci
xe vm-param-set other-config:pci=0/0000:03:00.0, 0/0000:03:00.1 uuid=c41704d0-a1f2-6bc1-fe2e-adc26697e636
for old Nvidia 8600 and GT430 it doesn't work - Windows VM see that device, drivers are installed but all the time I have error 43 and this device is stopped
for Radeon 7870 it work ok

Audio and USB is working with that metod also.

Is this connected with Vbios of this GPU's ?

linhnb

Finally, we have GPU passthrough in the GUI,
But it is not working...
My setup:
CPU 2700x
MOBO: x470 Taichi
RAM: 32GB
GPU: Rx580 sapphire Nitro 4GB

Please, I did use CLI and GUI, no work.
Cannot see it in Windows.
![alt text](image url)

anthonyh

Ironically, I am trying to do this as well. I put a second graphics card in a host (NVIDIA NVS 510) and made sure the appropriate virtalization settings were enabled in the BIOS. Running up to date XCP-ng 8.0 (yum update as of yesterday afternoon). I can assign the GPU to the Windows Server 2016 guest in XCP-ng Center, and the NVIDIA drivers seem to install fine, but Device Manager reports the following:

What's also interesting is even though it warns that you must be able to access the VM remotely as there will be no local console, there is still a local console. I don't know if this means anything.

Any ideas?

jmccoy555

@anthonyh Google code 43 NVIDIA...... Basic translation is we want to stop you doing this with a consumer card in a VM. There are solutions I believe.

olivierlambert

Yes, using Nvidia card supporting GPU passthrough

Otherwise, there's "border line" patches on Windows drivers available on GitHub, but we won't find those for you

jmccoy555

@linhnb don't think you can use the GUI for GPUs, only vGPUs.

RX580 does work, just follow the PCI passthrough guide.

olivierlambert

AMD cards are indeed far better for both vGPU and GPU passthrough: it just works.

jmccoy555

If only they made a LP vGPU card.... Looks like a WX4100 will have to do.

linhnb

@anthonyh yeah, I also got this note in version 8.1. I just don't know why. But my VM can't see Rx580, that's the problem

@olivierlambert man, please, I got problem right here with AMD GPU. Please help.

@jmccoy555 You can use the GUI. I checked, the code changes as if you do make it in CLI. please check the newest version 8.1

anthonyh

@jmccoy555 said in XCP-ng GPU Passthrough - No GPU found:

@anthonyh Google code 43 NVIDIA...... Basic translation is we want to stop you doing this with a consumer card in a VM. There are solutions I believe.

@olivierlambert said in XCP-ng GPU Passthrough - No GPU found:

Yes, using Nvidia card supporting GPU passthrough

Otherwise, there's "border line" patches on Windows drivers available on GitHub, but we won't find those for you

Well, this card is technically in the Quadro family, so I was hoping it'd work. I see solutions for libvirt/KVM, but not Xen. Any "nudge" would be greatly appreciated if anyone is willing. This is just a test environment. If the application works in this setup we'll buy proper hardware and go the AMD route.

anthonyh

I think I might have found the GitHub driver patch @olivierlambert was referring to...

olivierlambert

@linhnb

I was answering to @anthonyh
You are on a community forum

jmccoy555

@linhnb said in XCP-ng GPU Passthrough - No GPU found:

You can use the GUI. I checked, the code changes as if you do make it in CLI. please check the newest version 8.1

Thanks for the tip!! Working in 8.1 in XCP-ng Center and also XO

Also, dont think there is a need to 'hide' the GPU from Dom0 now??

edit: Did a fresh install, no need to 'xen-pciback.hide' when assigning via XO or XCP-ng center. This was with AMD as they play nicely, not sure about NVIDIA.