XCP-ng GPU Passthrough - No GPU found
-
This GPU doesn't appear to be supported, likely some limitation from Citrix that hasn't been worked around.
-
Removing the passthrough GPU, the VM starts without issue.
-
Yes, you tried to pass a vGPU, which is different to do a full PCI passthrough.
Nvidia vGPU is not free sadly. AMD and Intel are, because based on standards (XenGT for Intel and SRIOV for AMD).
However, PCI passthrough should be universal (ie working for everyone).
vGPU is vastly different than PCI passthrough. In short, vGPU is passing "slices" of physical GPU to a VM (like vCPU for a physical CPU). This allows to share GPU load between multiple VMs with one physical GPU.
PCI Passthrough is exclusive, it "reserves" the whole PCI device for one VM.
-
@olivierlambert said in XCP-ng GPU Passthrough - No GPU found:
Gotcha, which I was hoping to provide just a slice, but with Nvidia it's a no-go.
No worries, at least now I know.
-
Yeah, we had specific
threainstructions to remove the Nvidia/Citrix vGPU thing for XCP-ng because it's not Open Source.On Intel side, recent Xeon supports it (but you know Intel graphic perfs lol…) and also AMD FirePro S7150 (16vGPU).
-
So a rock and a hard place. . . don't get the performance for the money or spend a ton of money. . .
-
vGPU is still "reserved" for Virtual Desktop Infrastructure, which is a VERY lucrative and closed source world.
-
@olivierlambert Indeed. NVIDIA in particular is bent on your having to license any sort of vGPU technology and it would not surprise me to see even passthrough leveraged at some point in the future. There are already restrictions on being able to make use of Quadro features, for example, of you don't have licenses.
Also, note that you need one video board reserved to run the native OS (XCP-ng) dom0 instance itself, so the server has to effectovely have at least two graphics boards such that one can be used as a GPU.
-
Yeah, with GRID you need to pay also for the "driver" if I'm correct.
AMD approach is far better IMHO (using "standard" SRIOV) but that's because they are probably lagging in the market. Nvidia and Intel have somehow very similar business methods
-
@tjkreidl hmm it's not possible to "remove" the GPU for the dom0? It won't boot without it?
-
@olivierlambert No, it needs it (some sort of video board is necessary or it won't run at all). It has to at least be able to render the xsconsole interface.
-
Okay good to know
I had the hope that a serial console would be enough. I'll take a look if I can have any luck. -
So when will PCI passthrough be available through the GUI for lazy people such as myself? I don't mind dedicating a whole card per VM (Prefer it actually) but am highly hesitant to use the console. Thank you for all of the hard work, XCP-ng is awesome!
-
@misterpc23 sometimes even lazy people have to go to the cli
-
@borzel It wasn't scary at all! Only downside is my gpu hasn't showed up so I'm thinking it is not supported (R370). Where could I find a list of GPU's that will work with PCI passthrough with XCP-NG? Thank you for any help
-
KVM is quite easy to spoof the VM so the nvidia drivers work. Is it possible to do easily for xcp?
https://lists.xenproject.org/archives/html/xen-devel/2016-07/msg01713.html
-
You can pass the entire GPU if you like, it's no big deal. vGPU is another story.
-
I'm talking about GPU Passthrough, not vGPU. The GPU is passthrough fine but the nvidia driver results in code 43, meaning the driver detected it is running in a VM.
KVM bypass this by spoofing the VM, and it works, so can XCP do similar?
-
IDK what it means to spoofing the VM. If you can tell what's needed exactly, maybe we could do something
-
In KVM, I need to do these
- turn on cpu hidden state
-
Assign the gpu to vfio directly (I guess we may not need to do this here)
-
Blacklist the nvidia drivers like this
https://techblog.jeppson.org/2018/03/windows-vm-gtx-1070-gpu-passthrough-proxmox-5/
https://forum.proxmox.com/threads/gpu-passthrough-tutorial-reference.34303/
