vGPU - which graphics card supported?
-
@olivierlambert said in vGPU - which graphics card supported?:
- NVIDIA GRID: closed source driver (binary), closed source vGPU mechanism (not in XCP-ng until someone decide to develop one in Open Source), need supported GPUs (GRID compatible card + subscription/license)
- AMD MxGPU: drive is likely Open Source, it's using SR-IOV (standard), there's might be a Citrix Hypervisor/XenServer "driver" somewhere. Compatible hardware? AMD Radeon Pro V340 or *Firepro S7150 seems to be supported. KVM got an Open Source driver so if we miss something for Citrix, we could adapt it.
- Intel GPU: I think I tested it and it worked, but Intel GPU aren't really powerful.
If someone got a Pro V340 or S7150 card, that might be interesting to test.
Hi,
Does that mean that an Nvidia Grid K2 won't work as vGPU in xcp-ng?
I've got a Grid K2 laying around that I was hoping to use on an xcp-ng server...
If Intel GPUs are supported I might have to look into those (they'll be used mainly for VDI with light 3D usage)
Thanks.
-
K2 aren't supported indeed because we lack some closed source part. We could rewrite those ourselves, but nobody asked, hence it's not a priority.
-
Unfortunately K1/K2 Nvidia Grid cards are only supported on Xenserver 7.1, so if you want to be using them you'll have to go to the latest 7.1 LTSR release. Think that was a decision by Nvidia so that they could change the licensing model for their successor M60 grid cards.
If you want an equivalent to the K1/K2 your only option is the AMD MxGPU's - performance wise the S7510 FirePro is as good as the Nvidia M60 and without the additional licensing.
Nvidia Quadro and AMD Vega/RX cards for pass through only will work with XCP-NG.
-
@olivierlambert said in vGPU - which graphics card supported?:
K2 aren't supported indeed because we lack some closed source part. We could rewrite those ourselves, but nobody asked, hence it's not a priority.
Well, if it's not too much work, that would be great! Grid K2s are quite cheaper these days, and it'd be a great way to introduce low-cost VDIs along with xcp-ng.
@AllooTikeeChaat said in vGPU - which graphics card supported?:
Unfortunately K1/K2 Nvidia Grid cards are only supported on Xenserver 7.1, so if you want to be using them you'll have to go to the latest 7.1 LTSR release. Think that was a decision by Nvidia so that they could change the licensing model for their successor M60 grid cards.
If you want an equivalent to the K1/K2 your only option is the AMD MxGPU's - performance wise the S7510 FirePro is as good as the Nvidia M60 and without the additional licensing.
Nvidia Quadro and AMD Vega/RX cards for pass through only will work with XCP-NG.
Feared as much - I remember testing it with XenServer 7.1 back when it wasn't yet LTSR... Looks we'll have to go that route.
I was looking into the AMD cards as well, but we've got this K2 laying around which I wanted to put to use.
-
@biztems I suppose this will cost between 20k€ to 60k€ depending on the difficulty level (hard to have a more precise idea).
This is a zone we have 0 knowledge and only contractors (hence the pricing) would be able to assist us.
So as you can see, we need more traction before deciding to spend that amount of money
edit: obviously, if the community can push code that make it works, we are VERY welcoming them!
-
@AllooTikeeChaat You mean FirePro S7150 right? (not S7510, I can't find any SKU with this name)
-
@olivierlambert said in vGPU - which graphics card supported?:
@biztems I suppose this will cost between 20k€ to 60k€ depending on the difficulty level (hard to have a more precise idea).
This is a zone we have 0 knowledge and only contractors (hence the pricing) would be able to assist us.
So as you can see, we need more traction before deciding to spend that amount of money
edit: obviously, if the community can push code that make it works, we are VERY welcoming them!
Welp, we're a smallish outfit, I guess that's outside our range. I understand what you're saying - I surmise this is a very taxing and complex task.
Sadly we haven't got any devs with hw experience, otherwise we'd have gladly looked into it.
@olivierlambert said in vGPU - which graphics card supported?:
@AllooTikeeChaat You mean FirePro S7150 right? (not S7510, I can't find any SKU with this name)
Yep, looks like he meant S7150. We're looking into that too - any chance of it working with xcp-ng?
Thanks again for your time!
-
It would require more GPU experience and hypervisor/stack XP (we got this part). So it might be doable "cheaper", but I think this will require contributions from multiple actors (not just us).
Regarding the Firepro, we could help on this if it doesn't work, because I think it should or it will be probably easy to do (however, it's just an assumption), because:
- there is Open Source "connectors" (it's using SR-IOV which is a standard)
- no extra license
-
Sorry chaps .. I'm away from home with minimal internet access. I did mean the S7150 series but stubby fingers always get in the way. The new Radeon
Pro v430 should also work with XCP-NG. You'll just need to install the latest Xenserver drivers from AMD. Unfortunately I no longer have access to any of the AMD Mx GPU's otherwise I would have been happy to test etc with XCp-NG..@olivierlambert .. think it might be worthwhile getting in touch with AMD and Intel as a partner just to make sure that nothings a miss in XCP-NG to get those GPU's to work out of the box. I'm sure that they do.
Not sure if Citrix would be happy though!
https://www.amd.com/en/graphics/workstation-virtual-graphics
-
@AllooTikeeChaat said in vGPU - which graphics card supported?:
Pro v430
Pro V340 right?
Do you know where we can actually buy those things? -
AMD were making a lot of noise about the Pro V430 when it released and how it stacked up against the equivalent NV card. Not sure on where to get the Pro V430 .. those would be have been provided by AMD and eventually alway had to go back ...
The S7150x2 and other MxGPU's are available from the likes of Scan, I'm surpised that they don;t sell the Pro v430.
I found the Pro v430 being sold ar Insight and its spendy $9k - not sure what the performance would be like and is it worth 3x the price of the S7150x2 ? The S7150x2 was a good as the Nv M60 in our testing.
You should be able to get the S7150 and get 3 for the price of a single Pro v430 from most resellers:
-
@AllooTikeeChaat
Cheers, your insight is much appreciated.We might look into a S7150 in the future!
We were also looking into gvt-g supported CPUs.
Has anyone tested those with xcp-ng? -
Managed to get the AMD S7150x2 working with xcp-ng 7.6 week ago. No idea how it stacks up performancewise with anything else as it is my first adventure in VM shared video.
I can post details Monday when I am back I the office, but I just installed XCP-NG and loaded the Citrix driver from AMD's website and it worked. Much more sane install than my attempt at Hyper-v. The mxgpu settings page gives me the ability to set the you slices and everything. Performance in one test guest feels pretty decent.
Overall I'm very impressed by XCP-NG so far.
-
@Arvee thanks a LOT for the feedback. Ideally, if you can, please update the Wiki (write permissions for everyone) to explain the exact steps you did
Feel free to create a vGPU page and make a dedicated paragraph for AMD GPUs
-
Well done.. the S7150x2 should be a a fair bit faster than the K2/K1 grid cards. For CAD/Architectural workloads we found it as fast as Nvidia M60 and sometimes faster .. using the same GPU profile types.
-
@OLIVIERLAMBERT will do. I'll try and get that rolling today or tomorrow.
The only complaint the remote person had was the mouse was "jumpy" in Autocad which is likely due to an RDP latency issue. We'll do some more tuning on that and see where it ends up. If it eludes me much more I'll post a separate topic for that.
-
We were always deploying using Xendesktop/XenApp - performance once configured correctly - GPO's HDX policies was usually very good - apps workloads Autocad, Revit and Inventor Pro. No longer have access to all the tweaks.
Not sure how you'd tune and tweak RDP to improve the performance.
-
Yeah, XenDesktop (and in general Citrix HDX protocols) are great for those cases.
I don't know about UDS, if it uses something else than RDP.
-
-
I am running a WX7100 under XCP-ng 7.6. It only allows full GPU passthrough. So you can run multiple VMS on the server, but only one at a time can be assigned the GPU. I have tested it to work properly with Server 2016 std, Server 2019 std, and Win10 pro. Currently I have it crunching BOINC under win10pro and here are the stats.... BOINCstats for Norby
