XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    vGPU - which graphics card supported?

    Scheduled Pinned Locked Moved Development
    vgpu
    55 Posts 20 Posters 38.8k Views 15 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Offline
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by olivierlambert

      • NVIDIA GRID: closed source driver (binary), closed source vGPU mechanism (not in XCP-ng until someone decide to develop one in Open Source), need supported GPUs (GRID compatible card + subscription/license)
      • AMD MxGPU: drive is likely Open Source, it's using SR-IOV (standard), there's might be a Citrix Hypervisor/XenServer "driver" somewhere. Compatible hardware? AMD Radeon Pro V340 or *Firepro S7150 seems to be supported. KVM got an Open Source driver so if we miss something for Citrix, we could adapt it.
      • Intel GPU: I think I tested it and it worked, but Intel GPU aren't really powerful.

      If someone got a Pro V340 or S7150 card, that might be interesting to test.

      B 1 Reply Last reply Reply Quote 0
      • B Offline
        biztems @olivierlambert
        last edited by

        olivierlambert said in vGPU - which graphics card supported?:

        • NVIDIA GRID: closed source driver (binary), closed source vGPU mechanism (not in XCP-ng until someone decide to develop one in Open Source), need supported GPUs (GRID compatible card + subscription/license)
        • AMD MxGPU: drive is likely Open Source, it's using SR-IOV (standard), there's might be a Citrix Hypervisor/XenServer "driver" somewhere. Compatible hardware? AMD Radeon Pro V340 or *Firepro S7150 seems to be supported. KVM got an Open Source driver so if we miss something for Citrix, we could adapt it.
        • Intel GPU: I think I tested it and it worked, but Intel GPU aren't really powerful.

        If someone got a Pro V340 or S7150 card, that might be interesting to test.

        Hi,

        Does that mean that an Nvidia Grid K2 won't work as vGPU in xcp-ng?

        I've got a Grid K2 laying around that I was hoping to use on an xcp-ng server...

        If Intel GPUs are supported I might have to look into those (they'll be used mainly for VDI with light 3D usage)

        Thanks.

        1 Reply Last reply Reply Quote 1
        • olivierlambertO Offline
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by

          K2 aren't supported indeed because we lack some closed source part. We could rewrite those ourselves, but nobody asked, hence it's not a priority.

          B 1 Reply Last reply Reply Quote 0
          • A Offline
            AllooTikeeChaat
            last edited by AllooTikeeChaat

            Unfortunately K1/K2 Nvidia Grid cards are only supported on Xenserver 7.1, so if you want to be using them you'll have to go to the latest 7.1 LTSR release. Think that was a decision by Nvidia so that they could change the licensing model for their successor M60 grid cards.

            If you want an equivalent to the K1/K2 your only option is the AMD MxGPU's - performance wise the S7510 FirePro is as good as the Nvidia M60 and without the additional licensing.

            Nvidia Quadro and AMD Vega/RX cards for pass through only will work with XCP-NG.

            olivierlambertO 1 Reply Last reply Reply Quote 0
            • B Offline
              biztems @olivierlambert
              last edited by

              olivierlambert said in vGPU - which graphics card supported?:

              K2 aren't supported indeed because we lack some closed source part. We could rewrite those ourselves, but nobody asked, hence it's not a priority.

              Well, if it's not too much work, that would be great! Grid K2s are quite cheaper these days, and it'd be a great way to introduce low-cost VDIs along with xcp-ng.

              AllooTikeeChaat said in vGPU - which graphics card supported?:

              Unfortunately K1/K2 Nvidia Grid cards are only supported on Xenserver 7.1, so if you want to be using them you'll have to go to the latest 7.1 LTSR release. Think that was a decision by Nvidia so that they could change the licensing model for their successor M60 grid cards.

              If you want an equivalent to the K1/K2 your only option is the AMD MxGPU's - performance wise the S7510 FirePro is as good as the Nvidia M60 and without the additional licensing.

              Nvidia Quadro and AMD Vega/RX cards for pass through only will work with XCP-NG.

              Feared as much - I remember testing it with XenServer 7.1 back when it wasn't yet LTSR... Looks we'll have to go that route.

              I was looking into the AMD cards as well, but we've got this K2 laying around which I wanted to put to use.

              1 Reply Last reply Reply Quote 1
              • olivierlambertO Offline
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by olivierlambert

                biztems I suppose this will cost between 20k€ to 60k€ depending on the difficulty level (hard to have a more precise idea).

                This is a zone we have 0 knowledge and only contractors (hence the pricing) would be able to assist us.

                So as you can see, we need more traction before deciding to spend that amount of money 😉

                edit: obviously, if the community can push code that make it works, we are VERY welcoming them!

                B 1 Reply Last reply Reply Quote 0
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO @AllooTikeeChaat
                  last edited by

                  AllooTikeeChaat You mean FirePro S7150 right? (not S7510, I can't find any SKU with this name)

                  1 Reply Last reply Reply Quote 0
                  • B Offline
                    biztems @olivierlambert
                    last edited by biztems

                    olivierlambert said in vGPU - which graphics card supported?:

                    biztems I suppose this will cost between 20k€ to 60k€ depending on the difficulty level (hard to have a more precise idea).

                    This is a zone we have 0 knowledge and only contractors (hence the pricing) would be able to assist us.

                    So as you can see, we need more traction before deciding to spend that amount of money 😉

                    edit: obviously, if the community can push code that make it works, we are VERY welcoming them!

                    Welp, we're a smallish outfit, I guess that's outside our range. I understand what you're saying - I surmise this is a very taxing and complex task.

                    Sadly we haven't got any devs with hw experience, otherwise we'd have gladly looked into it.

                    olivierlambert said in vGPU - which graphics card supported?:

                    AllooTikeeChaat You mean FirePro S7150 right? (not S7510, I can't find any SKU with this name)

                    Yep, looks like he meant S7150. We're looking into that too - any chance of it working with xcp-ng?

                    Thanks again for your time!

                    A 1 Reply Last reply Reply Quote 0
                    • olivierlambertO Offline
                      olivierlambert Vates 🪐 Co-Founder CEO
                      last edited by

                      It would require more GPU experience and hypervisor/stack XP (we got this part). So it might be doable "cheaper", but I think this will require contributions from multiple actors (not just us).

                      Regarding the Firepro, we could help on this if it doesn't work, because I think it should or it will be probably easy to do (however, it's just an assumption), because:

                      • there is Open Source "connectors" (it's using SR-IOV which is a standard)
                      • no extra license
                      1 Reply Last reply Reply Quote 0
                      • A Offline
                        AllooTikeeChaat @biztems
                        last edited by AllooTikeeChaat

                        biztems , olivierlambert

                        Sorry chaps .. I'm away from home with minimal internet access. I did mean the S7150 series but stubby fingers always get in the way. The new Radeon™ Pro v430 should also work with XCP-NG. You'll just need to install the latest Xenserver drivers from AMD. Unfortunately I no longer have access to any of the AMD Mx GPU's otherwise I would have been happy to test etc with XCp-NG..

                        olivierlambert .. think it might be worthwhile getting in touch with AMD and Intel as a partner just to make sure that nothings a miss in XCP-NG to get those GPU's to work out of the box. I'm sure that they do.

                        Not sure if Citrix would be happy though!

                        https://www.amd.com/en/graphics/workstation-virtual-graphics

                        1 Reply Last reply Reply Quote 0
                        • olivierlambertO Offline
                          olivierlambert Vates 🪐 Co-Founder CEO
                          last edited by

                          AllooTikeeChaat said in vGPU - which graphics card supported?:

                          Pro v430

                          Pro V340 right? 😉 Do you know where we can actually buy those things?

                          A 1 Reply Last reply Reply Quote 0
                          • A Offline
                            AllooTikeeChaat @olivierlambert
                            last edited by AllooTikeeChaat

                            olivierlambert

                            AMD were making a lot of noise about the Pro V430 when it released and how it stacked up against the equivalent NV card. Not sure on where to get the Pro V430 .. those would be have been provided by AMD and eventually alway had to go back ... ☺

                            The S7150x2 and other MxGPU's are available from the likes of Scan, I'm surpised that they don;t sell the Pro v430.

                            I found the Pro v430 being sold ar Insight and its spendy $9k - not sure what the performance would be like and is it worth 3x the price of the S7150x2 ? The S7150x2 was a good as the Nv M60 in our testing.

                            https://www.insight.com/en_US/buy/product/Q0Y81A/HEWLETT PACKARD ENTERPRISE/Q0Y81A/AMD-Radeon-Pro-V340--graphics-card--Radeon-Pro-V340--32-GB/

                            You should be able to get the S7150 and get 3 for the price of a single Pro v430 from most resellers:

                            https://www.scan.co.uk/products/16gb-amd-firepro-s7150x2-server-gpu-reverse-air-flow-passive-cooling-256-bit-gddr5-754-tflops-eec-su

                            1 Reply Last reply Reply Quote 0
                            • B Offline
                              biztems
                              last edited by

                              AllooTikeeChaat
                              Cheers, your insight is much appreciated.

                              We might look into a S7150 in the future!

                              We were also looking into gvt-g supported CPUs.
                              Has anyone tested those with xcp-ng?

                              1 Reply Last reply Reply Quote 0
                              • A Offline
                                Arvee
                                last edited by

                                Managed to get the AMD S7150x2 working with xcp-ng 7.6 week ago. No idea how it stacks up performancewise with anything else as it is my first adventure in VM shared video.

                                I can post details Monday when I am back I the office, but I just installed XCP-NG and loaded the Citrix driver from AMD's website and it worked. Much more sane install than my attempt at Hyper-v. The mxgpu settings page gives me the ability to set the you slices and everything. Performance in one test guest feels pretty decent.

                                Overall I'm very impressed by XCP-NG so far.

                                A B 2 Replies Last reply Reply Quote 2
                                • olivierlambertO Offline
                                  olivierlambert Vates 🪐 Co-Founder CEO
                                  last edited by olivierlambert

                                  Arvee thanks a LOT for the feedback. Ideally, if you can, please update the Wiki (write permissions for everyone) to explain the exact steps you did 🙂

                                  Feel free to create a vGPU page and make a dedicated paragraph for AMD GPUs 🙂

                                  1 Reply Last reply Reply Quote 1
                                  • A Offline
                                    AllooTikeeChaat @Arvee
                                    last edited by

                                    Arvee

                                    Well done.. the S7150x2 should be a a fair bit faster than the K2/K1 grid cards. For CAD/Architectural workloads we found it as fast as Nvidia M60 and sometimes faster .. using the same GPU profile types.

                                    1 Reply Last reply Reply Quote 1
                                    • A Offline
                                      Arvee
                                      last edited by

                                      olivierlambert will do. I'll try and get that rolling today or tomorrow.

                                      The only complaint the remote person had was the mouse was "jumpy" in Autocad which is likely due to an RDP latency issue. We'll do some more tuning on that and see where it ends up. If it eludes me much more I'll post a separate topic for that. 🙂

                                      A 1 Reply Last reply Reply Quote 0
                                      • A Offline
                                        AllooTikeeChaat @Arvee
                                        last edited by

                                        Arvee

                                        We were always deploying using Xendesktop/XenApp - performance once configured correctly - GPO's HDX policies was usually very good - apps workloads Autocad, Revit and Inventor Pro. No longer have access to all the tweaks.

                                        Not sure how you'd tune and tweak RDP to improve the performance.

                                        1 Reply Last reply Reply Quote 0
                                        • olivierlambertO Offline
                                          olivierlambert Vates 🪐 Co-Founder CEO
                                          last edited by

                                          Yeah, XenDesktop (and in general Citrix HDX protocols) are great for those cases.

                                          I don't know about UDS, if it uses something else than RDP.

                                          1 Reply Last reply Reply Quote 0
                                          • V Offline
                                            vdarkobar
                                            last edited by vdarkobar

                                            https://github.com/xcp-ng/xcp/wiki/MxGPU

                                            1 Reply Last reply Reply Quote 3
                                            • First post
                                              Last post