XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Adding GPU From XO

    Scheduled Pinned Locked Moved Xen Orchestra
    10 Posts 5 Posters 2.2k Views 2 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B Offline
      Brailyn
      last edited by

      Hello,

      I've been successful in presenting XCP-NG and XO a GPU... But I cannot get it to pass through. I feel like I am missing something.

      Dell R210 II Xeon E3-1230 V2
      Nvidia P400 (UEFI removed/vBIOS hack)
      Windows 10 Pro Oct 2020 with XCP-NG guest tools 8.2.2.200-rc1

      add-gpu.PNG

      passthrough () 0x0 is shown... Not sure if that is right, but when booting the machine isn't detecting it.

      The GPU passthrough section doesn't say much on the docs https://xcp-ng.org/docs/compute.html#gpu-passthrough

      Any help would be appreciated.

      1 Reply Last reply Reply Quote 0
      • olivierlambertO Offline
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        This UI is for vGPU, not passthrough.

        You need to use xe CLI.

        B 1 Reply Last reply Reply Quote 0
        • B Offline
          Brailyn @olivierlambert
          last edited by Brailyn

          olivierlambert Man I am on a roll with dumb questions in this forum... Only now do I see that dialog says vGPU.

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            Not a dumb question no worries, also having passthrough in the UI might come in the future at some point.

            B 1 Reply Last reply Reply Quote 0
            • B Offline
              Brailyn @olivierlambert
              last edited by Brailyn

              olivierlambert
              I just ran these commands and I still can use the console window and do not see it in device manager.

              [10:39 xcp-ng2 ~]# lspci
00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v2/Ivy Bridge DRAM Controller (rev 09)
00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port (rev 09)
00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 04)
00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b4)
00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 04)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a4)
00:1f.0 ISA bridge: Intel Corporation C202 Chipset LPC Controller (rev 04)
00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family 6 port Desktop SATA AHCI Controller (rev 04)
00:1f.3 SMBus: Intel Corporation 6 Series/C200 Series Chipset Family SMBus Controller (rev 04)
01:00.0 VGA compatible controller: NVIDIA Corporation GP107GL [Quadro P400] (rev a1)
01:00.1 Audio device: NVIDIA Corporation GP107GL High Definition Audio Controller (rev a1)
02:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM5716 Gigabit Ethernet (rev 20)
02:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM5716 Gigabit Ethernet (rev 20)


              
[10:40 xcp-ng2 ~]# xl pci-assignable-list
0000:01:00.0
0000:01:00.1
[10:41 xcp-ng2 ~]# xe vm-param-set other-config:pci=0/0000:01:00.0,1/0000:01:00.1 uuid=6ffb8f66-297e-98ef-f7c9-2c930c5e4ce2
[10:42 xcp-ng2 ~]#
              B 1 Reply Last reply Reply Quote 0
              • B Offline
                Brailyn @Brailyn
                last edited by Brailyn

                After installing the drivers I do see the device in the OS! Unfortunately, I do not believe using an Nvidia GPU like the Quadro P400 is possible with standard Nvidia drivers. I am getting error code 43 as I now read so many others are...

                error-43.PNG

                I removed my pci device from the vm using the following command:

                xe vm-param-remove param-name=other-config uuid=6ffb8f66-297e-98ef-f7c9-2c930c5e4ce2 param-key=pci 0/0000:01:00.0,1/0000:01:00.1

                To see parameters of the vm in general I used:

                xe vm-param-list uuid=6ffb8f66-297e-98ef-f7c9-2c930c5e4ce2

                I tested in Debian 10 and have similar problems when trying to use the card. The card is visible but will not run.

                root@debian:/home/user# nvidia-detect
Detected NVIDIA GPUs:
00:05.0 VGA compatible controller [0300]: NVIDIA Corporation GP107GL [Quadro P400][10de:1cb3] (rev a1)

Checking card:  NVIDIA Corporation GP107GL [Quadro P400] (rev a1)
Your card is supported by the default drivers and legacy driver series 390.
It is recommended to install the
    nvidia-driver

                root@debian:/home/user# apt install nvidia-driver 
root@debian:/home/user# apt install nvidia-smi

                root@debian:/home/user# nvidia-smi
Unable to determine the device handle for GPU 0000:00:05.0: Unknown Error
                U 1 Reply Last reply Reply Quote 0
                • U Offline
                  Undexter @Brailyn
                  last edited by

                  Brailyn Did you ever get anywhere with this? I've got the same card, and the same problem (error 43).

                  1 Reply Last reply Reply Quote 0
                  • olivierlambertO Offline
                    olivierlambert Vates 🪐 Co-Founder CEO
                    last edited by

                    Error 43 means Nvidia driver detects the OS you are installing the driver is a VM. That's an artificial limitation (market segmentation).

                    You might find some modified drivers around on GitHub.

                    1 Reply Last reply Reply Quote 0
                    • D Online
                      DustinB
                      last edited by

                      As Linus Torvalds as said "f*** nvidia" and their proprietary drivers.

                      1 Reply Last reply Reply Quote 1
                      • T Offline
                        TheFrisianClause
                        last edited by

                        Hey I just found this topic, did you manage to get the Quadro P400 working in XCP-NG?

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post