XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    PCI device doesn't show in XO or xe pci-list

    Scheduled Pinned Locked Moved Compute
    23 Posts 6 Posters 351 Views 6 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Offline
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      Same answer than the other topic, checking first the basics before investigating further 🙂

      C P 2 Replies Last reply Reply Quote 0
      • C Offline
        chicagomed @olivierlambert
        last edited by

        @olivierlambert I'm going to swap in an AMD card today and will let you know if anything changes!

        C 1 Reply Last reply Reply Quote 1
        • P Offline
          Pyroteq @olivierlambert
          last edited by

          @olivierlambert

          My issue isn't that I can't pass through the card at all, I can still do it via CLI just fine so there isn't really any real problem preventing me from hiding the card from dom0 and then attaching it to my Plex VM. I was just curious why some devices are listed with xe pci-list and others aren't because I would have thought that it would essentially just reflect whatever shows in lspci.

          Having it show in xe pci-list would just mean it's easier to attach/detach from a VM as it would then show in the webUI.

          Does XCP-NG require the built in driver support to list the devices in pci-list?? Because the TV tuner doesn't work natively on Linux without downloading the drivers so I guess that could be a possibility?

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            @Pyroteq OK so it's more clear to me now. So there's an issue on how we report all the devices to make it doable via Xen Orchestra. I'm not sure exactly who to ping, maybe @Team-Hypervisor-Kernel

            1 Reply Last reply Reply Quote 0
            • marcoiM Offline
              marcoi
              last edited by

              im seeing a similar thing in lastest version of XO (self built)
              lspci showing more items the XO is showing for the host.
              I just added a usbc card for example and its not showing up in XO.

              b56ed22f-f4a8-42cb-a326-71137c010324-image.png

              35132b3d-221e-42e9-8ee0-f7e2d218cb7b-image.png

              marcoiM 1 Reply Last reply Reply Quote 0
              • marcoiM Offline
                marcoi @marcoi
                last edited by

                Just to add details about my box. Seems lspci is showing 20 items and xe/xo is only showing 12.
                I left the device name in the second list to help show whats not showing up in xe vs lscpi

                XE/XO list

                 pci-id ( RO): 0000:c1:00.0
                 pci-id ( RO): 0000:c2:00.0
                 pci-id ( RO): 0000:c3:00.0
                 pci-id ( RO): 0000:c4:00.0
                 pci-id ( RO): 0000:c5:00.0
                 pci-id ( RO): 0000:c5:00.1
                 pci-id ( RO): 0000:c7:00.0
                 pci-id ( RO): 0000:c7:00.1
                 pci-id ( RO): 0000:c7:00.2
                 pci-id ( RO): 0000:c7:00.4
                 pci-id ( RO): 0000:c7:00.6
                 pci-id ( RO): 0000:c7:00.7
                

                VS lspci list

                c1:00.0	SATA controller: JMicron Technology Corp. JMB58x AHCI SATA controller
                c2:00.0	Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961/SM963
                c3:00.0	Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03)
                c4:00.0	Ethernet controller: Realtek Semiconductor Co., Ltd. Device 8126 (rev 01)
                c5:00.0	VGA compatible controller: NVIDIA Corporation GK208 [GeForce GT 720] (rev a1)
                c5:00.1	Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)
                c6:00.0	USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01)
                c7:00.0	Display controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 150e (rev d1)
                c7:00.1	Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
                c7:00.2	Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 17e0
                c7:00.4	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151e
                c7:00.6	Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller
                c7:00.7	Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 164a
                c8:00.0	Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 150d
                c8:00.1	Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 17f0 (rev 10)
                c9:00.0	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151f
                c9:00.3	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151a
                c9:00.4	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151b
                c9:00.5	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151c
                c9:00.6	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151d
                
                1 Reply Last reply Reply Quote 0
                • C Offline
                  chicagomed @chicagomed
                  last edited by

                  Just adding here from my other post---AMD card didn't not reproduce this issue but my Intel Arc card experience matches exactly what others have posted here about the LSPCI vs XE-Assignable / XOA list difference.

                  andSmvA A 2 Replies Last reply Reply Quote 0
                  • andSmvA Offline
                    andSmv Vates 🪐 XCP-ng Team Xen Guru @chicagomed
                    last edited by andSmv

                    @chicagomed If lspci shows the PCI device in its output we probably need to check if XAPI layer "sees" all this devices and correctly reports them to XO. Ping @Team-XAPI-Network

                    C 1 Reply Last reply Reply Quote 1
                    • A Offline
                      andriy.sultanov Vates 🪐 XAPI & Network Team @chicagomed
                      last edited by

                      @chicagomed Could you (and others with the issue) please post the output of lspci -mnn for the devices that are not shown in xe pci-list?

                      XAPI filters for PCI devices with classes 01XX, 02XX, and 03XX as a safety measure (better to be safe than sorry in avoiding passthrough of critical devices), but perhaps we could reasonably expand this filter.

                      marcoiM 1 Reply Last reply Reply Quote 2
                      • marcoiM Offline
                        marcoi
                        last edited by

                        here my list - items c6, c8, c9 are not showing up.

                        00:00.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]"
                        00:00.2 "IOMMU [0806]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]"
                        00:01.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
                        00:01.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" ""
                        00:01.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" ""
                        00:02.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
                        00:02.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
                        00:02.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
                        00:02.4 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
                        00:02.5 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
                        00:03.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
                        00:03.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
                        00:03.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
                        00:08.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
                        00:08.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
                        00:08.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
                        00:08.3 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
                        00:14.0 "SMBus [0c05]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]" -r71 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]"
                        00:14.3 "ISA bridge [0601]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]" -r51 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]"
                        00:18.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f8]" "" ""
                        00:18.1 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f9]" "" ""
                        00:18.2 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fa]" "" ""
                        00:18.3 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fb]" "" ""
                        00:18.4 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fc]" "" ""
                        00:18.5 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fd]" "" ""
                        00:18.6 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fe]" "" ""
                        00:18.7 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16ff]" "" ""
                        c1:00.0 "SATA controller [0106]" "JMicron Technology Corp. [197b]" "JMB58x AHCI SATA controller [0585]" -p01 "JMicron Technology Corp. [197b]" "Device [0000]"
                        c2:00.0 "Non-Volatile memory controller [0108]" "Samsung Electronics Co Ltd [144d]" "NVMe SSD Controller SM961/PM961/SM963 [a804]" -p02 "Samsung Electronics Co Ltd [144d]" "SM963 2.5\" NVMe PCIe SSD [a801]"
                        c3:00.0 "Ethernet controller [0200]" "Aquantia Corp. [1d6a]" "AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] [04c0]" -r03 "Aquantia Corp. [1d6a]" "Device [0001]"
                        c4:00.0 "Ethernet controller [0200]" "Realtek Semiconductor Co., Ltd. [10ec]" "Device [8126]" -r01 "Realtek Semiconductor Co., Ltd. [10ec]" "Device [0123]"
                        c5:00.0 "VGA compatible controller [0300]" "NVIDIA Corporation [10de]" "GK208 [GeForce GT 720] [1286]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]"
                        c5:00.1 "Audio device [0403]" "NVIDIA Corporation [10de]" "GK208 HDMI/DP Audio Controller [0e0f]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]"
                        c6:00.0 "USB controller [0c03]" "Etron Technology, Inc. [1b6f]" "EJ168 USB 3.0 Host Controller [7023]" -r01 -p30 "Unknown vendor [7023]" "Device [1b6f]"
                        c7:00.0 "Display controller [0380]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Device [150e]" -rd1 "Unknown vendor [1f4c]" "Device [b020]"
                        c7:00.1 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Rembrandt Radeon High Definition Audio Controller [1640]" "Unknown vendor [1f4c]" "Device [b020]"
                        c7:00.2 "Encryption controller [1080]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]"
                        c7:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151e]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]"
                        c7:00.6 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Family 17h/19h HD Audio Controller [15e3]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [d808]"
                        c7:00.7 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]"
                        c8:00.0 "Non-Essential Instrumentation [1300]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]"
                        c8:00.1 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]" -r10 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]"
                        c9:00.0 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151f]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]"
                        c9:00.3 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]"
                        c9:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]"
                        c9:00.5 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]"
                        c9:00.6 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]"
                        
                        
                        1 Reply Last reply Reply Quote 0
                        • marcoiM Offline
                          marcoi @andriy.sultanov
                          last edited by

                          @andriy.sultanov is there a way to allow all devices (even if we blow up the system lol)

                          For example in the docs there a usb filter list you can edit
                          /etc/xensource/usb-policy.conf

                          anything similar for pcie? Can something be added with disclaimer you break it on you etc?
                          Maybe make it a command line option to disable the pci device filters for users that want to pass through special devices.

                          olivierlambertO 1 Reply Last reply Reply Quote 0
                          • olivierlambertO Offline
                            olivierlambert Vates 🪐 Co-Founder CEO @marcoi
                            last edited by

                            @marcoi Right now it's hard coded. But we'll see what could be the best approach on this 🙂

                            marcoiM 1 Reply Last reply Reply Quote 0
                            • marcoiM Offline
                              marcoi @olivierlambert
                              last edited by

                              @olivierlambert thanks for the update.
                              and just to confirm, if a device is not showing up in xe list with uuid, there is no way to pass it to a VM correct?

                              1 Reply Last reply Reply Quote 0
                              • olivierlambertO Offline
                                olivierlambert Vates 🪐 Co-Founder CEO
                                last edited by

                                No, you can pass it anyway, it's just not doable via XO. But the CLI method should work 🙂

                                marcoiM 1 Reply Last reply Reply Quote 0
                                • marcoiM Offline
                                  marcoi @olivierlambert
                                  last edited by

                                  @olivierlambert to confirm the steps
                                  i can skip this step since it isnt showing up anyways

                                  • xe pci-disable-dom0-access uuid=<pci uuid>

                                  then use

                                  • xe vm-param-set other-config:pci=0/0000:04:01.0 uuid=<vm uuid> to add it to vm
                                  1 Reply Last reply Reply Quote 0
                                  • olivierlambertO Offline
                                    olivierlambert Vates 🪐 Co-Founder CEO
                                    last edited by olivierlambert

                                    That might work indeed. If it doesn't, you'll have to go via the old method:

                                    /opt/xensource/libexec/xen-cmdline --set-dom0 "xen-pciback.hide=(0000:04:01.0)"
                                    

                                    Please let us know 🙂 (this way we could update the doc)

                                    marcoiM 1 Reply Last reply Reply Quote 0
                                    • marcoiM Offline
                                      marcoi @olivierlambert
                                      last edited by

                                      @olivierlambert

                                      xe vm-param-set other-config:pci=0/0000:c6:00.0 uuid=45d0f537-9076-b395-1fbd-850d2cc0cf68

                                      This command worked. I was able to pass through the usb and also pcie devices i can get to using XO.

                                      3555b351-e13d-478d-9df4-7bbcb1643909-image.png

                                      windows host showing usb drive plugged into usb3 card and graphics card.

                                      b6f55d15-9e66-4606-8a37-7593e3068d3a-image.png

                                      1 Reply Last reply Reply Quote 0
                                      • olivierlambertO Offline
                                        olivierlambert Vates 🪐 Co-Founder CEO
                                        last edited by

                                        Perfect! It's just a matter of stuff hidden for some reasons, at least it doesn't cause any problem, which is what matters 🙂

                                        1 Reply Last reply Reply Quote 1
                                        • C Offline
                                          chicagomed @andSmv
                                          last edited by

                                          @andSmv

                                          From LSPCI:

                                          0a:00.0 Audio device: Intel Corporation DG2 Audio Controller
                                          0b:00.0 VGA compatible controller: Intel Corporation DG2 [Arc A310] (rev 05)
                                          

                                          With xl pci-assignable-list :

                                          0000:01:00.6
                                          0000:01:00.4
                                          0000:0b:00.0
                                          0000:01:00.0
                                          0000:01:00.3
                                          
                                          

                                          Here you go...hope this helps!

                                          1 Reply Last reply Reply Quote 0
                                          • First post
                                            Last post