XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    PCI device doesn't show in XO or xe pci-list

    Scheduled Pinned Locked Moved Compute
    23 Posts 6 Posters 351 Views 6 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • marcoiM Offline
      marcoi
      last edited by

      im seeing a similar thing in lastest version of XO (self built)
      lspci showing more items the XO is showing for the host.
      I just added a usbc card for example and its not showing up in XO.

      b56ed22f-f4a8-42cb-a326-71137c010324-image.png

      35132b3d-221e-42e9-8ee0-f7e2d218cb7b-image.png

      marcoiM 1 Reply Last reply Reply Quote 0
      • marcoiM Offline
        marcoi @marcoi
        last edited by

        Just to add details about my box. Seems lspci is showing 20 items and xe/xo is only showing 12.
        I left the device name in the second list to help show whats not showing up in xe vs lscpi

        XE/XO list

         pci-id ( RO): 0000:c1:00.0
 pci-id ( RO): 0000:c2:00.0
 pci-id ( RO): 0000:c3:00.0
 pci-id ( RO): 0000:c4:00.0
 pci-id ( RO): 0000:c5:00.0
 pci-id ( RO): 0000:c5:00.1
 pci-id ( RO): 0000:c7:00.0
 pci-id ( RO): 0000:c7:00.1
 pci-id ( RO): 0000:c7:00.2
 pci-id ( RO): 0000:c7:00.4
 pci-id ( RO): 0000:c7:00.6
 pci-id ( RO): 0000:c7:00.7

        VS lspci list

        c1:00.0	SATA controller: JMicron Technology Corp. JMB58x AHCI SATA controller
c2:00.0	Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961/SM963
c3:00.0	Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03)
c4:00.0	Ethernet controller: Realtek Semiconductor Co., Ltd. Device 8126 (rev 01)
c5:00.0	VGA compatible controller: NVIDIA Corporation GK208 [GeForce GT 720] (rev a1)
c5:00.1	Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)
c6:00.0	USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01)
c7:00.0	Display controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 150e (rev d1)
c7:00.1	Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
c7:00.2	Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 17e0
c7:00.4	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151e
c7:00.6	Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller
c7:00.7	Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 164a
c8:00.0	Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 150d
c8:00.1	Signal processing controller: Advanced Micro Devices, Inc. [AMD] Device 17f0 (rev 10)
c9:00.0	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151f
c9:00.3	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151a
c9:00.4	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151b
c9:00.5	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151c
c9:00.6	USB controller: Advanced Micro Devices, Inc. [AMD] Device 151d
        1 Reply Last reply Reply Quote 0
        • C Offline
          chicagomed @chicagomed
          last edited by

          Just adding here from my other post---AMD card didn't not reproduce this issue but my Intel Arc card experience matches exactly what others have posted here about the LSPCI vs XE-Assignable / XOA list difference.

          andSmvA A 2 Replies Last reply Reply Quote 0
          • andSmvA Offline
            andSmv Vates 🪐 XCP-ng Team Xen Guru @chicagomed
            last edited by andSmv

            @chicagomed If lspci shows the PCI device in its output we probably need to check if XAPI layer "sees" all this devices and correctly reports them to XO. Ping @Team-XAPI-Network

            C 1 Reply Last reply Reply Quote 1
            • A Offline
              andriy.sultanov Vates 🪐 XAPI & Network Team @chicagomed
              last edited by

              @chicagomed Could you (and others with the issue) please post the output of lspci -mnn for the devices that are not shown in xe pci-list?

              XAPI filters for PCI devices with classes 01XX, 02XX, and 03XX as a safety measure (better to be safe than sorry in avoiding passthrough of critical devices), but perhaps we could reasonably expand this filter.

              marcoiM 1 Reply Last reply Reply Quote 2
              • marcoiM Offline
                marcoi
                last edited by

                here my list - items c6, c8, c9 are not showing up.

                00:00.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1507]"
00:00.2 "IOMMU [0806]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1508]"
00:01.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:01.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" ""
00:01.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150a]" "" ""
00:02.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:02.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:02.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:02.4 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:02.5 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:03.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:03.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:03.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150b]" "" ""
00:08.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [1509]" "" ""
00:08.1 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
00:08.2 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
00:08.3 "PCI bridge [0604]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150c]" "" ""
00:14.0 "SMBus [0c05]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]" -r71 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH SMBus Controller [790b]"
00:14.3 "ISA bridge [0601]" "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]" -r51 "Advanced Micro Devices, Inc. [AMD] [1022]" "FCH LPC Bridge [790e]"
00:18.0 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f8]" "" ""
00:18.1 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16f9]" "" ""
00:18.2 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fa]" "" ""
00:18.3 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fb]" "" ""
00:18.4 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fc]" "" ""
00:18.5 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fd]" "" ""
00:18.6 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16fe]" "" ""
00:18.7 "Host bridge [0600]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [16ff]" "" ""
c1:00.0 "SATA controller [0106]" "JMicron Technology Corp. [197b]" "JMB58x AHCI SATA controller [0585]" -p01 "JMicron Technology Corp. [197b]" "Device [0000]"
c2:00.0 "Non-Volatile memory controller [0108]" "Samsung Electronics Co Ltd [144d]" "NVMe SSD Controller SM961/PM961/SM963 [a804]" -p02 "Samsung Electronics Co Ltd [144d]" "SM963 2.5\" NVMe PCIe SSD [a801]"
c3:00.0 "Ethernet controller [0200]" "Aquantia Corp. [1d6a]" "AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] [04c0]" -r03 "Aquantia Corp. [1d6a]" "Device [0001]"
c4:00.0 "Ethernet controller [0200]" "Realtek Semiconductor Co., Ltd. [10ec]" "Device [8126]" -r01 "Realtek Semiconductor Co., Ltd. [10ec]" "Device [0123]"
c5:00.0 "VGA compatible controller [0300]" "NVIDIA Corporation [10de]" "GK208 [GeForce GT 720] [1286]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]"
c5:00.1 "Audio device [0403]" "NVIDIA Corporation [10de]" "GK208 HDMI/DP Audio Controller [0e0f]" -ra1 "NVIDIA Corporation [10de]" "Device [1087]"
c6:00.0 "USB controller [0c03]" "Etron Technology, Inc. [1b6f]" "EJ168 USB 3.0 Host Controller [7023]" -r01 -p30 "Unknown vendor [7023]" "Device [1b6f]"
c7:00.0 "Display controller [0380]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Device [150e]" -rd1 "Unknown vendor [1f4c]" "Device [b020]"
c7:00.1 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD/ATI] [1002]" "Rembrandt Radeon High Definition Audio Controller [1640]" "Unknown vendor [1f4c]" "Device [b020]"
c7:00.2 "Encryption controller [1080]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17e0]"
c7:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151e]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]"
c7:00.6 "Audio device [0403]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Family 17h/19h HD Audio Controller [15e3]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [d808]"
c7:00.7 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [164a]"
c8:00.0 "Non-Essential Instrumentation [1300]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [150d]"
c8:00.1 "Signal processing controller [1180]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]" -r10 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [17f0]"
c9:00.0 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151f]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [15b9]"
c9:00.3 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151a]"
c9:00.4 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]" -p30 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151b]"
c9:00.5 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151c]"
c9:00.6 "USB controller [0c03]" "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]" -p40 "Advanced Micro Devices, Inc. [AMD] [1022]" "Device [151d]"
                1 Reply Last reply Reply Quote 0
                • marcoiM Offline
                  marcoi @andriy.sultanov
                  last edited by

                  @andriy.sultanov is there a way to allow all devices (even if we blow up the system lol)

                  For example in the docs there a usb filter list you can edit
                  /etc/xensource/usb-policy.conf

                  anything similar for pcie? Can something be added with disclaimer you break it on you etc?
                  Maybe make it a command line option to disable the pci device filters for users that want to pass through special devices.

                  olivierlambertO 1 Reply Last reply Reply Quote 0
                  • olivierlambertO Offline
                    olivierlambert Vates 🪐 Co-Founder CEO @marcoi
                    last edited by

                    @marcoi Right now it's hard coded. But we'll see what could be the best approach on this 🙂

                    marcoiM 1 Reply Last reply Reply Quote 0
                    • marcoiM Offline
                      marcoi @olivierlambert
                      last edited by

                      @olivierlambert thanks for the update.
                      and just to confirm, if a device is not showing up in xe list with uuid, there is no way to pass it to a VM correct?

                      1 Reply Last reply Reply Quote 0
                      • olivierlambertO Offline
                        olivierlambert Vates 🪐 Co-Founder CEO
                        last edited by

                        No, you can pass it anyway, it's just not doable via XO. But the CLI method should work 🙂

                        marcoiM 1 Reply Last reply Reply Quote 0
                        • marcoiM Offline
                          marcoi @olivierlambert
                          last edited by

                          @olivierlambert to confirm the steps
                          i can skip this step since it isnt showing up anyways

                          • xe pci-disable-dom0-access uuid=<pci uuid>

                          then use

                          • xe vm-param-set other-config:pci=0/0000:04:01.0 uuid=<vm uuid> to add it to vm
                          1 Reply Last reply Reply Quote 0
                          • olivierlambertO Offline
                            olivierlambert Vates 🪐 Co-Founder CEO
                            last edited by olivierlambert

                            That might work indeed. If it doesn't, you'll have to go via the old method:

                            /opt/xensource/libexec/xen-cmdline --set-dom0 "xen-pciback.hide=(0000:04:01.0)"

                            Please let us know 🙂 (this way we could update the doc)

                            marcoiM 1 Reply Last reply Reply Quote 0
                            • marcoiM Offline
                              marcoi @olivierlambert
                              last edited by

                              @olivierlambert

                              xe vm-param-set other-config:pci=0/0000:c6:00.0 uuid=45d0f537-9076-b395-1fbd-850d2cc0cf68

                              This command worked. I was able to pass through the usb and also pcie devices i can get to using XO.

                              3555b351-e13d-478d-9df4-7bbcb1643909-image.png

                              windows host showing usb drive plugged into usb3 card and graphics card.

                              b6f55d15-9e66-4606-8a37-7593e3068d3a-image.png

                              1 Reply Last reply Reply Quote 0
                              • olivierlambertO Offline
                                olivierlambert Vates 🪐 Co-Founder CEO
                                last edited by

                                Perfect! It's just a matter of stuff hidden for some reasons, at least it doesn't cause any problem, which is what matters 🙂

                                1 Reply Last reply Reply Quote 1
                                • C Offline
                                  chicagomed @andSmv
                                  last edited by

                                  @andSmv

                                  From LSPCI:

                                  0a:00.0 Audio device: Intel Corporation DG2 Audio Controller
0b:00.0 VGA compatible controller: Intel Corporation DG2 [Arc A310] (rev 05)

                                  With xl pci-assignable-list :

                                  0000:01:00.6
0000:01:00.4
0000:0b:00.0
0000:01:00.0
0000:01:00.3

                                  Here you go...hope this helps!

                                  1 Reply Last reply Reply Quote 0
                                  • First post
                                    Last post