XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Gpu passthrough on Asrock rack B650D4U3-2L2Q will not work

    Scheduled Pinned Locked Moved Hardware
    99 Posts 7 Posters 16.1k Views 5 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S Offline
      steff22 @tuxen
      last edited by steff22

      @tuxen Why is dom0 mem reset to default (dom0_mem=2624M) every time xcp-ng hangs?

      Does 8129mb hold for the new dGPU(rx7800xt) with 16gb ram?

      Assumes that the error still has to do with Cpu and AMD-Vi interrupt remapping.

      XEN) [    1.367192]  ENTRY ADDRESS: ffffffff8242b180
      (XEN) [    1.368155] Dom0 has maximum 8 VCPUs
      (XEN) [    1.391670] Initial low memory virq threshold set at 0x4000 pages.
      (XEN) [    1.392244] Scrubbing Free RAM in background
      (XEN) [    1.392813] Std. Loglevel: Errors, warnings and info
      (XEN) [    1.393387] Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
      (XEN) [    1.393961] Xen is relinquishing VGA console.
      (XEN) [    1.400042] *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
      (XEN) [    1.400187] Freed 2048kB init memory
      (XEN) [  200.115638] d1v0: Unsupported MSI delivery mode 7 for Dom1
      (XEN) [  200.648109] d[IDLE]v22: Unsupported MSI delivery mode 7 for Dom1
      (XEN) [  218.462104] d[IDLE]v22: Unsupported MSI delivery mode 7 for Dom1
      (XEN) [  221.048074] d1v0: Unsupported MSI delivery mode 7 for Dom1
      (XEN) [  532.108813] d[IDLE]v17: Unsupported MSI delivery mode 7 for Dom1
      
      
      T 1 Reply Last reply Reply Quote 0
      • T Offline
        tuxen Top contributor @steff22
        last edited by tuxen

        @steff22 Any change via grub menu is non-persistent and will be reverted in the next (re)boot. It's useful for testing/troubleshooting purposes.

        Regarding dom0 memory increasing, it was a simple boot test to verify possible lack of the resource. Given that IOMMU compat fix, I'd keep the default value for now.

        For the new AMD dGPU failing, any PCI error in dom0 /var/log/kern.log? Post the output of lspci -k -v .

        Tux

        S 2 Replies Last reply Reply Quote 0
        • S Offline
          steff22 @tuxen
          last edited by

          @tuxen

          16:00 xcp-ng-AsRoCk ~]# xl dmesg
           __  __            _  _    _ _____ ____
           \ \/ /___ _ __   | || |  / |___  | ___|
            \  // _ \ '_ \  | || |_ | |  / /|___ \
            /  \  __/ | | | |__   _|| | / /_ ___) |
           /_/\_\___|_| |_|    |_|(_)_|/_/(_)____/
          
          (XEN) [000000827fc97806] Xen version 4.17.5-4 (mockbuild@[unknown]) (gcc (GCC) 11.2.1 20210728 (Red Hat 11.2.1-1)) debug=n Wed Nov 13 11:42:55 CET 2024
          (XEN) [000000827fc988d2] Latest ChangeSet: 430ce6cd9365, pq f09cf5633773
          (XEN) [000000827fc99a1f] build-id: 0c6d91001e3befae6cbe6dbb635b6313c99e706c
          (XEN) [000000827fc9a000] Bootloader: GRUB 2.06
          (XEN) [000000827fc9a60c] Command line: dom0_mem=8129M,max:8129M watchdog ucode=scan dom0_max_vcpus=1-8 crashkernel=256M,below=4G console=vga vga=mode-0x0311
          (XEN) [000000827fc9aec8] Xen image load base address: 0x86e00000
          (XEN) [000000827fc9b27a] Video information:
          (XEN) [000000827fc9bb36]  VGA is graphics mode 1024x768, 32 bpp
          (XEN) [000000827fc9bf69] Disc information:
          (XEN) [000000827fc9c6a2]  Found 0 MBR signatures
          (XEN) [000000827fc9cad5]  Found 4 EDD information structures
          (XEN) [000000827fc9e35b] CPU Vendor: AMD, Family 26 (0x1a), Model 68 (0x44), Stepping 0 (raw 00b40f40)
          (XEN) [000000827fc9f702] Enabling Supervisor Shadow Stacks
          (XEN) [000000827fca47cd] EFI RAM map:
          (XEN) [000000827fca51b6]  [0000000000000000, 000000000009ffff] (usable)
          (XEN) [000000827fca58c4]  [00000000000a0000, 00000000000fffff] (reserved)
          (XEN) [000000827fca5fa7]  [0000000000100000, 0000000009afefff] (usable)
          (XEN) [000000827fca645b]  [0000000009aff000, 0000000009ffffff] (reserved)
          (XEN) [000000827fca68e4]  [000000000a000000, 000000000a1fffff] (usable)
          (XEN) [000000827fca6d42]  [000000000a200000, 000000000a21dfff] (ACPI NVS)
          (XEN) [000000827fca724c]  [000000000a21e000, 000000000affffff] (usable)
          (XEN) [000000827fca767f]  [000000000b000000, 000000000b020fff] (reserved)
          (XEN) [000000827fca7b5e]  [000000000b021000, 000000008857efff] (usable)
          (XEN) [000000827fca8068]  [000000008857f000, 000000008e57efff] (reserved)
          (XEN) [000000827fca851c]  [000000008e57f000, 000000008e67efff] (ACPI data)
          (XEN) [000000827fca8aa7]  [000000008e67f000, 000000009067efff] (ACPI NVS)
          (XEN) [000000827fca8f30]  [000000009067f000, 00000000987fefff] (reserved)
          (XEN) [000000827fca93b9]  [00000000987ff000, 0000000099ff6fff] (usable)
          (XEN) [000000827fca9842]  [0000000099ff7000, 0000000099ffbfff] (reserved)
          (XEN) [000000827fca9ccb]  [0000000099ffc000, 0000000099ffffff] (usable)
          (XEN) [000000827fcaa154]  [000000009a000000, 000000009bffffff] (reserved)
          (XEN) [000000827fcaa5dd]  [000000009d7f3000, 000000009fffffff] (reserved)
          (XEN) [000000827fcaaa3b]  [00000000e0000000, 00000000efffffff] (reserved)
          (XEN) [000000827fcaaeef]  [00000000fd000000, 00000000ffffffff] (reserved)
          (XEN) [000000827fcab47a]  [0000000100000000, 000000083dd7ffff] (usable)
          (XEN) [000000827fcab92e]  [000000083edc0000, 00000008801fffff] (reserved)
          (XEN) [000000827fcabe8e]  [000000fd00000000, 000000ffffffffff] (reserved)
          (XEN) [00000082829c525b] Kdump: 256MB (262144kB) at 0x77000000
          (XEN) [00000082829f0f75] ACPI: RSDP 90665014, 0024 (r2 ALASKA)
          (XEN) [00000082829f31b9] ACPI: XSDT 90664728, 00EC (r1 ALASKA   A M I   1072009 AMI   1000013)
          (XEN) [00000082829f4b41] ACPI: FACP 8E673000, 0114 (r6 ALASKA   A M I   1072009 AMI     10013)
          (XEN) [00000082829f6952] ACPI: DSDT 8E5F6000, 7329C (r208 ALASKA   A M I   1072009 INTL 20230331)
          (XEN) [00000082829f7718] ACPI: FACS 90662000, 0040
          (XEN) [00000082829f84de] ACPI: SSDT 8E676000, 816C (r2    AMD Splinter        2 MSFT  5000000)
          (XEN) [00000082829f947d] ACPI: SPMI 8E675000, 0041 (r5 ALASKA   A M I         0 AMI.        0)
          (XEN) [00000082829fa4f3] ACPI: SSDT 8E674000, 03F1 (r2 ALASKA  CPUSSDT  1072009 AMI   1072009)
          (XEN) [00000082829fb0b5] ACPI: FIDT 8E66D000, 009C (r1 ALASKA    A M I  1072009 AMI     10013)
          (XEN) [00000082829fbba0] ACPI: MCFG 8E66C000, 003C (r1 ALASKA    A M I  1072009 MSFT    10013)
          (XEN) [00000082829fc635] ACPI: HPET 8E66B000, 0038 (r1 ALASKA    A M I  1072009 AMI         5)
          (XEN) [00000082829fd324] ACPI: FPDT 8E66A000, 0044 (r1 ALASKA   A M I   1072009 AMI   1000013)
          (XEN) [00000082829fddb9] ACPI: VFCT 8E5DC000, 190A0 (r1 ALASKA   A M I         1 AMD  33504F47)
          (XEN) [00000082829fe9d1] ACPI: BGRT 8E672000, 0038 (r1 ALASKA   A M I   1072009 AMI     10013)
          (XEN) [00000082829ff466] ACPI: SPCR 8E671000, 0050 (r2 ALASKA   A M I   1072009 AMI     50023)
          (XEN) [00000082829ffea5] ACPI: SSDT 8E5D2000, 9BAE (r2    AMD  AMD CPU        1 AMD         1)
          (XEN) [0000008282a0093a] ACPI: TPM2 8E670000, 004C (r4 ALASKA   A M I         1 AMI         0)
          (XEN) [0000008282a017ac] ACPI: SSDT 8E66F000, 06D4 (r2    AMD  CPMWLRC        1 INTL 20230331)
          (XEN) [0000008282a024f1] ACPI: SSDT 8E5D0000, 169E (r2    AMD CPMDFIG2        1 INTL 20230331)
          (XEN) [0000008282a02f86] ACPI: SSDT 8E5CD000, 2AA6 (r2    AMD CDFAAIG2        1 INTL 20230331)
          (XEN) [0000008282a0399a] ACPI: SSDT 8E66E000, 08BA (r2    AMD CPMDFDG2        1 INTL 20230331)
          (XEN) [0000008282a04404] ACPI: SSDT 8E5C3000, 9A9E (r2    AMD   CPMCMN        1 INTL 20230331)
          (XEN) [0000008282a04e6e] ACPI: SSDT 8E5C0000, 26F3 (r2    AMD AOD             1 INTL 20230331)
          (XEN) [0000008282a05959] ACPI: WSMT 8E5BF000, 0028 (r1 ALASKA   A M I   1072009 AMI     10013)
          (XEN) [0000008282a06398] ACPI: APIC 8E5BE000, 015E (r6 ALASKA   A M I   1072009 AMI     10013)
          (XEN) [0000008282a06dd7] ACPI: IVRS 8E5BD000, 0184 (r2  AMD   AmdTable        1 AMD         1)
          (XEN) [0000008282a0786c] ACPI: SSDT 8E5BC000, 0500 (r2    AMD MEMTOOL0        2 INTL 20230331)
          (XEN) [0000008282a082ab] ACPI: SSDT 8E5BB000, 047C (r2    AMD   AMDWOV        1 INTL 20230331)
          (XEN) [0000008282a08cea] ACPI: SSDT 8E5BA000, 0460 (r2    AMD AmdTable        1 INTL 20230331)
          (XEN) [0000008282a40624] System RAM: 31861MB (32626028kB)
          (XEN) [000000828474af98] No NUMA configuration found
          (XEN) [000000828474bad9] Faking a node at 0000000000000000-000000083dd80000
          (XEN) [000000828908894b] Domain heap initialised
          (XEN) [000000828b2c3f8f] vesafb: framebuffer at 0x00000000fa000000, mapped to 0xffff82c000201000, using 3072k, total 3072k
          (XEN) [000000828b2c49f9] vesafb: mode is 1024x768x32, linelength=4096, font 8x14
          (XEN) [000000828b2c5361] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
          (XEN) [000000828cdbdf73] SMBIOS 3.7 present.
          (XEN) [000000828ce3e93c] XSM Framework v1.0.1 initialized
          (XEN) [000000828cef265f] Initialising XSM SILO mode
          (XEN) [000000828d02e7be] Using APIC driver default
          (XEN) [000000828d0e0fe2] ACPI: PM-Timer IO Port: 0x808 (32 bits)
          (XEN) [000000828d1931cf] ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
          (XEN) [000000828d26c08c] ACPI: SLEEP INFO: pm1x_cnt[1:804,1:0], pm1x_evt[1:800,1:0]
          (XEN) [000000828d361e0a] ACPI: 32/64X FACS address mismatch in FADT - 90662000/0000000000000000, using 32
          (XEN) [000000828d48e477] ACPI:             wakeup_vec[9066200c], vec_size[20]
          (XEN) [000000828d69b71a] Overriding APIC driver with bigsmp
          (XEN) [000000828d778657] ACPI: IOAPIC (id[0x20] address[0xfec00000] gsi_base[0])
          (XEN) [000000828d85255f] IOAPIC[0]: apic_id 32, version 33, address 0xfec00000, GSI 0-23
          (XEN) [000000828d9540ab] ACPI: IOAPIC (id[0x21] address[0xfec01000] gsi_base[24])
          (XEN) [000000828da450ba] IOAPIC[1]: apic_id 33, version 33, address 0xfec01000, GSI 24-55
          (XEN) [000000828db77562] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
          (XEN) [000000828dc54724] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
          (XEN) [000000828dd7dbae] ACPI: HPET id: 0x10228201 base: 0xfed00000
          (XEN) [000000828de3ef50] PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - ff
          (XEN) [000000828df4369e] PCI: MCFG area at e0000000 reserved in E820
          (XEN) [000000828e01363f] PCI: Using MCFG for segment 0000 bus 00-ff
          (XEN) [000000828e0e4e66] ACPI: BGRT: invalidating v1 image at 0x824e9018
          (XEN) [000000828e1bb37b] Using ACPI (MADT) for SMP configuration information
          (XEN) [000000828e29f169] SMP: Allowing 32 CPUs (0 hotplug CPUs)
          (XEN) [000000828e36a74d] IRQ limits: 56 GSI, 6600 MSI/MSI-X
          (XEN) [000000828e5a7e17] BSP microcode revision: 0x0b404022
          (XEN) [000000828e6512ec] xstate: size: 0x988 and states: 0x2e7
          (XEN) [000000828e75dab9] CPU0: AMD Fam1ah machine check reporting enabled
          (XEN) [000000828e82880c] Speculative mitigation facilities:
          (XEN) [000000828e8e0a38]   Hardware hints: STIBP_ALWAYS IBRS_FAST IBRS_SAME_MODE BTC_NO IBPB_RET IBPB_BRTYPE
          (XEN) [000000828ea141db]   Hardware features: IBPB IBRS STIBP SSBD PSFD L1D_FLUSH SBPB
          (XEN) [000000828eb10db4]   Compiled-in support: INDIRECT_THUNK HARDEN_ARRAY HARDEN_BRANCH HARDEN_GUEST_ACCESS HARDEN_LOCK
          (XEN) [000000828ec65417]   Xen settings: BTI-Thunk: JMP, SPEC_CTRL: IBRS+ STIBP+ SSBD- PSFD-, Other: IBPB-ctxt BRANCH_HARDEN
          (XEN) [000000828edc0579]   Support for HVM VMs: MSR_SPEC_CTRL MSR_VIRT_SPEC_CTRL RSB IBPB-entry
          (XEN) [000000828eed4284]   Support for PV VMs: None
          (XEN) [000000828ef7b0b7]   XPTI (64-bit PV only): Dom0 disabled, DomU disabled (without PCID)
          (XEN) [000000828f08a3da]   PV L1TF shadowing: Dom0 disabled, DomU disabled
          (XEN) [000000828f168e4d] Using scheduler: SMP Credit Scheduler (credit)
          (XEN) [000000829bf01255] Platform timer is 14.318MHz HPET
          (XEN) [    0.110221] Detected 4292.017 MHz processor.
          (XEN) [    0.112883] EFI memory map:
          (XEN) [    0.112982]  0000000000000-0000000003fff type=2 attr=000000000000000f
          (XEN) [    0.113199]  0000000004000-000000008efff type=7 attr=000000000000000f
          (XEN) [    0.113421]  000000008f000-000000009efff type=2 attr=000000000000000f
          (XEN) [    0.113639]  000000009f000-000000009ffff type=4 attr=000000000000000f
          (XEN) [    0.113857]  0000000100000-00000039e2fff type=2 attr=000000000000000f
          (XEN) [    0.114074]  00000039e3000-0000009afefff type=7 attr=000000000000000f
          (XEN) [    0.114291]  0000009aff000-0000009ffffff type=0 attr=000000000000000f
          (XEN) [    0.114509]  000000a000000-000000a1fffff type=7 attr=000000000000000f
          (XEN) [    0.114726]  000000a200000-000000a21dfff type=10 attr=000000000000000f
          (XEN) [    0.114947] Setting RUNTIME attribute for 000000a200000-000000a21dfff
          (XEN) [    0.115165]  000000a21e000-000000a29dfff type=4 attr=000000000000000f
          (XEN) [    0.115382]  000000a29e000-000000affffff type=7 attr=000000000000000f
          (XEN) [    0.115600]  000000b000000-000000b020fff type=0 attr=000000000000000f
          (XEN) [    0.115817]  000000b021000-000005f933fff type=7 attr=000000000000000f
          (XEN) [    0.121149]  000005f934000-000007fce9fff type=1 attr=000000000000000f
          (XEN) [    0.126647]  000007fcea000-000007fcecfff type=4 attr=000000000000000f
          (XEN) [    0.132140]  000007fced000-000007fd2bfff type=7 attr=000000000000000f
          (XEN) [    0.137568]  000007fd2c000-000007fd2cfff type=4 attr=000000000000000f
          (XEN) [    0.143016]  000007fd2d000-000007fd30fff type=7 attr=000000000000000f
          (XEN) [    0.148531]  000007fd31000-000007fd40fff type=4 attr=000000000000000f
          (XEN) [    0.154039]  000007fd41000-000007fd44fff type=7 attr=000000000000000f
          (XEN) [    0.159432]  000007fd45000-000007fd45fff type=4 attr=000000000000000f
          (XEN) [    0.164852]  000007fd46000-000007fd4dfff type=7 attr=000000000000000f
          (XEN) [    0.170250]  000007fd4e000-000007fd5dfff type=4 attr=000000000000000f
          (XEN) [    0.175758]  000007fd5e000-000007fd5ffff type=7 attr=000000000000000f
          (XEN) [    0.181125]  000007fd60000-000007fd7bfff type=4 attr=000000000000000f
          (XEN) [    0.186519]  000007fd7c000-000007fef9fff type=7 attr=000000000000000f
          (XEN) [    0.191873]  000007fefa000-000008000dfff type=1 attr=000000000000000f
          (XEN) [    0.197293]  000008000e000-0000080074fff type=7 attr=000000000000000f
          (XEN) [    0.202613]  0000080075000-0000080093fff type=4 attr=000000000000000f
          (XEN) [    0.207988]  0000080094000-00000800eafff type=7 attr=000000000000000f
          (XEN) [    0.213329]  00000800eb000-00000800ecfff type=4 attr=000000000000000f
          (XEN) [    0.218740]  00000800ed000-00000800edfff type=7 attr=000000000000000f
          (XEN) [    0.224073]  00000800ee000-00000800eefff type=4 attr=000000000000000f
          (XEN) [    0.229444]  00000800ef000-00000800f8fff type=7 attr=000000000000000f
          (XEN) [    0.234841]  00000800f9000-00000800fcfff type=4 attr=000000000000000f
          (XEN) [    0.240147]  00000800fd000-00000800fffff type=7 attr=000000000000000f
          (XEN) [    0.245498]  0000080100000-0000080101fff type=4 attr=000000000000000f
          (XEN) [    0.250929]  0000080102000-0000080105fff type=7 attr=000000000000000f
          (XEN) [    0.256354]  0000080106000-0000080106fff type=4 attr=000000000000000f
          (XEN) [    0.261742]  0000080107000-0000080108fff type=7 attr=000000000000000f
          (XEN) [    0.267146]  0000080109000-0000080109fff type=4 attr=000000000000000f
          (XEN) [    0.272489]  000008010a000-000008010bfff type=7 attr=000000000000000f
          (XEN) [    0.277801]  000008010c000-000008010cfff type=2 attr=000000000000000f
          (XEN) [    0.283028]  000008010d000-0000081588fff type=4 attr=000000000000000f
          (XEN) [    0.288256]  0000081589000-0000081589fff type=7 attr=000000000000000f
          (XEN) [    0.293411]  000008158a000-0000081599fff type=4 attr=000000000000000f
          (XEN) [    0.298513]  000008159a000-000008159afff type=7 attr=000000000000000f
          (XEN) [    0.303592]  000008159b000-00000815a6fff type=4 attr=000000000000000f
          (XEN) [    0.308724]  00000815a7000-00000815abfff type=7 attr=000000000000000f
          (XEN) [    0.313868]  00000815ac000-000008226dfff type=4 attr=000000000000000f
          (XEN) [    0.318971]  000008226e000-0000082279fff type=7 attr=000000000000000f
          (XEN) [    0.324069]  000008227a000-0000082299fff type=4 attr=000000000000000f
          (XEN) [    0.329321]  000008229a000-00000822a0fff type=7 attr=000000000000000f
          (XEN) [    0.334467]  00000822a1000-00000822aefff type=4 attr=000000000000000f
          (XEN) [    0.339595]  00000822af000-00000822affff type=7 attr=000000000000000f
          (XEN) [    0.344722]  00000822b0000-00000822b2fff type=4 attr=000000000000000f
          (XEN) [    0.349914]  00000822b3000-00000822b5fff type=7 attr=000000000000000f
          (XEN) [    0.355068]  00000822b6000-00000822c4fff type=4 attr=000000000000000f
          (XEN) [    0.360195]  00000822c5000-00000822c5fff type=7 attr=000000000000000f
          (XEN) [    0.365349]  00000822c6000-00000826b4fff type=4 attr=000000000000000f
          (XEN) [    0.370529]  00000826b5000-00000826bafff type=7 attr=000000000000000f
          (XEN) [    0.375689]  00000826bb000-00000826d4fff type=4 attr=000000000000000f
          (XEN) [    0.380813]  00000826d5000-00000826d8fff type=7 attr=000000000000000f
          (XEN) [    0.385971]  00000826d9000-000008284ffff type=4 attr=000000000000000f
          (XEN) [    0.391121]  0000082850000-0000082851fff type=7 attr=000000000000000f
          (XEN) [    0.396254]  0000082852000-0000082855fff type=4 attr=000000000000000f
          (XEN) [    0.401379]  0000082856000-0000082856fff type=7 attr=000000000000000f
          (XEN) [    0.406588]  0000082857000-0000082858fff type=4 attr=000000000000000f
          (XEN) [    0.411727]  0000082859000-000008285afff type=7 attr=000000000000000f
          (XEN) [    0.416853]  000008285b000-000008298ffff type=4 attr=000000000000000f
          (XEN) [    0.421995]  0000082990000-0000082991fff type=7 attr=000000000000000f
          (XEN) [    0.427175]  0000082992000-0000082b01fff type=4 attr=000000000000000f
          (XEN) [    0.432299]  0000082b02000-0000082b02fff type=7 attr=000000000000000f
          (XEN) [    0.437443]  0000082b03000-000008657efff type=4 attr=000000000000000f
          (XEN) [    0.442599]  000008657f000-0000086ffffff type=7 attr=000000000000000f
          (XEN) [    0.447763]  0000087000000-00000879fffff type=2 attr=000000000000000f
          (XEN) [    0.452888]  0000087a00000-0000087a4bfff type=7 attr=000000000000000f
          (XEN) [    0.458017]  0000087a4c000-000008857efff type=3 attr=000000000000000f
          (XEN) [    0.463182]  000008857f000-000008e57efff type=0 attr=000000000000000f
          (XEN) [    0.468329]  000008e57f000-000008e67efff type=9 attr=000000000000000f
          (XEN) [    0.473453]  000008e67f000-000009067efff type=10 attr=000000000000000f
          (XEN) [    0.478590] Setting RUNTIME attribute for 000008e67f000-000009067efff
          (XEN) [    0.483789]  000009067f000-000009867efff type=6 attr=800000000000000f
          (XEN) [    0.488926]  000009867f000-00000987fefff type=5 attr=800000000000000f
          (XEN) [    0.494058]  00000987ff000-0000098dfffff type=4 attr=000000000000000f
          (XEN) [    0.499217]  0000098e00000-0000098f0cfff type=7 attr=000000000000000f
          (XEN) [    0.504381]  0000098f0d000-000009900cfff type=4 attr=000000000000000f
          (XEN) [    0.509508]  000009900d000-0000099031fff type=3 attr=000000000000000f
          (XEN) [    0.514638]  0000099032000-0000099066fff type=4 attr=000000000000000f
          (XEN) [    0.519811]  0000099067000-0000099098fff type=3 attr=000000000000000f
          (XEN) [    0.524958]  0000099099000-00000990b1fff type=4 attr=000000000000000f
          (XEN) [    0.530087]  00000990b2000-00000990c9fff type=3 attr=000000000000000f
          (XEN) [    0.535216]  00000990ca000-0000099e5cfff type=4 attr=000000000000000f
          (XEN) [    0.540394]  0000099e5d000-0000099e60fff type=3 attr=000000000000000f
          (XEN) [    0.545534]  0000099e61000-0000099e74fff type=4 attr=000000000000000f
          (XEN) [    0.550662]  0000099e75000-0000099e76fff type=3 attr=000000000000000f
          (XEN) [    0.555816]  0000099e77000-0000099e87fff type=4 attr=000000000000000f
          (XEN) [    0.560985]  0000099e88000-0000099eacfff type=3 attr=000000000000000f
          (XEN) [    0.566125]  0000099ead000-0000099eaefff type=4 attr=000000000000000f
          (XEN) [    0.571252]  0000099eaf000-0000099eaffff type=7 attr=000000000000000f
          (XEN) [    0.576415]  0000099eb0000-0000099ed3fff type=4 attr=000000000000000f
          (XEN) [    0.581571]  0000099ed4000-0000099ed4fff type=7 attr=000000000000000f
          (XEN) [    0.586724]  0000099ed5000-0000099ed5fff type=3 attr=000000000000000f
          (XEN) [    0.591852]  0000099ed6000-0000099fe7fff type=4 attr=000000000000000f
          (XEN) [    0.597080]  0000099fe8000-0000099feefff type=3 attr=000000000000000f
          (XEN) [    0.602213]  0000099fef000-0000099ff6fff type=4 attr=000000000000000f
          (XEN) [    0.607344]  0000099ff7000-0000099ffbfff type=6 attr=800000000000000f
          (XEN) [    0.612474]  0000099ffc000-0000099ffffff type=4 attr=000000000000000f
          (XEN) [    0.617686]  0000100000000-000083dd7ffff type=7 attr=000000000000000f
          (XEN) [    0.622824]  00000000a0000-00000000fffff type=0 attr=000000000000000f
          (XEN) [    0.627966]  000009a000000-000009bffffff type=0 attr=000000000000000f
          (XEN) [    0.633127]  000009d7f3000-000009fffffff type=0 attr=000000000000000f
          (XEN) [    0.638341]  00000e0000000-00000efffffff type=11 attr=800000000000100d
          (XEN) [    0.643486]  00000fd000000-00000fedfffff type=11 attr=800000000000100d
          (XEN) [    0.648628]  00000fee00000-00000fee00fff type=11 attr=8000000000000001
          (XEN) [    0.653835]  00000fee01000-00000ffffffff type=11 attr=800000000000100d
          (XEN) [    0.658991]  000083edc0000-000085fffffff type=0 attr=000000000000000f
          (XEN) [    0.664128]  0000860000000-00008801fffff type=11 attr=800000000000100d
          (XEN) [    0.669267]  000fd00000000-000ffffffffff type=0 attr=0000000000000001
          (XEN) [    0.674512] alt table ffff82d0406a36b8 -> ffff82d0406b2cc2
          (XEN) [    0.689657] AMD-Vi: IOMMU Extended Features:
          (XEN) [    0.694746] - Peripheral Page Service Request
          (XEN) [    0.699787] - NX bit
          (XEN) [    0.704776] - Guest APIC Physical Processor Interrupt
          (XEN) [    0.709829] - Invalidate All Command
          (XEN) [    0.714833] - Guest APIC
          (XEN) [    0.719720] - Performance Counters
          (XEN) [    0.724591] - Host Address Translation Size: 0x2
          (XEN) [    0.729539] - Guest Address Translation Size: 0
          (XEN) [    0.734461] - Guest CR3 Root Table Level: 0x1
          (XEN) [    0.739279] - Maximum PASID: 0xf
          (XEN) [    0.744043] - SMI Filter Register: 0x1
          (XEN) [    0.748849] - SMI Filter Register Count: 0x1
          (XEN) [    0.753608] - Guest Virtual APIC Modes: 0x1
          (XEN) [    0.758296] - Dual PPR Log: 0x2
          (XEN) [    0.762922] - Dual Event Log: 0x2
          (XEN) [    0.767590] - Secure ATS
          (XEN) [    0.772286] - User / Supervisor Page Protection
          (XEN) [    0.776982] - Device Table Segmentation: 0x3
          (XEN) [    0.781810] - PPR Log Overflow Early Warning
          (XEN) [    0.786466] - PPR Automatic Response
          (XEN) [    0.791063] - Memory Access Routing and Control: 0x1
          (XEN) [    0.795822] - Block StopMark Message
          (XEN) [    0.800561] - Performance Optimization
          (XEN) [    0.805225] - MSI Capability MMIO Access
          (XEN) [    0.809709] - Guest I/O Protection
          (XEN) [    0.814243] - Enhanced PPR Handling
          (XEN) [    0.818659] - Invalidate IOTLB Type
          (XEN) [    0.823129] - VM Table Size: 0x2
          (XEN) [    0.827519] - Guest Access Bit Update Disable
          (XEN) [    0.840327] AMD-Vi: IOMMU 0 Enabled.
          (XEN) [    0.844726] I/O virtualisation enabled
          (XEN) [    0.848814]  - Dom0 mode: Relaxed
          (XEN) [    0.852959] Interrupt remapping enabled
          (XEN) [    0.857118] Enabled directed EOI with ioapic_ack_old on!
          (XEN) [    0.861276] Enabling APIC mode.  Using 2 I/O APICs
          (XEN) [    0.866315] ENABLING IO-APIC IRQs
          (XEN) [    0.870281]  -> Using old ACK method
          (XEN) [    0.874537] ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
          (XEN) [    1.698223] Defaulting to alternative key handling; send 'A' to switch to normal mode.
          (XEN) [    1.702257] Allocated console ring of 128 KiB.
          (XEN) [    1.706232] HVM: ASIDs enabled.
          (XEN) [    1.710146] SVM: Supported advanced features:
          (XEN) [    1.714065]  - Nested Page Tables (NPT)
          (XEN) [    1.717941]  - Last Branch Record (LBR) Virtualisation
          (XEN) [    1.721835]  - Next-RIP Saved on #VMEXIT
          (XEN) [    1.725680]  - VMCB Clean Bits
          (XEN) [    1.729465]  - DecodeAssists
          (XEN) [    1.733200]  - Virtual VMLOAD/VMSAVE
          (XEN) [    1.736913]  - Virtual GIF
          (XEN) [    1.740559]  - Pause-Intercept Filter
          (XEN) [    1.744191]  - Pause-Intercept Filter Threshold
          (XEN) [    1.747819]  - TSC Rate MSR
          (XEN) [    1.751375]  - NPT Supervisor Shadow Stack
          (XEN) [    1.754970]  - MSR_SPEC_CTRL virtualisation
          (XEN) [    1.758551] HVM: SVM enabled
          (XEN) [    1.762088] HVM: Hardware Assisted Paging (HAP) detected
          (XEN) [    1.765708] HVM: HAP page sizes: 4kB, 2MB, 1GB
          (XEN) [    1.769470] alt table ffff82d0406a36b8 -> ffff82d0406b2cc2
          (XEN) [    2.404814] Brought up 32 CPUs
          (XEN) [    2.408391] Testing NMI watchdog on all CPUs:ok
          (XEN) [    2.431106] Scheduling granularity: cpu, 1 CPU per sched-resource
          (XEN) [    2.434864] mcheck_poll: Machine check polling timer started.
          (XEN) [    2.458726] NX (Execute Disable) protection active
          (XEN) [    2.462413] d0 has maximum 1304 PIRQs
          (XEN) [    2.466186] csched_alloc_domdata: setting dom 0 as the privileged domain
          (XEN) [    2.469986] *** Building a PV Dom0 ***
          (XEN) [    2.592247]  Xen  kernel: 64-bit, lsb
          (XEN) [    2.595990]  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x302c000
          (XEN) [    2.600060] PHYSICAL MEMORY ARRANGEMENT:
          (XEN) [    2.603951]  Dom0 alloc.:   0000000820000000->0000000824000000 (2051762 pages to be allocated)
          (XEN) [    2.608215]  Init. ramdisk: 000000083a9b2000->000000083dbff800
          (XEN) [    2.612322] VIRTUAL MEMORY ARRANGEMENT:
          (XEN) [    2.616306]  Loaded kernel: ffffffff81000000->ffffffff8302c000
          (XEN) [    2.620364]  Phys-Mach map: 0000008000000000->0000008000fe0800
          (XEN) [    2.624514]  Start info:    ffffffff8302c000->ffffffff8302c4b8
          (XEN) [    2.628633]  Page tables:   ffffffff8302d000->ffffffff8304a000
          (XEN) [    2.632791]  Boot stack:    ffffffff8304a000->ffffffff8304b000
          (XEN) [    2.636935]  TOTAL:         ffffffff80000000->ffffffff83400000
          (XEN) [    2.641097]  ENTRY ADDRESS: ffffffff8242b180
          (XEN) [    2.645597] Dom0 has maximum 8 VCPUs
          (XEN) [    2.674053] Initial low memory virq threshold set at 0x4000 pages.
          (XEN) [    2.678287] Scrubbing Free RAM in background
          (XEN) [    2.682587] Std. Loglevel: Errors, warnings and info
          (XEN) [    2.687042] Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
          (XEN) [    2.691560] Xen is relinquishing VGA console.
          (XEN) [    2.705974] *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
          (XEN) [    2.706122] Freed 2048kB init memory
          (XEN) [  308.667953] d1v0 VIRIDIAN GUEST_CRASH: 0x7e 0xffffffffc0000096 0xfffff8024e294935 0xffffc58546066e78 0xffffc585460666b0
          (XEN) [  573.788833] d2v0: Unsupported MSI delivery mode 7 for Dom2
          (XEN) [  741.438068] d[IDLE]v8: Unsupported MSI delivery mode 7 for Dom2
          (XEN) [  758.035296] d2v0: Unsupported MSI delivery mode 7 for Dom2
          (XEN) [ 2493.164712] memory_map:fail: dom3 gfn=fffffffff1800 mfn=fcd0000 nr=200 ret:-2
          (XEN) [ 2493.164721] memory_map: error -22 removing dom3 access to [fcd0000,fcd01ff]
          (XEN) [ 2498.147544] memory_map: error -22 removing dom3 access to [fcd0000,fcd01ff]
          (XEN) [10926.717607] memory_map:fail: dom4 gfn=fffffffff1800 mfn=fcd0000 nr=200 ret:-2
          (XEN) [10926.717620] memory_map: error -22 removing dom4 access to [fcd0000,fcd01ff]
          (XEN) [10931.683056] memory_map: error -22 removing dom4 access to [fcd0000,fcd01ff]
          [16:00 xcp-ng-AsRoCk ~]# 
          
          
          
          1 Reply Last reply Reply Quote 0
          • S Offline
            steff22 @tuxen
            last edited by

            @tuxen

            [16:00 xcp-ng-AsRoCk ~]# lspci -k -v
            00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14d8
            	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14d8
            	Flags: fast devsel
            
            00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 14d9
            	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14d9
            	Flags: bus master, fast devsel, latency 0, IRQ 255
            	Capabilities: [40] Secure device <?>
            	Capabilities: [64] MSI: Enable- Count=1/4 Maskable- 64bit+
            	Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+
            
            00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
            	Flags: fast devsel
            
            00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0
            	Bus: primary=00, secondary=01, subordinate=03, sec-latency=0
            	I/O behind bridge: 0000f000-0000ffff
            	Memory behind bridge: fbe00000-fc0fffff
            	Prefetchable memory behind bridge: 000000fcc0000000-000000fcd01fffff
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Root Port (Slot+), MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
            	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [370] L1 PM Substates
            	Capabilities: [3c4] #23
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [440] #27
            	Capabilities: [500] #2a
            	Kernel driver in use: pcieport
            
            00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0
            	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
            	Memory behind bridge: fc300000-fc3fffff
            	Prefetchable memory behind bridge: 000000fcf0000000-000000fcf20fffff
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Root Port (Slot+), MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
            	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [370] L1 PM Substates
            	Capabilities: [3c4] #23
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [440] #27
            	Capabilities: [500] #2a
            	Kernel driver in use: pcieport
            
            00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
            	Flags: fast devsel
            
            00:02.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0
            	Bus: primary=00, secondary=05, subordinate=0f, sec-latency=0
            	I/O behind bridge: 0000b000-0000dfff
            	Memory behind bridge: fa000000-fb6fffff
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Root Port (Slot+), MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
            	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [370] L1 PM Substates
            	Capabilities: [3c4] #23
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [440] #27
            	Capabilities: [500] #2a
            	Kernel driver in use: pcieport
            
            00:02.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0
            	Bus: primary=00, secondary=10, subordinate=10, sec-latency=0
            	Memory behind bridge: fc200000-fc2fffff
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Root Port (Slot+), MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
            	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [370] L1 PM Substates
            	Capabilities: [3c4] #23
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [440] #27
            	Capabilities: [500] #2a
            	Kernel driver in use: pcieport
            
            00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
            	Flags: fast devsel
            
            00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
            	Flags: fast devsel
            
            00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
            	Flags: fast devsel
            
            00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14dd (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 26
            	Bus: primary=00, secondary=11, subordinate=11, sec-latency=0
            	I/O behind bridge: 0000e000-0000efff
            	Memory behind bridge: fb800000-fbdfffff
            	Prefetchable memory behind bridge: 000000fce0000000-000000fcefffffff
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Root Port (Slot-), MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14dd
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [450] #27
            	Kernel driver in use: pcieport
            
            00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14dd (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 26
            	Bus: primary=00, secondary=12, subordinate=12, sec-latency=0
            	Memory behind bridge: fc100000-fc1fffff
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Root Port (Slot-), MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14dd
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [450] #27
            	Kernel driver in use: pcieport
            
            00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 71)
            	Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
            	Flags: 66MHz, medium devsel
            	Kernel driver in use: piix4_smbus
            	Kernel modules: i2c_piix4
            
            00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
            	Subsystem: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
            	Flags: bus master, 66MHz, medium devsel, latency 0
            
            00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e0
            	Flags: fast devsel
            
            00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e1
            	Flags: fast devsel
            
            00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e2
            	Flags: fast devsel
            
            00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e3
            	Flags: fast devsel
            
            00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e4
            	Flags: fast devsel
            
            00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e5
            	Flags: fast devsel
            
            00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e6
            	Flags: fast devsel
            
            00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e7
            	Flags: fast devsel
            
            01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch (rev 11) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 24
            	Memory at fc000000 (32-bit, non-prefetchable) [size=16K]
            	Bus: primary=01, secondary=02, subordinate=03, sec-latency=0
            	I/O behind bridge: 0000f000-0000ffff
            	Memory behind bridge: fbe00000-fbffffff
            	Prefetchable memory behind bridge: 000000fcc0000000-000000fcd01fffff
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Upstream Port, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [150] Advanced Error Reporting
            	Capabilities: [270] #19
            	Capabilities: [320] Latency Tolerance Reporting
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [440] #27
            	Kernel driver in use: pcieport
            
            02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch (rev 11) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 24
            	Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
            	I/O behind bridge: 0000f000-0000ffff
            	Memory behind bridge: fbe00000-fbffffff
            	Prefetchable memory behind bridge: 000000fcc0000000-000000fcd01fffff
            	Capabilities: [50] Power Management version 3
            	Capabilities: [58] Express Downstream Port (Slot-), MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [150] Advanced Error Reporting
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [400] #25
            	Capabilities: [410] #26
            	Capabilities: [450] #27
            	Kernel driver in use: pcieport
            
            03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 32 [Radeon RX 7700 XT / 7800 XT] (rev ff) (prog-if ff)
            	!!! Unknown header type 7f
            	Kernel driver in use: pciback
            
            03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 HDMI/DP Audio (rev ff) (prog-if ff)
            	!!! Unknown header type 7f
            	Kernel driver in use: pciback
            
            04:00.0 Ethernet controller: Broadcom Inc. and subsidiaries BCM57502 NetXtreme-E 10Gb/25Gb/40Gb/50Gb Ethernet (rev 12)
            	Subsystem: ASRock Incorporation Device 1752
            	Flags: bus master, fast devsel, latency 0, IRQ 28
            	Memory at fcf2010000 (64-bit, prefetchable) [size=64K]
            	Memory at fcf1000000 (64-bit, prefetchable) [size=16M]
            	Memory at fcf2028000 (64-bit, prefetchable) [size=32K]
            	Expansion ROM at fc380000 [disabled] [size=512K]
            	Capabilities: [48] Power Management version 3
            	Capabilities: [50] Vital Product Data
            	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
            	Capabilities: [ac] Express Endpoint, MSI 00
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [13c] Device Serial Number 9c-6b-00-ff-fe-65-38-6b
            	Capabilities: [150] Power Budgeting <?>
            	Capabilities: [160] Virtual Channel
            	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
            	Capabilities: [1b0] Latency Tolerance Reporting
            	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
            	Capabilities: [230] Transaction Processing Hints
            	Capabilities: [300] #19
            	Capabilities: [200] Precision Time Measurement
            	Capabilities: [358] #26
            	Capabilities: [388] #27
            	Kernel driver in use: bnxt_en
            	Kernel modules: bnxt_en
            
            04:00.1 Ethernet controller: Broadcom Inc. and subsidiaries BCM57502 NetXtreme-E 10Gb/25Gb/40Gb/50Gb Ethernet (rev 12)
            	Subsystem: ASRock Incorporation Device 1752
            	Flags: bus master, fast devsel, latency 0, IRQ 29
            	Memory at fcf2000000 (64-bit, prefetchable) [size=64K]
            	Memory at fcf0000000 (64-bit, prefetchable) [size=16M]
            	Memory at fcf2020000 (64-bit, prefetchable) [size=32K]
            	Expansion ROM at fc300000 [disabled] [size=512K]
            	Capabilities: [48] Power Management version 3
            	Capabilities: [50] Vital Product Data
            	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
            	Capabilities: [ac] Express Endpoint, MSI 00
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [13c] Device Serial Number 9c-6b-00-ff-fe-65-38-6b
            	Capabilities: [150] Power Budgeting <?>
            	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
            	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
            	Capabilities: [230] Transaction Processing Hints
            	Kernel driver in use: bnxt_en
            	Kernel modules: bnxt_en
            
            05:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Upstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Bus: primary=05, secondary=06, subordinate=0f, sec-latency=0
            	I/O behind bridge: 0000b000-0000dfff
            	Memory behind bridge: fa000000-fb6fffff
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Upstream Port, MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [160] Latency Tolerance Reporting
            	Capabilities: [1c0] #19
            	Capabilities: [200] L1 PM Substates
            	Capabilities: [220] #25
            	Capabilities: [240] #26
            	Capabilities: [280] #27
            	Kernel driver in use: pcieport
            
            06:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Bus: primary=06, secondary=07, subordinate=07, sec-latency=0
            	Memory behind bridge: fb600000-fb6fffff
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [1c0] #19
            	Capabilities: [200] L1 PM Substates
            	Capabilities: [220] #25
            	Capabilities: [240] #26
            	Capabilities: [280] #27
            	Kernel driver in use: pcieport
            
            06:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 47
            	Bus: primary=06, secondary=08, subordinate=08, sec-latency=0
            	I/O behind bridge: 0000d000-0000dfff
            	Memory behind bridge: fb500000-fb5fffff
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [1c0] #19
            	Capabilities: [200] L1 PM Substates
            	Capabilities: [220] #25
            	Capabilities: [240] #26
            	Capabilities: [280] #27
            	Kernel driver in use: pcieport
            
            06:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 44
            	Bus: primary=06, secondary=09, subordinate=09, sec-latency=0
            	I/O behind bridge: 0000c000-0000cfff
            	Memory behind bridge: fb400000-fb4fffff
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [1c0] #19
            	Capabilities: [200] L1 PM Substates
            	Capabilities: [220] #25
            	Capabilities: [240] #26
            	Capabilities: [280] #27
            	Kernel driver in use: pcieport
            
            06:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 45
            	Bus: primary=06, secondary=0a, subordinate=0b, sec-latency=0
            	I/O behind bridge: 0000b000-0000bfff
            	Memory behind bridge: fa000000-fb0fffff
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [1c0] #19
            	Capabilities: [200] L1 PM Substates
            	Capabilities: [220] #25
            	Capabilities: [240] #26
            	Capabilities: [280] #27
            	Kernel driver in use: pcieport
            
            06:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Bus: primary=06, secondary=0c, subordinate=0c, sec-latency=0
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [1c0] #19
            	Capabilities: [200] L1 PM Substates
            	Capabilities: [220] #25
            	Capabilities: [240] #26
            	Capabilities: [280] #27
            	Kernel driver in use: pcieport
            
            06:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Bus: primary=06, secondary=0d, subordinate=0d, sec-latency=0
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [1c0] #19
            	Capabilities: [200] L1 PM Substates
            	Capabilities: [220] #25
            	Capabilities: [240] #26
            	Capabilities: [280] #27
            	Kernel driver in use: pcieport
            
            06:0c.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Bus: primary=06, secondary=0e, subordinate=0e, sec-latency=0
            	Memory behind bridge: fb300000-fb3fffff
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot-), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Kernel driver in use: pcieport
            
            06:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 47
            	Bus: primary=06, secondary=0f, subordinate=0f, sec-latency=0
            	Memory behind bridge: fb200000-fb2fffff
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Downstream Port (Slot-), MSI 00
            	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
            	Capabilities: [100] Advanced Error Reporting
            	Kernel driver in use: pcieport
            
            07:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller (rev 03) (prog-if 30 [XHCI])
            	Subsystem: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Memory at fb600000 (64-bit, non-prefetchable) [size=8K]
            	Capabilities: [50] Power Management version 3
            	Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+
            	Capabilities: [90] MSI-X: Enable+ Count=8 Masked-
            	Capabilities: [a0] Express Endpoint, MSI 00
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [150] Latency Tolerance Reporting
            	Kernel driver in use: pciback
            	Kernel modules: xhci_pci
            
            08:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
            	Subsystem: ASRock Incorporation Device 1533
            	Flags: bus master, fast devsel, latency 0, IRQ 47
            	Memory at fb500000 (32-bit, non-prefetchable) [size=512K]
            	I/O ports at d000 [size=32]
            	Memory at fb580000 (32-bit, non-prefetchable) [size=16K]
            	Capabilities: [40] Power Management version 3
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
            	Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
            	Capabilities: [a0] Express Endpoint, MSI 00
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [140] Device Serial Number 9c-6b-00-ff-ff-65-37-bf
            	Capabilities: [1a0] Transaction Processing Hints
            	Kernel driver in use: igb
            	Kernel modules: igb
            
            09:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
            	Subsystem: ASRock Incorporation Device 1533
            	Flags: bus master, fast devsel, latency 0, IRQ 44
            	Memory at fb400000 (32-bit, non-prefetchable) [size=512K]
            	I/O ports at c000 [size=32]
            	Memory at fb480000 (32-bit, non-prefetchable) [size=16K]
            	Capabilities: [40] Power Management version 3
            	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
            	Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
            	Capabilities: [a0] Express Endpoint, MSI 00
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [140] Device Serial Number 9c-6b-00-ff-ff-65-38-0f
            	Capabilities: [1a0] Transaction Processing Hints
            	Kernel driver in use: igb
            	Kernel modules: igb
            
            0a:00.0 PCI bridge: ASRock Incorporation Device 1150 (rev 06) (prog-if 00 [Normal decode])
            	Flags: bus master, fast devsel, latency 0, IRQ 255
            	Bus: primary=0a, secondary=0b, subordinate=0b, sec-latency=32
            	I/O behind bridge: 0000b000-0000bfff
            	Memory behind bridge: fa000000-fb0fffff
            	Capabilities: [50] MSI: Enable- Count=1/32 Maskable- 64bit+
            	Capabilities: [78] Power Management version 3
            	Capabilities: [80] Express PCI-Express to PCI/PCI-X Bridge, MSI 00
            	Capabilities: [c0] Subsystem: ASRock Incorporation Device 1150
            	Capabilities: [100] Virtual Channel
            	Capabilities: [200] #23
            	Capabilities: [2c0] #23
            	Capabilities: [800] Advanced Error Reporting
            
            0b:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 52) (prog-if 00 [VGA controller])
            	Subsystem: ASRock Incorporation Device 2000
            	Flags: medium devsel, IRQ 255
            	Memory at fa000000 (32-bit, non-prefetchable) [size=16M]
            	Memory at fb000000 (32-bit, non-prefetchable) [size=256K]
            	I/O ports at b000 [size=128]
            	[virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
            	Capabilities: [40] Power Management version 3
            	Capabilities: [50] MSI: Enable- Count=1/4 Maskable- 64bit+
            
            0e:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset USB 3.2 Controller (rev 01) (prog-if 30 [XHCI])
            	Subsystem: ASMedia Technology Inc. Device 1142
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Memory at fb300000 (64-bit, non-prefetchable) [size=32K]
            	Capabilities: [50] MSI: Enable- Count=1/8 Maskable- 64bit+
            	Capabilities: [68] MSI-X: Enable+ Count=8 Masked-
            	Capabilities: [78] Power Management version 3
            	Capabilities: [80] Express Legacy Endpoint, MSI 00
            	Capabilities: [100] Advanced Error Reporting
            	Capabilities: [160] Latency Tolerance Reporting
            	Kernel driver in use: xhci_hcd
            	Kernel modules: xhci_pci
            
            0f:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset SATA Controller (rev 01) (prog-if 01 [AHCI 1.0])
            	Subsystem: ASMedia Technology Inc. Device 1062
            	Flags: bus master, fast devsel, latency 0, IRQ 118
            	Memory at fb280000 (32-bit, non-prefetchable) [size=1K]
            	Expansion ROM at fb200000 [disabled] [size=512K]
            	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
            	Capabilities: [70] Power Management version 3
            	Capabilities: [80] Express Legacy Endpoint, MSI 00
            	Capabilities: [100] Advanced Error Reporting
            	Kernel driver in use: ahci
            	Kernel modules: ahci
            
            10:00.0 Non-Volatile memory controller: Kingston Technology Company, Inc. FURY Renegade NVMe SSD with heatsink (rev 01) (prog-if 02 [NVM Express])
            	Subsystem: Kingston Technology Company, Inc. FURY Renegade NVMe SSD with heatsink
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Memory at fc200000 (64-bit, non-prefetchable) [size=16K]
            	Capabilities: [80] Express Endpoint, MSI 00
            	Capabilities: [d0] MSI-X: Enable+ Count=33 Masked-
            	Capabilities: [e0] MSI: Enable- Count=1/8 Maskable- 64bit+
            	Capabilities: [f8] Power Management version 3
            	Capabilities: [100] Latency Tolerance Reporting
            	Capabilities: [110] L1 PM Substates
            	Capabilities: [128] Alternative Routing-ID Interpretation (ARI)
            	Capabilities: [1e0] #25
            	Capabilities: [200] Advanced Error Reporting
            	Capabilities: [290] Device Serial Number 00-00-00-00-00-00-00-00
            	Capabilities: [2a0] Power Budgeting <?>
            	Capabilities: [300] #19
            	Capabilities: [340] #26
            	Capabilities: [378] #27
            	Kernel driver in use: nvme
            	Kernel modules: nvme
            
            11:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 13c0 (rev c1) (prog-if 00 [VGA controller])
            	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device 13c0
            	Flags: bus master, fast devsel, latency 0, IRQ 255
            	Memory at fce0000000 (64-bit, prefetchable) [size=256M]
            	Memory at fb800000 (64-bit, prefetchable) [size=2M]
            	I/O ports at e000 [disabled] [size=256]
            	Memory at fbd00000 (32-bit, non-prefetchable) [size=512K]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Legacy Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/4 Maskable- 64bit+
            	Capabilities: [c0] MSI-X: Enable- Count=4 Masked-
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [2b0] Address Translation Service (ATS)
            	Capabilities: [2c0] Page Request Interface (PRI)
            	Capabilities: [2d0] Process Address Space ID (PASID)
            	Capabilities: [410] #26
            	Capabilities: [450] #27
            
            11:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
            	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
            	Flags: fast devsel, IRQ 255
            	Memory at fbdc8000 (32-bit, non-prefetchable) [disabled] [size=16K]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Legacy Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [2a0] Access Control Services
            
            11:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 19h PSP/CCP
            	Subsystem: Advanced Micro Devices, Inc. [AMD] Family 19h PSP/CCP
            	Flags: fast devsel, IRQ 255
            	Memory at fbc00000 (32-bit, non-prefetchable) [disabled] [size=1M]
            	Memory at fbdcc000 (32-bit, non-prefetchable) [disabled] [size=8K]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/2 Maskable- 64bit+
            	Capabilities: [c0] MSI-X: Enable- Count=2 Masked-
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [2a0] Access Control Services
            
            11:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b6 (prog-if 30 [XHCI])
            	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 15b6
            	Flags: bus master, fast devsel, latency 0, IRQ 41
            	Memory at fbb00000 (64-bit, non-prefetchable) [size=1M]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
            	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [2a0] Access Control Services
            	Kernel driver in use: xhci_hcd
            	Kernel modules: xhci_pci
            
            11:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b7 (prog-if 30 [XHCI])
            	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 15b6
            	Flags: bus master, fast devsel, latency 0, IRQ 42
            	Memory at fba00000 (64-bit, non-prefetchable) [size=1M]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
            	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [2a0] Access Control Services
            	Kernel driver in use: xhci_hcd
            	Kernel modules: xhci_pci
            
            11:00.5 Multimedia controller: Advanced Micro Devices, Inc. [AMD] ACP/ACP3X/ACP6x Audio Coprocessor (rev 62)
            	Subsystem: Advanced Micro Devices, Inc. [AMD] ACP/ACP3X/ACP6x Audio Coprocessor
            	Flags: fast devsel, IRQ 255
            	Memory at fbd80000 (32-bit, non-prefetchable) [disabled] [size=256K]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [2a0] Access Control Services
            
            11:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller
            	Subsystem: Advanced Micro Devices, Inc. [AMD] Device d601
            	Flags: fast devsel, IRQ 255
            	Memory at fbdc0000 (32-bit, non-prefetchable) [disabled] [size=32K]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [2a0] Access Control Services
            
            12:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b8 (prog-if 30 [XHCI])
            	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 15b6
            	Flags: bus master, fast devsel, latency 0, IRQ 46
            	Memory at fc100000 (64-bit, non-prefetchable) [size=1M]
            	Capabilities: [48] Vendor Specific Information: Len=08 <?>
            	Capabilities: [50] Power Management version 3
            	Capabilities: [64] Express Endpoint, MSI 00
            	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
            	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
            	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            	Capabilities: [270] #19
            	Capabilities: [2a0] Access Control Services
            	Capabilities: [410] #26
            	Capabilities: [450] #27
            	Kernel driver in use: xhci_hcd
            	Kernel modules: xhci_pci
            
            [16:03 xcp-ng-AsRoCk ~]# 
            
            
            
            S T 2 Replies Last reply Reply Quote 0
            • S Offline
              steff22 @steff22
              last edited by steff22

              @steff22 I really think there is a more serious problem with the new amd dGpu. since then the whole xcp-ng hangs and restarts itself.

              But when windows installs drivers itself it expands to the screen connected to the gpu but the image becomes a rainbow image. But no error messages.

              But when I install drivers from amd the whole win wm hangs and restarts right after login. And if I press shut down vm from xen orchestra the whole xcp-ng hangs and restarts.

              20:19 xcp-ng-AsRoCk ~]# tail -f /var/log/kern.log
              Nov 26 20:17:10 xcp-ng-AsRoCk kernel: [  905.801329] device tap3.0 entered promiscuous mode
              Nov 26 20:17:44 xcp-ng-AsRoCk kernel: [  939.567508] device tap3.0 left promiscuous mode
              Nov 26 20:17:44 xcp-ng-AsRoCk kernel: [  940.403154] device vif3.0 left promiscuous mode
              Nov 26 20:17:48 xcp-ng-AsRoCk kernel: [  944.072124] block tda: sector-size: 512/512 capacity: 524288000
              Nov 26 20:17:48 xcp-ng-AsRoCk kernel: [  944.368061] block tdb: sector-size: 512/512 capacity: 9558400
              Nov 26 20:17:49 xcp-ng-AsRoCk kernel: [  944.699150] device vif4.0 entered promiscuous mode
              Nov 26 20:17:49 xcp-ng-AsRoCk kernel: [  944.866671] device tap4.0 entered promiscuous mode
              Nov 26 20:18:00 xcp-ng-AsRoCk kernel: [  955.782415] device tap4.0 left promiscuous mode
              Nov 26 20:18:03 xcp-ng-AsRoCk kernel: [  959.318049] vif vif-4-0 vif4.0: Guest Rx ready
              Nov 26 20:18:47 xcp-ng-AsRoCk kernel: [ 1003.398295] device vif4.0 left promiscuous mode
              
              1 Reply Last reply Reply Quote 0
              • T Offline
                tuxen Top contributor @steff22
                last edited by tuxen

                @steff22 said in Gpu passthrough on Asrock rack B650D4U3-2L2Q will not work:

                03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 32 [Radeon RX 7700 XT / 7800 XT] (rev ff) (prog-if ff)
                !!! Unknown header type 7f
                Kernel driver in use: pciback

                03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 HDMI/DP Audio (rev ff) (prog-if ff)
                !!! Unknown header type 7f
                Kernel driver in use: pciback

                Something went wrong with the card detection. Since it's a big file, instead of posting, could you upload (last button) /var/log/kern.log ?

                Searching around some old forums with this error, it's said that if the system has the AMD iGPU + AMD dGPU combo, the iGPU takes precedence and power down the dGPU. Verify in the BIOS (under Advanced > AMD PBS > Graphics or something like that) if there's any configuration regarding this hybrid mode.

                Those last messages you posted are normal (guest net and disk infos).

                Tux

                S 1 Reply Last reply Reply Quote 0
                • S Offline
                  steff22 @tuxen
                  last edited by

                  @tuxen
                  I found some settings in the bios that I could disable igpu and make dGpu primary.

                  After this change I get more info about the card but same error.

                  But I can't run dom0 /var/log/kern.log. I only get message about bash: /var/log/kern.log: Permission denied

                  [06:03 xcp-ng-AsRoCk ~]# lspci -k -v
                  00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14d8
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14d8
                  	Flags: fast devsel
                  
                  00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 14d9
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14d9
                  	Flags: bus master, fast devsel, latency 0, IRQ 255
                  	Capabilities: [40] Secure device <?>
                  	Capabilities: [64] MSI: Enable- Count=1/4 Maskable- 64bit+
                  	Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+
                  
                  00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
                  	Flags: fast devsel
                  
                  00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0
                  	Bus: primary=00, secondary=01, subordinate=03, sec-latency=0
                  	I/O behind bridge: 0000f000-0000ffff
                  	Memory behind bridge: fbc00000-fbefffff
                  	Prefetchable memory behind bridge: 000000f800000000-000000fc0fffffff
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Root Port (Slot+), MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
                  	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [370] L1 PM Substates
                  	Capabilities: [3c4] #23
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [440] #27
                  	Capabilities: [500] #2a
                  	Kernel driver in use: pcieport
                  
                  00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0
                  	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
                  	Memory behind bridge: fc100000-fc1fffff
                  	Prefetchable memory behind bridge: 000000fc11000000-000000fc130fffff
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Root Port (Slot+), MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
                  	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [370] L1 PM Substates
                  	Capabilities: [3c4] #23
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [440] #27
                  	Capabilities: [500] #2a
                  	Kernel driver in use: pcieport
                  
                  00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
                  	Flags: fast devsel
                  
                  00:02.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0
                  	Bus: primary=00, secondary=05, subordinate=0f, sec-latency=0
                  	I/O behind bridge: 0000c000-0000efff
                  	Memory behind bridge: fa000000-fb6fffff
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Root Port (Slot+), MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
                  	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [370] L1 PM Substates
                  	Capabilities: [3c4] #23
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [440] #27
                  	Capabilities: [500] #2a
                  	Kernel driver in use: pcieport
                  
                  00:02.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0
                  	Bus: primary=00, secondary=10, subordinate=10, sec-latency=0
                  	Memory behind bridge: fc000000-fc0fffff
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Root Port (Slot+), MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
                  	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [370] L1 PM Substates
                  	Capabilities: [3c4] #23
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [440] #27
                  	Capabilities: [500] #2a
                  	Kernel driver in use: pcieport
                  
                  00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
                  	Flags: fast devsel
                  
                  00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
                  	Flags: fast devsel
                  
                  00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
                  	Flags: fast devsel
                  
                  00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14dd (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 26
                  	Bus: primary=00, secondary=11, subordinate=11, sec-latency=0
                  	Memory behind bridge: fb800000-fbbfffff
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Root Port (Slot-), MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14dd
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [450] #27
                  	Kernel driver in use: pcieport
                  
                  00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14dd (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 26
                  	Bus: primary=00, secondary=12, subordinate=12, sec-latency=0
                  	Memory behind bridge: fbf00000-fbffffff
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Root Port (Slot-), MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14dd
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [450] #27
                  	Kernel driver in use: pcieport
                  
                  00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 71)
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
                  	Flags: 66MHz, medium devsel
                  	Kernel driver in use: piix4_smbus
                  	Kernel modules: i2c_piix4
                  
                  00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
                  	Flags: bus master, 66MHz, medium devsel, latency 0
                  
                  00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e0
                  	Flags: fast devsel
                  
                  00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e1
                  	Flags: fast devsel
                  
                  00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e2
                  	Flags: fast devsel
                  
                  00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e3
                  	Flags: fast devsel
                  
                  00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e4
                  	Flags: fast devsel
                  
                  00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e5
                  	Flags: fast devsel
                  
                  00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e6
                  	Flags: fast devsel
                  
                  00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e7
                  	Flags: fast devsel
                  
                  01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch (rev 11) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 24
                  	Memory at fbe00000 (32-bit, non-prefetchable) [size=16K]
                  	Bus: primary=01, secondary=02, subordinate=03, sec-latency=0
                  	I/O behind bridge: 0000f000-0000ffff
                  	Memory behind bridge: fbc00000-fbdfffff
                  	Prefetchable memory behind bridge: 000000f800000000-000000fc0fffffff
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Upstream Port, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [150] Advanced Error Reporting
                  	Capabilities: [270] #19
                  	Capabilities: [320] Latency Tolerance Reporting
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [440] #27
                  	Kernel driver in use: pcieport
                  
                  02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch (rev 11) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 24
                  	Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
                  	I/O behind bridge: 0000f000-0000ffff
                  	Memory behind bridge: fbc00000-fbdfffff
                  	Prefetchable memory behind bridge: 000000f800000000-000000fc0fffffff
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [58] Express Downstream Port (Slot-), MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [150] Advanced Error Reporting
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [400] #25
                  	Capabilities: [410] #26
                  	Capabilities: [450] #27
                  	Kernel driver in use: pcieport
                  
                  03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 32 [Radeon RX 7700 XT / 7800 XT] (rev c8) (prog-if 00 [VGA controller])
                  	Subsystem: Gigabyte Technology Co., Ltd Device 2413
                  	Flags: bus master, fast devsel, latency 0, IRQ 24
                  	Memory at f800000000 (64-bit, prefetchable) [size=16G]
                  	Memory at fc00000000 (64-bit, prefetchable) [size=256M]
                  	I/O ports at f000 [size=256]
                  	Memory at fbc00000 (32-bit, non-prefetchable) [size=1M]
                  	Expansion ROM at fbd00000 [disabled] [size=128K]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Legacy Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [150] Advanced Error Reporting
                  	Capabilities: [200] #15
                  	Capabilities: [240] Power Budgeting <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [2d0] Process Address Space ID (PASID)
                  	Capabilities: [320] Latency Tolerance Reporting
                  	Capabilities: [410] #26
                  	Capabilities: [450] #27
                  	Kernel driver in use: pciback
                  
                  03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 HDMI/DP Audio
                  	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 HDMI/DP Audio
                  	Flags: bus master, fast devsel, latency 0, IRQ 25
                  	Memory at fbd20000 (32-bit, non-prefetchable) [size=16K]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Legacy Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [150] Advanced Error Reporting
                  	Capabilities: [2a0] Access Control Services
                  	Kernel driver in use: pciback
                  
                  04:00.0 Ethernet controller: Broadcom Inc. and subsidiaries BCM57502 NetXtreme-E 10Gb/25Gb/40Gb/50Gb Ethernet (rev 12)
                  	Subsystem: ASRock Incorporation Device 1752
                  	Flags: bus master, fast devsel, latency 0, IRQ 28
                  	Memory at fc13010000 (64-bit, prefetchable) [size=64K]
                  	Memory at fc12000000 (64-bit, prefetchable) [size=16M]
                  	Memory at fc13028000 (64-bit, prefetchable) [size=32K]
                  	Expansion ROM at fc180000 [disabled] [size=512K]
                  	Capabilities: [48] Power Management version 3
                  	Capabilities: [50] Vital Product Data
                  	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
                  	Capabilities: [ac] Express Endpoint, MSI 00
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [13c] Device Serial Number 9c-6b-00-ff-fe-65-38-6b
                  	Capabilities: [150] Power Budgeting <?>
                  	Capabilities: [160] Virtual Channel
                  	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
                  	Capabilities: [1b0] Latency Tolerance Reporting
                  	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
                  	Capabilities: [230] Transaction Processing Hints
                  	Capabilities: [300] #19
                  	Capabilities: [200] Precision Time Measurement
                  	Capabilities: [358] #26
                  	Capabilities: [388] #27
                  	Kernel driver in use: bnxt_en
                  	Kernel modules: bnxt_en
                  
                  04:00.1 Ethernet controller: Broadcom Inc. and subsidiaries BCM57502 NetXtreme-E 10Gb/25Gb/40Gb/50Gb Ethernet (rev 12)
                  	Subsystem: ASRock Incorporation Device 1752
                  	Flags: bus master, fast devsel, latency 0, IRQ 29
                  	Memory at fc13000000 (64-bit, prefetchable) [size=64K]
                  	Memory at fc11000000 (64-bit, prefetchable) [size=16M]
                  	Memory at fc13020000 (64-bit, prefetchable) [size=32K]
                  	Expansion ROM at fc100000 [disabled] [size=512K]
                  	Capabilities: [48] Power Management version 3
                  	Capabilities: [50] Vital Product Data
                  	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
                  	Capabilities: [ac] Express Endpoint, MSI 00
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [13c] Device Serial Number 9c-6b-00-ff-fe-65-38-6b
                  	Capabilities: [150] Power Budgeting <?>
                  	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
                  	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
                  	Capabilities: [230] Transaction Processing Hints
                  	Kernel driver in use: bnxt_en
                  	Kernel modules: bnxt_en
                  
                  05:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Upstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Bus: primary=05, secondary=06, subordinate=0f, sec-latency=0
                  	I/O behind bridge: 0000c000-0000efff
                  	Memory behind bridge: fa000000-fb6fffff
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Upstream Port, MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [160] Latency Tolerance Reporting
                  	Capabilities: [1c0] #19
                  	Capabilities: [200] L1 PM Substates
                  	Capabilities: [220] #25
                  	Capabilities: [240] #26
                  	Capabilities: [280] #27
                  	Kernel driver in use: pcieport
                  
                  06:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Bus: primary=06, secondary=07, subordinate=07, sec-latency=0
                  	Memory behind bridge: fb600000-fb6fffff
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [1c0] #19
                  	Capabilities: [200] L1 PM Substates
                  	Capabilities: [220] #25
                  	Capabilities: [240] #26
                  	Capabilities: [280] #27
                  	Kernel driver in use: pcieport
                  
                  06:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 47
                  	Bus: primary=06, secondary=08, subordinate=08, sec-latency=0
                  	I/O behind bridge: 0000e000-0000efff
                  	Memory behind bridge: fb500000-fb5fffff
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [1c0] #19
                  	Capabilities: [200] L1 PM Substates
                  	Capabilities: [220] #25
                  	Capabilities: [240] #26
                  	Capabilities: [280] #27
                  	Kernel driver in use: pcieport
                  
                  06:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 44
                  	Bus: primary=06, secondary=09, subordinate=09, sec-latency=0
                  	I/O behind bridge: 0000d000-0000dfff
                  	Memory behind bridge: fb400000-fb4fffff
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [1c0] #19
                  	Capabilities: [200] L1 PM Substates
                  	Capabilities: [220] #25
                  	Capabilities: [240] #26
                  	Capabilities: [280] #27
                  	Kernel driver in use: pcieport
                  
                  06:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 45
                  	Bus: primary=06, secondary=0a, subordinate=0b, sec-latency=0
                  	I/O behind bridge: 0000c000-0000cfff
                  	Memory behind bridge: fa000000-fb0fffff
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [1c0] #19
                  	Capabilities: [200] L1 PM Substates
                  	Capabilities: [220] #25
                  	Capabilities: [240] #26
                  	Capabilities: [280] #27
                  	Kernel driver in use: pcieport
                  
                  06:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Bus: primary=06, secondary=0c, subordinate=0c, sec-latency=0
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [1c0] #19
                  	Capabilities: [200] L1 PM Substates
                  	Capabilities: [220] #25
                  	Capabilities: [240] #26
                  	Capabilities: [280] #27
                  	Kernel driver in use: pcieport
                  
                  06:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Bus: primary=06, secondary=0d, subordinate=0d, sec-latency=0
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot+), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [1c0] #19
                  	Capabilities: [200] L1 PM Substates
                  	Capabilities: [220] #25
                  	Capabilities: [240] #26
                  	Capabilities: [280] #27
                  	Kernel driver in use: pcieport
                  
                  06:0c.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Bus: primary=06, secondary=0e, subordinate=0e, sec-latency=0
                  	Memory behind bridge: fb300000-fb3fffff
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot-), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Kernel driver in use: pcieport
                  
                  06:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 47
                  	Bus: primary=06, secondary=0f, subordinate=0f, sec-latency=0
                  	Memory behind bridge: fb200000-fb2fffff
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Downstream Port (Slot-), MSI 00
                  	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3328
                  	Capabilities: [100] Advanced Error Reporting
                  	Kernel driver in use: pcieport
                  
                  07:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller (rev 03) (prog-if 30 [XHCI])
                  	Subsystem: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Memory at fb600000 (64-bit, non-prefetchable) [size=8K]
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+
                  	Capabilities: [90] MSI-X: Enable- Count=8 Masked-
                  	Capabilities: [a0] Express Endpoint, MSI 00
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [150] Latency Tolerance Reporting
                  	Kernel driver in use: pciback
                  	Kernel modules: xhci_pci
                  
                  08:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
                  	Subsystem: ASRock Incorporation Device 1533
                  	Flags: bus master, fast devsel, latency 0, IRQ 47
                  	Memory at fb500000 (32-bit, non-prefetchable) [size=512K]
                  	I/O ports at e000 [size=32]
                  	Memory at fb580000 (32-bit, non-prefetchable) [size=16K]
                  	Capabilities: [40] Power Management version 3
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
                  	Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
                  	Capabilities: [a0] Express Endpoint, MSI 00
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [140] Device Serial Number 9c-6b-00-ff-ff-65-37-bf
                  	Capabilities: [1a0] Transaction Processing Hints
                  	Kernel driver in use: igb
                  	Kernel modules: igb
                  
                  09:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
                  	Subsystem: ASRock Incorporation Device 1533
                  	Flags: bus master, fast devsel, latency 0, IRQ 44
                  	Memory at fb400000 (32-bit, non-prefetchable) [size=512K]
                  	I/O ports at d000 [size=32]
                  	Memory at fb480000 (32-bit, non-prefetchable) [size=16K]
                  	Capabilities: [40] Power Management version 3
                  	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
                  	Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
                  	Capabilities: [a0] Express Endpoint, MSI 00
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [140] Device Serial Number 9c-6b-00-ff-ff-65-38-0f
                  	Capabilities: [1a0] Transaction Processing Hints
                  	Kernel driver in use: igb
                  	Kernel modules: igb
                  
                  0a:00.0 PCI bridge: ASRock Incorporation Device 1150 (rev 06) (prog-if 00 [Normal decode])
                  	Flags: bus master, fast devsel, latency 0, IRQ 255
                  	Bus: primary=0a, secondary=0b, subordinate=0b, sec-latency=32
                  	I/O behind bridge: 0000c000-0000cfff
                  	Memory behind bridge: fa000000-fb0fffff
                  	Capabilities: [50] MSI: Enable- Count=1/32 Maskable- 64bit+
                  	Capabilities: [78] Power Management version 3
                  	Capabilities: [80] Express PCI-Express to PCI/PCI-X Bridge, MSI 00
                  	Capabilities: [c0] Subsystem: ASRock Incorporation Device 1150
                  	Capabilities: [100] Virtual Channel
                  	Capabilities: [200] #23
                  	Capabilities: [2c0] #23
                  	Capabilities: [800] Advanced Error Reporting
                  
                  0b:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 52) (prog-if 00 [VGA controller])
                  	Subsystem: ASRock Incorporation Device 2000
                  	Flags: medium devsel, IRQ 255
                  	Memory at fa000000 (32-bit, non-prefetchable) [size=16M]
                  	Memory at fb000000 (32-bit, non-prefetchable) [size=256K]
                  	I/O ports at c000 [size=128]
                  	[virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
                  	Capabilities: [40] Power Management version 3
                  	Capabilities: [50] MSI: Enable- Count=1/4 Maskable- 64bit+
                  
                  0e:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset USB 3.2 Controller (rev 01) (prog-if 30 [XHCI])
                  	Subsystem: ASMedia Technology Inc. Device 1142
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Memory at fb300000 (64-bit, non-prefetchable) [size=32K]
                  	Capabilities: [50] MSI: Enable- Count=1/8 Maskable- 64bit+
                  	Capabilities: [68] MSI-X: Enable+ Count=8 Masked-
                  	Capabilities: [78] Power Management version 3
                  	Capabilities: [80] Express Legacy Endpoint, MSI 00
                  	Capabilities: [100] Advanced Error Reporting
                  	Capabilities: [160] Latency Tolerance Reporting
                  	Kernel driver in use: xhci_hcd
                  	Kernel modules: xhci_pci
                  
                  0f:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset SATA Controller (rev 01) (prog-if 01 [AHCI 1.0])
                  	Subsystem: ASMedia Technology Inc. Device 1062
                  	Flags: bus master, fast devsel, latency 0, IRQ 118
                  	Memory at fb280000 (32-bit, non-prefetchable) [size=1K]
                  	Expansion ROM at fb200000 [disabled] [size=512K]
                  	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                  	Capabilities: [70] Power Management version 3
                  	Capabilities: [80] Express Legacy Endpoint, MSI 00
                  	Capabilities: [100] Advanced Error Reporting
                  	Kernel driver in use: ahci
                  	Kernel modules: ahci
                  
                  10:00.0 Non-Volatile memory controller: Kingston Technology Company, Inc. FURY Renegade NVMe SSD with heatsink (rev 01) (prog-if 02 [NVM Express])
                  	Subsystem: Kingston Technology Company, Inc. FURY Renegade NVMe SSD with heatsink
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Memory at fc000000 (64-bit, non-prefetchable) [size=16K]
                  	Capabilities: [80] Express Endpoint, MSI 00
                  	Capabilities: [d0] MSI-X: Enable+ Count=33 Masked-
                  	Capabilities: [e0] MSI: Enable- Count=1/8 Maskable- 64bit+
                  	Capabilities: [f8] Power Management version 3
                  	Capabilities: [100] Latency Tolerance Reporting
                  	Capabilities: [110] L1 PM Substates
                  	Capabilities: [128] Alternative Routing-ID Interpretation (ARI)
                  	Capabilities: [1e0] #25
                  	Capabilities: [200] Advanced Error Reporting
                  	Capabilities: [290] Device Serial Number 00-00-00-00-00-00-00-00
                  	Capabilities: [2a0] Power Budgeting <?>
                  	Capabilities: [300] #19
                  	Capabilities: [340] #26
                  	Capabilities: [378] #27
                  	Kernel driver in use: nvme
                  	Kernel modules: nvme
                  
                  11:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Phoenix PCIe Dummy Function (rev c1)
                  	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device 13c0
                  	Flags: fast devsel
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Legacy Endpoint, MSI 00
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [410] #26
                  	Capabilities: [450] #27
                  
                  11:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 19h PSP/CCP
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] Family 19h PSP/CCP
                  	Flags: fast devsel, IRQ 255
                  	Memory at fba00000 (32-bit, non-prefetchable) [disabled] [size=1M]
                  	Memory at fbb48000 (32-bit, non-prefetchable) [disabled] [size=8K]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/2 Maskable- 64bit+
                  	Capabilities: [c0] MSI-X: Enable- Count=2 Masked-
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [2a0] Access Control Services
                  
                  11:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b6 (prog-if 30 [XHCI])
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 15b6
                  	Flags: bus master, fast devsel, latency 0, IRQ 41
                  	Memory at fb900000 (64-bit, non-prefetchable) [size=1M]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
                  	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [2a0] Access Control Services
                  	Kernel driver in use: xhci_hcd
                  	Kernel modules: xhci_pci
                  
                  11:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b7 (prog-if 30 [XHCI])
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 15b6
                  	Flags: bus master, fast devsel, latency 0, IRQ 42
                  	Memory at fb800000 (64-bit, non-prefetchable) [size=1M]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
                  	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [2a0] Access Control Services
                  	Kernel driver in use: xhci_hcd
                  	Kernel modules: xhci_pci
                  
                  11:00.5 Multimedia controller: Advanced Micro Devices, Inc. [AMD] ACP/ACP3X/ACP6x Audio Coprocessor (rev 62)
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] ACP/ACP3X/ACP6x Audio Coprocessor
                  	Flags: fast devsel, IRQ 255
                  	Memory at fbb00000 (32-bit, non-prefetchable) [disabled] [size=256K]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [2a0] Access Control Services
                  
                  11:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] Device d601
                  	Flags: fast devsel, IRQ 255
                  	Memory at fbb40000 (32-bit, non-prefetchable) [disabled] [size=32K]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [2a0] Access Control Services
                  
                  12:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b8 (prog-if 30 [XHCI])
                  	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 15b6
                  	Flags: bus master, fast devsel, latency 0, IRQ 46
                  	Memory at fbf00000 (64-bit, non-prefetchable) [size=1M]
                  	Capabilities: [48] Vendor Specific Information: Len=08 <?>
                  	Capabilities: [50] Power Management version 3
                  	Capabilities: [64] Express Endpoint, MSI 00
                  	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
                  	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
                  	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
                  	Capabilities: [270] #19
                  	Capabilities: [2a0] Access Control Services
                  	Capabilities: [410] #26
                  	Capabilities: [450] #27
                  	Kernel driver in use: xhci_hcd
                  	Kernel modules: xhci_pci
                  
                  [06:06 xcp-ng-AsRoCk ~]# 
                  
                  
                  
                  T 1 Reply Last reply Reply Quote 0
                  • T Offline
                    tuxen Top contributor @steff22
                    last edited by

                    @steff22 I'm seeing that this new card has large BAR. Could you disable in the BIOS:

                    • Disable Re-Size BAR;
                    • DIsable Above 4G Decoding;

                    Tux

                    S 2 Replies Last reply Reply Quote 0
                    • S Offline
                      steff22 @tuxen
                      last edited by

                      @tuxen Tried to Disable Re-Size BAR /Above 4G Decoding.

                      Vm hangs less then but is still only rainbow screen.

                      can't get it to work on vmware esxi either. just gets the same rainbow screen.

                      Not sure if that's true but found on level1 forum that others also couldn't get gpu passthrough with rx7800xt and they thought it was something with RDNA3

                      Ubuntu 24.4 manages to show the correct image but hangs and can't log in

                      1 Reply Last reply Reply Quote 0
                      • S Offline
                        steff22 @tuxen
                        last edited by

                        @tuxen

                        Is there any possibility to achieve something the same with changing the power pci state in xcp-ng as on proxmox.

                        Found this on a forum

                        ((
                        Splitting IOMMU groups did help but didn't solve the freeze it just reduced how often it occurs and added an output just one time before freezing

                        can't change power state from D3cold to D0
                        so i kept digging and found this in a post in proxmox forum:

                        pcie_port_pm=off
                        

                        adding this to my grub config finally got the freeze out of the way big_smile
                        this is not a total win tho, my gpu fully passes to the kvm but looks like if the kvm couln't use it at full power but limit itself around 25% of the gpu usage. My guesses now are:

                        Is the GPU locked in D3cold state? How to verify/control the state))

                        T 1 Reply Last reply Reply Quote 0
                        • T Offline
                          tuxen Top contributor @steff22
                          last edited by tuxen

                          @steff22

                          /opt/xensource/libexec/xen-cmdline --set-dom0 "pcie_port_pm=off"
                          reboot
                          

                          As an another option, you can also test the pcie_aspm=off that we did before for the Nvidia GPU (edit: added the command to remove the pcie_port_pm):

                          /opt/xensource/libexec/xen-cmdline --delete-dom0 "pcie_port_pm"
                          /opt/xensource/libexec/xen-cmdline --set-dom0 "pcie_aspm=off"
                          reboot
                          

                          Tux

                          S 3 Replies Last reply Reply Quote 0
                          • S Offline
                            steff22 @tuxen
                            last edited by

                            @tuxen

                            Unfortunately, it didn't work better, maybe a little less xcp-ng host crash with the VM running. But always when the VM shuts down.

                            This is the last entry in kern.log before Xcp-ng restarts

                            Nov 28 12:34:47 xcp-ng-AsRoCk kernel: [ 3313.679697] device vif2.0 left promiscuous mode
                            Nov 28 12:34:53 xcp-ng-AsRoCk kernel: [ 3319.117908] bnxt_en 0000:04:00.0 eth0: Recovering missed irq [0]: raw_cons: 8a4
                            Nov 28 12:34:59 xcp-ng-AsRoCk kernel: [ 3325.081449] bnxt_en 0000:04:00.0 eth0: Recovering missed irq [0]: raw_cons: 8a4
                            Nov 28 12:34:59 xcp-ng-AsRoCk kernel: [ 3325.081451] bnxt_en 0000:04:00.0 eth0: Recovering missed irq [1]: raw_cons: 4a9b
                            
                            
                            

                            There is a red timer that counts up in the middle of the rainbow screen. Does this mean that Xcp-ng has not completely lost control of the dgpu?
                            or is this normal before the VM sends an image to the screen?

                            Is it possible to get live xl dmesg messages like with tail -f /var/log/kern.log so that I see the last entry before Xcp-ng reboots?

                            1 Reply Last reply Reply Quote 0
                            • S Offline
                              steff22 @tuxen
                              last edited by

                              @tuxen Unfortunately I think this is amd reset bug on Radeon rx7800XT too. I have no idea if it can be fixed or if it's just to return the gpu to the store again. And rather find an nvidia card.

                              also found that amd gpu can automatically activate AMD vDisplay by gpu passthrough

                              Is there a list of gpu that others have managed to get to work with gpu gpu passthrough with Xcp-ng?

                              R 1 Reply Last reply Reply Quote 0
                              • S Offline
                                steff22 @tuxen
                                last edited by

                                @tuxen

                                Confirmed that vDisplay is enabled.

                                Windows finds the screen and extends the desktop to the available screen without connecting any physical screen.

                                Then tried with parsec and has access to hardware in the GPU to work playing steam games

                                1 Reply Last reply Reply Quote 0
                                • R Offline
                                  ravenet @steff22
                                  last edited by

                                  @steff22

                                  I have a Radeon Pro W7500 working fine on Win11 vm, on xcp 8.3. Windows update even installed the pro series driver for me.
                                  Asrock rack x470d4u, Ryzen 1700x.
                                  I know it's older platform and agesa though. I may have access to a ryzen 7700x system for some testing next week.

                                  12b5bea4-5c61-4677-abb1-7353ad2005c5-image.png

                                  S 1 Reply Last reply Reply Quote 1
                                  • S Offline
                                    steff22 @ravenet
                                    last edited by

                                    @ravenet Ok I think the pro gpu's work better without so many bugs.

                                    I switched to Nvidia RTX 4070. With the Nvidia gpu and this works as it should and gets an image on the screen on the first try.

                                    So there must be something wrong with the amd drivers plus that error with the amd reset bug

                                    R 1 Reply Last reply Reply Quote 1
                                    • R Offline
                                      ravenet @steff22
                                      last edited by

                                      @steff22 said in Gpu passthrough on Asrock rack B650D4U3-2L2Q will not work:

                                      @ravenet Ok I think the pro gpu's work better without so many bugs.

                                      I switched to Nvidia RTX 4070. With the Nvidia gpu and this works as it should and gets an image on the screen on the first try.

                                      So there must be something wrong with the amd drivers plus that error with the amd reset bug

                                      I've setup a test system with a ryzen 7700x and a regular radeon 7600xt, non-pro gpu. Will let you know results. Shouldn't be an issue, it's same hardware and even the drivers work across them. Though they do have different bios on cards

                                      1 Reply Last reply Reply Quote 0
                                      • First post
                                        Last post