Issue to load gpu passthrough "Invalid PCI ROM header signature: expecting 0xaa55, got 0x4556"

gleveque

Hello!

Sorry for my english
I tried to passthrough my amd embedded graphics cards but I have an issue on the VM boot "Invalid PCI ROM header signature: expecting 0xaa55, got 0x4556"
Have you ever had this problem?

Only solution who I found is to dump the vBios and force the vm to use it but it's for KVM and I don't if i can applie it on XCP.

https://www.reddit.com/r/homelab/comments/11l0s5j/boxmox_asrock_4x4_box_5800u_jbod_proxmox/

My setup

Udoo bolt V8 (AMD Ryzen Embedded V1605B with Radeon Vega Gfx + 16go DDR4)
I use XCP 8.3 up to date
on dom0 I exclude 05:00.0, 05:00.1 and assigned them on my debian VM

# lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 IOMMU
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0]
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0]
00:01.6 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0]
00:01.7 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0]
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus A
00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus B
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 7
01:00.0 Non-Volatile memory controller: Silicon Motion, Inc. SM2263EN/SM2263XT SSD Controller (rev 03)
04:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 0c)
05:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Raven Ridge [Radeon Vega Series / Radeon Vega Mobile Series] (rev 83)
05:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio Controller
05:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
05:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1
05:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1
05:00.5 Multimedia controller: Advanced Micro Devices, Inc. [AMD] Raven/Raven2/FireFlight/Renoir Audio Processor
05:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller
05:00.7 Non-VGA unclassified device: Advanced Micro Devices, Inc. [AMD] Raven/Raven2/Renoir Non-Sensor Fusion Hub KMDF driver
06:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 61)

# xe vm-param-get uuid=fbabee82-9426-650e-f10b-c392d8788ef2 param-name=other-config
pci: 0/0000:05:00.0,0/0000:05:00.1; xo:notes: bureau virtuel; xo:069b2d77: {"creation":{"date":"2024-03-23T16:58:00.859Z","template":"07d91aaa-43f7-430a-bf84-0edb6714df0f","user":"01357f62-8aab-4ea4-8c00-3544cfff24bf"}}; base_template_name: Debian Bookworm 12 (preview); import_task: OpaqueRef:a0d77144-e020-271a-f54b-b0f55f231aa0; mac_seed: 96e3d896-8aed-12e5-1b9a-d932a057b4a9; linux_template: true; install-methods: cdrom,nfs,http,ftp

# xl dmesg
 __  __            _  _    _ _____ _____
 \ \/ /___ _ __   | || |  / |___  |___ /
  \  // _ \ '_ \  | || |_ | |  / /  |_ \
  /  \  __/ | | | |__   _|| | / /_ ___) |
 /_/\_\___|_| |_|    |_|(_)_|/_/(_)____/

(XEN) [00000005a0a89ef4] Xen version 4.17.3-4 (mockbuild@[unknown]) (gcc (GCC) 11.2.1 20210728 (Red Hat 11.2.1-1)) debug=n Tue Apr 16 18:38:59 CEST 2024
(XEN) [00000005a0a8a778] Latest ChangeSet: 949a4aad4176, pq 4f8cbaa4a111
(XEN) [00000005a0a8b3f8] build-id: a8640618c1c5f907fd04bb2a8d6a1bcabff71d1d
(XEN) [00000005a0a8b984] Bootloader: GRUB 2.06
(XEN) [00000005a0a8bf74] Command line: dom0_mem=1792M,max:1792M watchdog ucode=scan dom0_max_vcpus=1-4 crashkernel=256M,below=4G console=vga vga=mode-0x0311 amd_iommu=on iommu=pt
(XEN) [00000005a0a8c8ac] Xen image load base address: 0x95a00000
(XEN) [00000005a0a8ccbc] Video information:
(XEN) [00000005a0a8d130]  No VGA detected
(XEN) [00000005a0a8d48c] Disc information:
(XEN) [00000005a0a8d98c]  Found 0 MBR signatures
(XEN) [00000005a0a8dedc]  Found 4 EDD information structures
(XEN) [00000005a0a8eeb8] CPU Vendor: AMD, Family 23 (0x17), Model 17 (0x11), Stepping 0 (raw 00810f10)
(XEN) [00000005a0a92b44] EFI RAM map:
(XEN) [00000005a0a932b0]  [0000000000000000, 000000000009ffff] (usable)
(XEN) [00000005a0a93990]  [00000000000a0000, 00000000000fffff] (reserved)
(XEN) [00000005a0a94084]  [0000000000100000, 0000000009601fff] (usable)
(XEN) [00000005a0a94764]  [0000000009602000, 00000000097fffff] (reserved)
(XEN) [00000005a0a94d90]  [0000000009800000, 000000000a1fffff] (usable)
(XEN) [00000005a0a95330]  [000000000a200000, 000000000a209fff] (ACPI NVS)
(XEN) [00000005a0a9595c]  [000000000a20a000, 000000009cc3bfff] (usable)
(XEN) [00000005a0a95f9c]  [000000009cc3c000, 000000009d71efff] (reserved)
(XEN) [00000005a0a965a0]  [000000009d71f000, 000000009d732fff] (ACPI data)
(XEN) [00000005a0a96b90]  [000000009d733000, 000000009dcc5fff] (ACPI NVS)
(XEN) [00000005a0a9716c]  [000000009dcc6000, 000000009e51cfff] (reserved)
(XEN) [00000005a0a9775c]  [000000009e51d000, 000000009effffff] (usable)
(XEN) [00000005a0a97d10]  [000000009f000000, 00000000dfffffff] (reserved)
(XEN) [00000005a0a982d8]  [00000000f8000000, 00000000fbffffff] (reserved)
(XEN) [00000005a0a98878]  [00000000fd100000, 00000000fdffffff] (reserved)
(XEN) [00000005a0a98e2c]  [00000000feb80000, 00000000fec01fff] (reserved)
(XEN) [00000005a0a993cc]  [00000000fec10000, 00000000fec10fff] (reserved)
(XEN) [00000005a0a99958]  [00000000fed00000, 00000000fed00fff] (reserved)
(XEN) [00000005a0a99ee4]  [00000000fed40000, 00000000fed44fff] (reserved)
(XEN) [00000005a0a9a484]  [00000000fed80000, 00000000fed8ffff] (reserved)
(XEN) [00000005a0a9a9fc]  [00000000fedc2000, 00000000fedcffff] (reserved)
(XEN) [00000005a0a9af88]  [00000000fedd4000, 00000000fedd5fff] (reserved)
(XEN) [00000005a0a9b500]  [00000000fee00000, 00000000feefffff] (reserved)
(XEN) [00000005a0a9ba8c]  [00000000ff000000, 00000000ffffffff] (reserved)
(XEN) [00000005a0a9c07c]  [0000000100000000, 000000041f33ffff] (usable)
(XEN) [00000005a0a9c6a8]  [000000041f340000, 000000041fffffff] (reserved)
(XEN) [00000005a1fea078] Kdump: 256MB (262144kB) at 0x85c00000
(XEN) [00000005a20058dc] ACPI: RSDP 9D840000, 0024 (r2 ALASKA)
(XEN) [00000005a2007290] ACPI: XSDT 9D840098, 00AC (r1 ALASKA   A M I   1072009 AMI     10013)
(XEN) [00000005a200876c] ACPI: FACP 9D848910, 0114 (r6 ALASKA   A M I   1072009 AMI     10013)
(XEN) [00000005a2009edc] ACPI: DSDT 9D8401D8, 8738 (r2 ALASKA   A M I   1072009 INTL 20120913)
(XEN) [00000005a200af1c] ACPI: FACS 9DC80F00, 0040
(XEN) [00000005a200b764] ACPI: APIC 9D848A28, 00DE (r3 ALASKA   A M I   1072009 AMI     10013)
(XEN) [00000005a200c2a4] ACPI: FPDT 9D848B08, 0044 (r1 ALASKA   A M I   1072009 AMI     10013)
(XEN) [00000005a200cd1c] ACPI: FIDT 9D848B50, 009C (r1 ALASKA    A M I  1072009 AMI     10013)
(XEN) [00000005a200d76c] ACPI: SSDT 9D848BF0, 5419 (r2    AMD AmdTable        2 MSFT  2000002)
(XEN) [00000005a200e400] ACPI: CRAT 9D84E010, 0810 (r1    AMD AMD CRAT        1 AMD         1)
(XEN) [00000005a200efa4] ACPI: CDIT 9D84E820, 0029 (r1    AMD AMD CDIT        1 AMD         1)
(XEN) [00000005a200f990] ACPI: MCFG 9D84E850, 003C (r1 ALASKA    A M I  1072009 MSFT    10013)
(XEN) [00000005a2010354] ACPI: HPET 9D84E890, 0038 (r1 ALASKA    A M I  1072009 AMI         5)
(XEN) [00000005a2010d04] ACPI: UEFI 9D84E8C8, 0048 (r1                        0             0)
(XEN) [00000005a2011808] ACPI: VFCT 9D84E910, D484 (r1 ALASKA   A M I         1  AMD 31504F47)
(XEN) [00000005a20123e8] ACPI: TPM2 9D85BD98, 0034 (r4 ALASKA   A M I         1 AMI         0)
(XEN) [00000005a2012d70] ACPI: IVRS 9D85BDD0, 00D0 (r2  AMD   AMD IVRS        1 AMD         0)
(XEN) [00000005a2013734] ACPI: SSDT 9D85BEA0, 0C33 (r1    AMD AmdTable        1 INTL 20120913)
(XEN) [00000005a2014224] ACPI: SSDT 9D85CAD8, 1B4E (r1    AMD AmdTable        1 INTL 20120913)
(XEN) [00000005a2014d00] ACPI: SSDT 9D85E628, 119C (r1    AMD  AMD CPU        1 AMD         1)
(XEN) [00000005a20157f0] ACPI: WSMT 9D85F7C8, 0028 (r1 ALASKA   A M I   1072009 AMI     10013)
(XEN) [00000005a2048c04] System RAM: 15303MB (15671260kB)
(XEN) [00000005a37c2f10] No NUMA configuration found
(XEN) [00000005a37c3974] Faking a node at 0000000000000000-000000041f340000
(XEN) [00000005a626c414] Domain heap initialised
(XEN) [00000005a6d29230] SMBIOS 3.1 present.
(XEN) [00000005a6d2e190] XSM Framework v1.0.1 initialized
(XEN) [00000005a6d2e834] Initialising XSM SILO mode
(XEN) [00000005a6d6d8a4] Using APIC driver default
(XEN) [00000005a6d80274] ACPI: PM-Timer IO Port: 0x808 (32 bits)
(XEN) [00000005a6d815ac] ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) [00000005a6d8353c] ACPI: SLEEP INFO: pm1x_cnt[1:804,1:0], pm1x_evt[1:800,1:0]
(XEN) [00000005a6d83ec4] ACPI: 32/64X FACS address mismatch in FADT - 9dc80f00/0000000000000000, using 32
(XEN) [00000005a6d85148] ACPI:             wakeup_vec[9dc80f0c], vec_size[20]
(XEN) [00000005a6e03430] ACPI: IOAPIC (id[0x09] address[0xfec00000] gsi_base[0])
(XEN) [00000005a6e09678] IOAPIC[0]: apic_id 9, version 33, address 0xfec00000, GSI 0-23
(XEN) [00000005a6e0a4ec] ACPI: IOAPIC (id[0x0a] address[0xfec01000] gsi_base[24])
(XEN) [00000005a6e0ce04] IOAPIC[1]: apic_id 10, version 33, address 0xfec01000, GSI 24-55
(XEN) [00000005a6e1efdc] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) [00000005a6e20508] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
(XEN) [00000005a6e36b00] ACPI: HPET id: 0x10228201 base: 0xfed00000
(XEN) [00000005a6e40d30] PCI: MCFG configuration 0: base f8000000 segment 0000 buses 00 - 3f
(XEN) [00000005a6e41668] PCI: MCFG area at f8000000 reserved in E820
(XEN) [00000005a6e434cc] PCI: Using MCFG for segment 0000 bus 00-3f
(XEN) [00000005a6e449bc] Using ACPI (MADT) for SMP configuration information
(XEN) [00000005a6e451a0] SMP: Allowing 16 CPUs (8 hotplug CPUs)
(XEN) [00000005a6e51234] IRQ limits: 56 GSI, 1608 MSI/MSI-X
(XEN) [00000005a6e846d4] CPU0: 1600 ... 2000 MHz
(XEN) [00000005a6e855ac] xstate: size: 0x340 and states: 0x7
(XEN) [00000005a6e93c10] CPU0: AMD Fam17h machine check reporting enabled
(XEN) [00000005a6e97bf8] Speculative mitigation facilities:
(XEN) [00000005a6e984b8]   Hardware hints:
(XEN) [00000005a6e98bc0]   Hardware features: IBPB
(XEN) [00000005a6e99048]   Compiled-in support: INDIRECT_THUNK HARDEN_ARRAY HARDEN_BRANCH HARDEN_GUEST_ACCESS HARDEN_LOCK
(XEN) [00000005a6e99d2c]   Xen settings: BTI-Thunk: RETPOLINE, SPEC_CTRL: No, Other: IBPB-ctxt DIV BRANCH_HARDEN
(XEN) [00000005a6e9a4ac]   Support for HVM VMs: MSR_VIRT_SPEC_CTRL RSB IBPB-entry
(XEN) [00000005a6e9aa10]   Support for PV VMs: None
(XEN) [00000005a6e9b190]   XPTI (64-bit PV only): Dom0 disabled, DomU disabled (without PCID)
(XEN) [00000005a6e9b730]   PV L1TF shadowing: Dom0 disabled, DomU disabled
(XEN) [00000005a6e9c900] Using scheduler: SMP Credit Scheduler (credit)
(XEN) [00000005ace06e04] Platform timer is 14.318MHz HPET
(XEN) [    0.102737] Detected 1996.241 MHz processor.
(XEN) [    0.106272] EFI memory map:
(XEN) [    0.106273]  0000000000000-0000000007fff type=3 attr=000000000000000f
(XEN) [    0.106274]  0000000008000-000000000bfff type=2 attr=000000000000000f
(XEN) [    0.106274]  000000000c000-000000002ffff type=7 attr=000000000000000f
(XEN) [    0.106275]  0000000030000-000000003ffff type=2 attr=000000000000000f
(XEN) [    0.106276]  0000000040000-000000009ffff type=3 attr=000000000000000f
(XEN) [    0.106277]  0000000100000-0000000794fff type=2 attr=000000000000000f
(XEN) [    0.106278]  0000000795000-0000000ffffff type=7 attr=000000000000000f
(XEN) [    0.106278]  0000001000000-000000101ffff type=4 attr=000000000000000f
(XEN) [    0.106279]  0000001020000-0000002315fff type=2 attr=000000000000000f
(XEN) [    0.106280]  0000002316000-0000009601fff type=7 attr=000000000000000f
(XEN) [    0.106280]  0000009602000-00000097fffff type=0 attr=000000000000000f
(XEN) [    0.106281]  0000009800000-000000a1fffff type=7 attr=000000000000000f
(XEN) [    0.106282]  000000a200000-000000a209fff type=10 attr=000000000000000f
(XEN) [    0.106283] Setting RUNTIME attribute for 000000a200000-000000a209fff
(XEN) [    0.106284]  000000a20a000-0000070f28fff type=7 attr=000000000000000f
(XEN) [    0.106285]  0000070f29000-0000096958fff type=1 attr=000000000000000f
(XEN) [    0.106286]  0000096959000-0000096959fff type=2 attr=000000000000000f
(XEN) [    0.106287]  000009695a000-000009695ffff type=7 attr=000000000000000f
(XEN) [    0.106287]  0000096960000-0000096a73fff type=1 attr=000000000000000f
(XEN) [    0.106288]  0000096a74000-000009c514fff type=4 attr=000000000000000f
(XEN) [    0.106289]  000009c515000-000009c682fff type=7 attr=000000000000000f
(XEN) [    0.106289]  000009c683000-000009cc3bfff type=3 attr=000000000000000f
(XEN) [    0.106290]  000009cc3c000-000009d71efff type=0 attr=000000000000000f
(XEN) [    0.106291]  000009d71f000-000009d732fff type=9 attr=000000000000000f
(XEN) [    0.106292]  000009d733000-000009dcc5fff type=10 attr=000000000000000f
(XEN) [    0.106292] Setting RUNTIME attribute for 000009d733000-000009dcc5fff
(XEN) [    0.106306]  000009dcc6000-000009e47efff type=6 attr=800000000000000f
(XEN) [    0.106320]  000009e47f000-000009e51cfff type=5 attr=800000000000000f
(XEN) [    0.106325]  000009e51d000-000009e69ffff type=4 attr=000000000000000f
(XEN) [    0.106326]  000009e6a0000-000009e6bdfff type=3 attr=000000000000000f
(XEN) [    0.106326]  000009e6be000-000009e6ecfff type=4 attr=000000000000000f
(XEN) [    0.106327]  000009e6ed000-000009e703fff type=3 attr=000000000000000f
(XEN) [    0.106328]  000009e704000-000009ef81fff type=4 attr=000000000000000f
(XEN) [    0.106328]  000009ef82000-000009ef88fff type=3 attr=000000000000000f
(XEN) [    0.106329]  000009ef89000-000009efadfff type=4 attr=000000000000000f
(XEN) [    0.106330]  000009efae000-000009efbdfff type=3 attr=000000000000000f
(XEN) [    0.106330]  000009efbe000-000009efdefff type=4 attr=000000000000000f
(XEN) [    0.106331]  000009efdf000-000009eff0fff type=3 attr=000000000000000f
(XEN) [    0.106332]  000009eff1000-000009eff8fff type=4 attr=000000000000000f
(XEN) [    0.106333]  000009eff9000-000009effffff type=3 attr=000000000000000f
(XEN) [    0.106333]  0000100000000-000041f33ffff type=7 attr=000000000000000f
(XEN) [    0.106334]  00000000a0000-00000000fffff type=0 attr=000000000000000f
(XEN) [    0.106335]  000009f000000-00000dfffffff type=0 attr=000000000000000f
(XEN) [    0.106336]  00000f8000000-00000fbffffff type=11 attr=800000000000100d
(XEN) [    0.106338]  00000fd100000-00000fdffffff type=11 attr=800000000000100d
(XEN) [    0.106346]  00000feb80000-00000fec01fff type=11 attr=800000000000100d
(XEN) [    0.106352]  00000fec10000-00000fec10fff type=11 attr=800000000000100d
(XEN) [    0.106353]  00000fed00000-00000fed00fff type=11 attr=800000000000100d
(XEN) [    0.106354]  00000fed40000-00000fed44fff type=11 attr=800000000000100d
(XEN) [    0.106355]  00000fed80000-00000fed8ffff type=11 attr=800000000000100d
(XEN) [    0.106357]  00000fedc2000-00000fedcffff type=11 attr=800000000000100d
(XEN) [    0.106358]  00000fedd4000-00000fedd5fff type=11 attr=800000000000100d
(XEN) [    0.106359]  00000fee00000-00000feefffff type=11 attr=800000000000100d
(XEN) [    0.106368]  00000ff000000-00000ffffffff type=11 attr=800000000000100d
(XEN) [    0.106369]  000041f340000-000041fffffff type=0 attr=000000000000000f
(XEN) [    0.106375] alt table ffff82d0406a55b8 -> ffff82d0406b4b98
(XEN) [    0.133541] AMD-Vi: IOMMU Extended Features:
(XEN) [    0.133542] - Peripheral Page Service Request
(XEN) [    0.133543] - NX bit
(XEN) [    0.133543] - Invalidate All Command
(XEN) [    0.133544] - Guest APIC
(XEN) [    0.133544] - Performance Counters
(XEN) [    0.133545] - Host Address Translation Size: 0x2
(XEN) [    0.133545] - Guest Address Translation Size: 0
(XEN) [    0.133546] - Guest CR3 Root Table Level: 0x1
(XEN) [    0.133546] - Maximum PASID: 0xf
(XEN) [    0.133547] - SMI Filter Register: 0x1
(XEN) [    0.133547] - SMI Filter Register Count: 0x2
(XEN) [    0.133548] - Guest Virtual APIC Modes: 0x1
(XEN) [    0.133548] - Dual PPR Log: 0x2
(XEN) [    0.133549] - Dual Event Log: 0x2
(XEN) [    0.133549] - User / Supervisor Page Protection
(XEN) [    0.133550] - Device Table Segmentation: 0x3
(XEN) [    0.133550] - PPR Log Overflow Early Warning
(XEN) [    0.133551] - PPR Automatic Response
(XEN) [    0.133551] - Memory Access Routing and Control: 0x1
(XEN) [    0.133552] - Block StopMark Message
(XEN) [    0.133552] - Performance Optimization
(XEN) [    0.133553] - MSI Capability MMIO Access
(XEN) [    0.133553] - Guest I/O Protection
(XEN) [    0.133554] - Host Access
(XEN) [    0.133554] - Enhanced PPR Handling
(XEN) [    0.133555] - Attribute Forward
(XEN) [    0.133555] - Invalidate IOTLB Type
(XEN) [    0.133555] - VM Table Size: 0
(XEN) [    0.145481] AMD-Vi: IOMMU 0 Enabled.
(XEN) [    0.145888] I/O virtualisation enabled
(XEN) [    0.145889]  - Dom0 mode: Relaxed
(XEN) [    0.145912] Interrupt remapping enabled
(XEN) [    0.145916] Enabling APIC mode.  Using 2 I/O APICs
(XEN) [    0.147708] ENABLING IO-APIC IRQs
(XEN) [    0.147709]  -> Using new ACK method
(XEN) [    0.148068] ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) [    1.289249] Allocated console ring of 64 KiB.
(XEN) [    1.289258] HVM: ASIDs enabled.
(XEN) [    1.289259] SVM: Supported advanced features:
(XEN) [    1.289260]  - Nested Page Tables (NPT)
(XEN) [    1.289260]  - Last Branch Record (LBR) Virtualisation
(XEN) [    1.289261]  - Next-RIP Saved on #VMEXIT
(XEN) [    1.289261]  - VMCB Clean Bits
(XEN) [    1.289262]  - DecodeAssists
(XEN) [    1.289262]  - Virtual VMLOAD/VMSAVE
(XEN) [    1.289263]  - Virtual GIF
(XEN) [    1.289263]  - Pause-Intercept Filter
(XEN) [    1.289264]  - Pause-Intercept Filter Threshold
(XEN) [    1.289264]  - TSC Rate MSR
(XEN) [    1.289265] HVM: SVM enabled
(XEN) [    1.289266] HVM: Hardware Assisted Paging (HAP) detected
(XEN) [    1.289266] HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) [    1.289272] alt table ffff82d0406a55b8 -> ffff82d0406b4b98
(XEN) [    1.432716] Brought up 8 CPUs
(XEN) [    1.432719] Testing NMI watchdog on all CPUs: ok
(XEN) [    1.453675] Scheduling granularity: cpu, 1 CPU per sched-resource
(XEN) [    1.453718] mcheck_poll: Machine check polling timer started.
(XEN) [    1.473781] NX (Execute Disable) protection active
(XEN) [    1.473788] Dom0 has maximum 888 PIRQs
(XEN) [    1.473834] csched_alloc_domdata: setting dom 0 as the privileged domain
(XEN) [    1.473861] *** Building a PV Dom0 ***
(XEN) [    1.670428]  Xen  kernel: 64-bit, lsb
(XEN) [    1.670431]  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x302c000
(XEN) [    1.670805] PHYSICAL MEMORY ARRANGEMENT:
(XEN) [    1.670805]  Dom0 alloc.:   000000040c000000->0000000410000000 (437514 pages to be allocated)
(XEN) [    1.670807]  Init. ramdisk: 000000041df0a000->000000041f1ff8bd
(XEN) [    1.670808] VIRTUAL MEMORY ARRANGEMENT:
(XEN) [    1.670810]  Loaded kernel: ffffffff81000000->ffffffff8302c000
(XEN) [    1.670811]  Phys-Mach map: 0000008000000000->0000008000380000
(XEN) [    1.670812]  Start info:    ffffffff8302c000->ffffffff8302c4b8
(XEN) [    1.670813]  Page tables:   ffffffff8302d000->ffffffff8304a000
(XEN) [    1.670814]  Boot stack:    ffffffff8304a000->ffffffff8304b000
(XEN) [    1.670815]  TOTAL:         ffffffff80000000->ffffffff83400000
(XEN) [    1.670816]  ENTRY ADDRESS: ffffffff8242b180
(XEN) [    1.671602] Dom0 has maximum 4 VCPUs
(XEN) [    1.693177] Initial low memory virq threshold set at 0x4000 pages.
(XEN) [    1.693179] Scrubbing Free RAM in background
(XEN) [    1.693182] Std. Loglevel: Errors, warnings and info
(XEN) [    1.693183] Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) [    1.693185] ***************************************************
(XEN) [    1.693187] Booted on leaky-DIV hardware with SMT/Hyperthreading
(XEN) [    1.693188] enabled.  Please assess your configuration and choose an
(XEN) [    1.693189] explicit 'smt=<bool>' setting.  See XSA-439.
(XEN) [    1.693189] ***************************************************
(XEN) [    1.693192] 3... 2... 1...
(XEN) [    4.694389] *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) [    4.695172] Freed 2048kB init memory

######################################

on the VM:

debian 12 up to date + installation firmware-amd-graphics,

# lspci
00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]
00:01.2 USB controller: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] (rev 01)
00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 03)
00:02.0 VGA compatible controller: Device 1234:1111 (rev 02)
00:03.0 Unassigned class [ff80]: XenSource, Inc. Xen Platform Device (rev 01)
00:08.0 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio Controller
00:09.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Raven Ridge [Radeon Vega Series / Radeon Vega Mobile Series] (rev 83)

# dmesg | grep amdg
[    5.118117] [drm] amdgpu kernel modesetting enabled.
[    5.118231] amdgpu: CRAT table not found
[    5.118235] amdgpu: Virtual CRAT table created for CPU
[    5.118251] amdgpu: Topology: Add CPU node
[    5.119622] amdgpu 0000:00:09.0: firmware: direct-loading firmware amdgpu/raven_gpu_info.bin
[    5.135617] amdgpu 0000:00:09.0: Invalid PCI ROM header signature: expecting 0xaa55, got 0x4556
[    5.151532] amdgpu 0000:00:09.0: amdgpu: Unable to locate a BIOS ROM
[    5.151560] amdgpu 0000:00:09.0: amdgpu: Fatal error during GPU init
[    5.153646] amdgpu 0000:00:09.0: amdgpu: amdgpu: finishing device.
[    5.154884] amdgpu: probe of 0000:00:09.0 failed with error -22

Regards,

Guillaume

olivierlambert

Hi,

Just to be sure I understand, you are trying to pass a non-discrete GPU to the VM, right?

gleveque

@olivierlambert hi, yes i try to use the ryzen igpu on a VM to use h264 decoding.

Regards,

itnok

@gleveque @olivierlambert Is there any update on this topic?

Am curious as am seeing the same exact behavior with Ubuntu 24.04.1 on a Beeline EQR6 with a Ryzen 9 (6900HX + 680M iGPU).

What would be the best option to pass through the iGPU from Dom0 to a VM?

nick.lloyd

@itnok I'm sure you already have, but have you ensured that everything in this guide was done?

itnok

@nick-lloyd thanks, I did! Passthrough for AMD consumer Hardare iGPUs seams not to properly function… or, I should say, the Linux VMs are experiencing troubles correctly dealing with it: the devices are correctly passing down to the VM, but for some reason the ROCm kernel module is not capable of dealing with them. Could it be be ause it expected them to be on a specific bus? (They are assigned a different bus id)
Could it be because it expected them to be under the same bus id? (They are scattered around different dedicated bus ids)
Not sure, but the end result is the iGPU cannot be correctly initialized, albeit detected.