@ravenet Ok I think the pro gpu's work better without so many bugs.
I switched to Nvidia RTX 4070. With the Nvidia gpu and this works as it should and gets an image on the screen on the first try.
So there must be something wrong with the amd drivers plus that error with the amd reset bug
@tuxen yes Xen & XCP-ng dev teams have been really good 
Started to get a little nervous that the big investment in hardware was wasted. Never would have needed such a powerful cpu without gpu passthrough.
So thank you very much Xen & XCP-ng dev teams
what kind of magic have you put in the last 7 patches?
Now everything works no errors with letting windows install the drivers or adding drivers yourself Directly from nvidia 
Double checked this by installing a clean Xcp-ng from iso without update. Clean win 10 install install drivers then error 43 appeared install patch and started win 10 and everything works. also works with win 11
@olivierlambert Yes, I hope so 
. I don't need so many cpu cores if I don't have any ext gpu
Is it the bios that determines which screen the xcp-ng console should be displayed on?
As soon as I choose passthrough enable, I lose this image on the screen associated with the ext video card.
But it doesn't come back on any of the other screens connected to the motherboard, nor does ipmi show this xcp-ng console.
even though I have selected primary video adapter to int graphics in the bios.
This is the main difference on the Radeon HD 5450 that gpu passthrough worked with. There, the primary video adapter remained on the graphics section of the motherboard.
So one suspects that this choice in the bios does not work.
The strange thing is that normal pci passthrough works as it should on both m.2 and pci usb controller card
Asrock suport wanted to try to reproduce the error with them but have no idea if they will choose to use Xcp-ng and xen orchestra. It takes quite a long time to set everything up
@olivierlambert Yes but is beta bios to support the new Amd Ryzen9000 series. But there may be some bugs in the bios,
I think the motherboard was launched after April this year. First bios slip 27/7/2024.
I have contacted Asrock support, But there are so many links that the error could lie in.
But there are several with B650D4U3 motherboards that have the same error
@poddingue yeah I saw it now but I was more like mentioning that many people also have the same problem.
Hope it gets resolved soon
@yannsionneau I also can't get Radeon iGPU to work either with xcp-ng 8.3
with hardware
hvovedkort B650D4U3-2L2Q/BCM,)
cpu AMD Ryzen 9 9950X
tried on ubuntu 25.04 and windows 10
get this error message
lspci -nnk
dmesg | grep amdgpu
amdgpu: Invalid PCI ROM header signature: expecting 0xaa55, got 0x4556
amdgpu: Unable to locate a BIOS ROM
amdgpu: Fatal error during GPU init
Unable to locate a BIOS ROM
Not sure if this is Xcp-ng 8.3 or Nvidia based error.
But when I try to take gpu passthrough with a gtx 1070ti with windows 10. I get the drivers installed fine without errors but after reboot I get an error triangle in the windows device mangager-. error43 and no image on the screen
Wasn't Xcp-ng 8.3 related or windows drivers I think.
Tested with another PC with Xcp-ng 8.3 and everything worked immediately. So think it must be Asrock rack B650D4U3-2L2Q bios related or ipmi trying to use the same gpu.
@yannsionneau Yes it works Thank you very much, great job
Tested on Ryzen 9 9950X / AMD Raphael iGPU Tested the new experimental iGPU passthrough packages. - CPU: AMD Ryzen 9 9950X - iGPU: AMD Raphael (1002:13c0) - XCP-ng: 8.3 -
Guest: Bazzite AMD - VBIOS: extracted from the ACPI VFCT and supplied as /root/vbios.bin - iGPU passthrough: working - AMD amdgpu driver: working - Physical HDMI output: working - Bazzite desktop displayed successfully on the physical HDMI port. Ubuntu 24.04.2 was able to initialize the GPU and Vulkan/RADV detected the Raphael iGPU, but the HDMI output went black when the graphical desktop started. Bazzite worked and provided a stable display output. So on my Ryzen 9 9950X, the experimental packages appear to successfully enable Raphael iGPU passthrough and physical HDMI output.
@yannsionneau That's great news thank you very much
@poddingue yeah I saw it now but I was more like mentioning that many people also have the same problem.
Hope it gets resolved soon
@yannsionneau I also can't get Radeon iGPU to work either with xcp-ng 8.3
with hardware
hvovedkort B650D4U3-2L2Q/BCM,)
cpu AMD Ryzen 9 9950X
tried on ubuntu 25.04 and windows 10
get this error message
lspci -nnk
dmesg | grep amdgpu
amdgpu: Invalid PCI ROM header signature: expecting 0xaa55, got 0x4556
amdgpu: Unable to locate a BIOS ROM
amdgpu: Fatal error during GPU init
Unable to locate a BIOS ROM
@ravenet Ok I think the pro gpu's work better without so many bugs.
I switched to Nvidia RTX 4070. With the Nvidia gpu and this works as it should and gets an image on the screen on the first try.
So there must be something wrong with the amd drivers plus that error with the amd reset bug
Confirmed that vDisplay is enabled.
Windows finds the screen and extends the desktop to the available screen without connecting any physical screen.
Then tried with parsec and has access to hardware in the GPU to work playing steam games
@tuxen Unfortunately I think this is amd reset bug on Radeon rx7800XT too. I have no idea if it can be fixed or if it's just to return the gpu to the store again. And rather find an nvidia card.
also found that amd gpu can automatically activate AMD vDisplay by gpu passthrough
Is there a list of gpu that others have managed to get to work with gpu gpu passthrough with Xcp-ng?
Unfortunately, it didn't work better, maybe a little less xcp-ng host crash with the VM running. But always when the VM shuts down.
This is the last entry in kern.log before Xcp-ng restarts
Nov 28 12:34:47 xcp-ng-AsRoCk kernel: [ 3313.679697] device vif2.0 left promiscuous mode
Nov 28 12:34:53 xcp-ng-AsRoCk kernel: [ 3319.117908] bnxt_en 0000:04:00.0 eth0: Recovering missed irq [0]: raw_cons: 8a4
Nov 28 12:34:59 xcp-ng-AsRoCk kernel: [ 3325.081449] bnxt_en 0000:04:00.0 eth0: Recovering missed irq [0]: raw_cons: 8a4
Nov 28 12:34:59 xcp-ng-AsRoCk kernel: [ 3325.081451] bnxt_en 0000:04:00.0 eth0: Recovering missed irq [1]: raw_cons: 4a9b
There is a red timer that counts up in the middle of the rainbow screen. Does this mean that Xcp-ng has not completely lost control of the dgpu?
or is this normal before the VM sends an image to the screen?
Is it possible to get live xl dmesg messages like with tail -f /var/log/kern.log so that I see the last entry before Xcp-ng reboots?
Is there any possibility to achieve something the same with changing the power pci state in xcp-ng as on proxmox.
Found this on a forum
((
Splitting IOMMU groups did help but didn't solve the freeze it just reduced how often it occurs and added an output just one time before freezing
can't change power state from D3cold to D0
so i kept digging and found this in a post in proxmox forum:
pcie_port_pm=off
adding this to my grub config finally got the freeze out of the way big_smile
this is not a total win tho, my gpu fully passes to the kvm but looks like if the kvm couln't use it at full power but limit itself around 25% of the gpu usage. My guesses now are:
Is the GPU locked in D3cold state? How to verify/control the state))
@tuxen Tried to Disable Re-Size BAR /Above 4G Decoding.
Vm hangs less then but is still only rainbow screen.
can't get it to work on vmware esxi either. just gets the same rainbow screen.
Not sure if that's true but found on level1 forum that others also couldn't get gpu passthrough with rx7800xt and they thought it was something with RDNA3
Ubuntu 24.4 manages to show the correct image but hangs and can't log in