XCP-ng 8.3 PCI Passthrough issue

MJGZ51

I have an XCP-ng 8.3 installation that passes through a few devices (2 USB PCI Cards and 1 Graphics Card).

Dell R630 Host (XCP-ng 8.3 - upgraded from 8.2)
XOA from Sources (commits are up-to-date)

Initially, when I set the host up, I passed these devices through using CLI. Now, after updating the host I tried using XOA and get the following:

These devices are successfully passed through into a couple VMs using the CLI method, but can't seem to get this working in XOA.

The other thing that's odd, the USB PCI devices are not showing in the list above.

Does anyone have any ideas what the error shown above is from?

Thank you.

BenjiReis

@MJGZ51 Hi!

Since 8.3 PCI passthrough is part of the XAPI and come with dedicated xe commands:

xe pci-list to have the list of PCI devices and then:

xe pci-disable-dom0-access uuid=<pci uuid> to hide th device from dom0
xe pci-enable-dom0-access uuid=<pci uuid> to unhide the from dom0

These are the same API calls made by XO or any XAPI clients
No need to edit manually the cmdline anymore!

Regards

psafont

@MJGZ51 said in XCP-ng 8.3 PCI Passthrough issue:

Does anyone have any ideas what the error shown above is from?

It's generated by OCaml code, but it's difficult to tell where from without a backtrace that should be found in /var/log/xensource.log

MJGZ51

@psafont Thanks for the reply.

To the untrained eye, I couldn't find anything glaring. Is there anything specific I should be looking for?

I'm wondering if I should just reinstall XCP-ng on that host and start fresh.

Thanks!

MJGZ51

For anyone experiencing this issue, it happens when you enable Passthrough via CLI (hide devices from DOM).

After a clean install of xcp-ng 8.3, Passthrough would work via XOA GUI. However, as soon as I enabled PCI Passthrough for a device via CLI, the errors appeared.

I've moved to just passing the devices via GUI and not CLI. Everything is now working.

olivierlambert

Hm that's important feedback thanks. We need to check if we can reproduce in here

Ping @stormi so we can assign someone to test that

stormi

@MJGZ51 said in XCP-ng 8.3 PCI Passthrough issue:

For anyone experiencing this issue, it happens when you enable Passthrough via CLI (hide devices from DOM).

After a clean install of xcp-ng 8.3, Passthrough would work via XOA GUI. However, as soon as I enabled PCI Passthrough for a device via CLI, the errors appeared.

I've moved to just passing the devices via GUI and not CLI. Everything is now working.

What's the involved CLI command?

MJGZ51

@stormi said in XCP-ng 8.3 PCI Passthrough issue:

@MJGZ51 said in XCP-ng 8.3 PCI Passthrough issue:

For anyone experiencing this issue, it happens when you enable Passthrough via CLI (hide devices from DOM).

After a clean install of xcp-ng 8.3, Passthrough would work via XOA GUI. However, as soon as I enabled PCI Passthrough for a device via CLI, the errors appeared.

I've moved to just passing the devices via GUI and not CLI. Everything is now working.

What's the involved CLI command?

Following the xcp-ng documentation for PCI passthrough:

/opt/xensource/libexec/xen-cmdline --set-dom0 "xen-pciback.hide=(0000:04:01.0)"

Then,

xe vm-param-set other-config:pci=0/0000:04:01.0 uuid=<vm uuid>

That's when I see the errors appear in XOA. If I remove the device from Passthrough via CLI (xe vm-param-remove param-name=other-config param-key=pci uuid=<vm uuid>), everything works again in XOA.

BenjiReis

@MJGZ51 Hi!

Since 8.3 PCI passthrough is part of the XAPI and come with dedicated xe commands:

xe pci-list to have the list of PCI devices and then:

xe pci-disable-dom0-access uuid=<pci uuid> to hide th device from dom0
xe pci-enable-dom0-access uuid=<pci uuid> to unhide the from dom0

These are the same API calls made by XO or any XAPI clients
No need to edit manually the cmdline anymore!

Regards