For anyone experiencing this issue, it happens when you enable Passthrough via CLI (hide devices from DOM).
After a clean install of xcp-ng 8.3, Passthrough would work via XOA GUI. However, as soon as I enabled PCI Passthrough for a device via CLI, the errors appeared.
I've moved to just passing the devices via GUI and not CLI. Everything is now working.