@GTwannabe
I assume he means using PCI passthrough for the USB port/controller so HA has direct access to that level of the hardware to circle around some USB passthrough problems. In my case this did not helped with the ConBee, but you might try it anyway and it is no problem to reboot the host which is needed to activate the PCI passthrough
Another pro for switching to an IP based controller is that you can backup and migrate the VM without any problem.