I've got passthrough to work a number of times without issue, the only thing I had to make sure of was that all devices related to the GPU were passed through completely.
Are you following the docs step by step?
I have a Ubuntu VM running with a 2060 passed through right now, works flawlessly and even survived a power loss on the host.