TrueNAS VM failing to start

olivierlambert

Ouch. @andyhhp in case that trace rings a bell.

EddieA

@olivierlambert Any further thoughts or suggestions (move PCIe cards around again ??).

Cheers.

olivierlambert

No but maybe @Team-Hypervisor-Kernel does

yannsionneau

Hello @eddiea

I've sent you a link in private so that you can upload all your log files.

Thanks

Regards,

Yann

EddieA

@yannsionneau Uploaded contents of /var/crash together with the output of "xen-bugtool --yestoall".

Cheers.

TeddyAstie

@EddieA Can you try differents combinations of passedthrough hardware in this VM ?

e.g try with each device one by one at a time; at least in the VM

EddieA

Give me a couple of days to try. It is (obviously) down to the combination of devices passed through, as I reported this earlier:

said in TrueNAS VM failing to start:

Re-boot XCP and start the TrueNAS VM with NO passthrough devices. As expected, that started up fine.

Cheers.

EddieA

OK, not really sure what's going on. I fired XCP back up to try what @teddyastie suggested.

Looking at the specs for the TrueNAS VM before booting it, it now had zero passthrough devices attached, which wasn't the state of the last time I tried (from memory). So re-added all but 1 passthrough, a GPU. Booted TrueNAS and this time it came up.

Bingo, I thought, the GPU is the issue, but based on my background, I had to try again with the GPU included to prove it was the culprit. Well, what do you know, after adding it back in, TrueNAS now starts perfectly. One theory destroyed.

All I can think, is that somehow the passthrough definitions in the VM config were corrupted and finding them all gone and re-adding them fixed this. Who knows.

But all appears to be good again (for now).

yannsionneau

@EddieA Ok, good that your setup is now fully operational !

Let's sort this as a self-resolved problem then for now.
Don't hesitate to ping us again if the issue comes back.

AshleyDe

That is a frustrating loop to be in, especially with TrueNAS. Usually, when the VM fails to start after a change, it’s because XCP-ng is trying to pass through a PCI device (like an HBA) that isn't being released properly by the host.
Have you checked if the "hide" parameters in your grub config are still correct? Sometimes an update can reset those, and the host grabs the controller before the VM can. Another thing to try is toggling the BIOS/UEFI mode in the VM settings - TrueNAS can be picky about that depending on which version you’re running.