@olivierlambert Thank you - appreciate for the confirmation.

@olivierlambert said in Kernel trap (??) booting TrueNAS with 2 x Kingston NVMe SSDs: Not all NVMe are created equals Now all I need to do is determine if these errors are from the NVME's themselves or the 4 x NVMe sled that they're inserted in. LOL. Again, thanks for the help.

@TS79 I had not seen that adapter, finding a main board that supports bifurcation is probably easier than a card that bifurcates. I'll have to look at some of the devices I have and see if this is supported.

Ok so I'm going to answer my own question. The answer is that the vdi (local SR) you are trying to boot from and the pci slots are on two different machines and you need to migrate the boot vdi to a shared pool sr or to the local sr of the machine with the pci slots!

No worries, I had the same problem few months ago

Thank you, low on sleep and of course you were right...

The problem is there's no such thing as "CPU architecture", that's only CPU features. It's a very complex problem and the easier way to solve it is to automatically harmonize to the lower one. Even if you are the oldest last, that will do as long as you shutdown/start previous VM again during a maintenance reboot of the guest OS.

You should have a command available in your Debian VM with tools, called "xenstore". You can use xenstore-write. For example: xenstore-write vm-data/gputemp 82 This will write the value 82 in a key gputemp. This key/value can be seen in the VM object then, eg with a : xe vm-param-get param-name=xenstore-data param-key=vm-data/gputemp uuid=<VM UUID> This will return 82. Now you can do whatever script in your Dom0 (or even from your XOA, since you can fetch all data in XAPI) As you can see, it's very simple and efficient

@AndyK I have had to sometimes do an iLO reset (reboot) to make it calm the fans down after installing. Its weird my gen 10s on ESXi never needed anything installed to prevent the fans from screaming but on these Gen 11s i tried various linux distro and xcp-ng and the fans were always loud without the daemon installed in the OS.

@olivierlambert Wow really nice unit makes me want to jump on those lighter fanless unit as i have lots of those 1L unit that works perfectly but has a small fans that i can hear if i really focus. I just like fanless unit to avoid dust getting in lol.

@Andrew I’m good with the BIOS setting for my NUC11 and 13. I wish Intel would fix ASPM, but still not on the latest BIOS. Just can’t run xcp-ng yet because of the older kernel and passthrough issue on the NUC13. It will probably come soon as 4.19 is out of support pretty soon. Was actually hoping there would be a alternate kernel for testing already.

@planedrop thank you for the input.

I quickly discussed with Xen developers and they are curious about your issue. Can you do a lspci -vvvv in your Dom0, first while you have still the option pci=realloc, and once without it, and see if we can spot any difference regarding your NIC. This might be helpful (you can provide both outputs at https://paste.vates.tech)

please advice is there a way to check that RAID1 read speed can be a bottleneck ? like 3 VMs are more than NVME Raid can give and that's why VMs are slow in responce

@manilx Got this from ChatGPT, so I think I got this. Would be great to just get these values from a cli command but I'm not up to the task The output from smartctl you provided contains information about the Wear Leveling Count attribute of an SSD. This attribute is used to indicate the wear and tear of the NAND flash memory cells in the SSD. Let's break down the relevant parts of the output: "Wear_Leveling_Count": This is the attribute being measured. "value": 98: This is the normalized value of the Wear Leveling Count. Normalized values typically start at 100 for new drives and decrease as the drive ages and wears out. "raw": { "string": "11", "value": 11 }: The raw value is the actual measurement from the SSD's controller. In this case, it is 11. Interpretation Normalized Value (98): This indicates the relative health of the SSD. A value of 98 means the SSD is still in good health, as it is close to the initial value of 100. Raw Value (11): This typically represents the number of cycles or the wear level. In this case, it likely indicates the number of times the cells have been erased and written. Wear Level SSDs generally have a threshold for when they are considered worn out, often around a normalized value of 10 or lower. With a normalized value of 98, your SSD is in very good health and shows minimal wear. The raw value of 11 suggests the SSD has gone through 11 cycles of wear leveling, which is quite low."