XCP-ng 8.3 betas and RCs feedback 🚀
-
@olivierlambert I'll report back at the end of the week when I deploy a new host with the exact same hardware config and a fresh install.
-
@pierre-c said in XCP-ng 8.3 betas and RCs feedback
:@stormi For us, the openvswitch-2.17.7-2.1.xcpng8.3 update has definitively solved the problem of overlay networks that weren't working (thanks David M. for all your help and hard work).
Unfortunately, the sm-3.2.3-1.1.xcpng8.3 update seems to have broken something in our iSCSI sessions. We now have 3 sessions instead of the usual 4 (2 interfaces on the host to two controllers on the storage array).
We have a less-than-ideal configuration with a large, flat network ( we have a project planned to put everything back the way it should be) with interfaces named c_eth4 and c_eth5, as recommended in the documentation in such cases.
It seems that the new version respects the use of interfaces for one of the two targets, but not for the other, which uses the default interface.
# iscsiadm -m session -P3 iSCSI Transport Class version 2.0-870 version 6.2.0.874-7 Target: iqn.2006-08.********************:21008041266ebf8e::20602:***.***.***.*** (non-flash) Current Portal: ***.***.***.***:3260,1539 Persistent Portal: ***.***.***.***:3260,1539 ********** Interface: ********** Iface Name: default Iface Transport: tcp Iface Initiatorname: iqn.2024-06.*********xcp-01.lan.mgmt:7203c069 Iface IPaddress: ***.***.20.155 Iface HWaddress: <empty> Iface Netdev: <empty> SID: 1 iSCSI Connection State: LOGGED IN iSCSI Session State: LOGGED_IN Internal iscsid Session State: NO CHANGE [...] Target: iqn.2006-08.********************:21008041266ebf8e::1020602:***.***.***.*** (non-flash) Current Portal: ***.***.***.***:3260,1549 Persistent Portal: ***.***.***.***:3260,1549 ********** Interface: ********** Iface Name: c_eth5 Iface Transport: tcp Iface Initiatorname: iqn.2024-06.*********xcp-01.lan.mgmt:7203c069 Iface IPaddress: ***.***.21.155 Iface HWaddress: <empty> Iface Netdev: xenbr5 SID: 2 iSCSI Connection State: LOGGED IN iSCSI Session State: LOGGED_IN Internal iscsid Session State: NO CHANGE [...] ********** Interface: ********** Iface Name: c_eth4 Iface Transport: tcp Iface Initiatorname: iqn.2024-06.*********xcp-01.lan.mgmt:7203c069 Iface IPaddress: ***.***.20.155 Iface HWaddress: <empty> Iface Netdev: xenbr4 SID: 3 iSCSI Connection State: LOGGED IN iSCSI Session State: LOGGED_IN Internal iscsid Session State: NO CHANGE [...]Concerning our problem with iSCSI sessions, I have just tried a downgrade of sm followed by a reboot :
yum downgrade sm sm-fairlockI can confirm that it works again on 4 paths via both interfaces after downgrade.
# iscsiadm -m session -o show tcp: [2] ***.***22.1:3260,1539 iqn.2006-08.********************:21008041266ebf8e::20602:***.***22.1 (non-flash) tcp: [3] ***.***22.1:3260,1539 iqn.2006-08.********************:21008041266ebf8e::20602:***.***22.1 (non-flash) tcp: [4] ***.***23.1:3260,1549 iqn.2006-08.********************:21008041266ebf8e::1020602:***.***23.1 (non-flash) tcp: [5] ***.***23.1:3260,1549 iqn.2006-08.********************:21008041266ebf8e::1020602:***.***23.1 (non-flash)# iscsiadm -m session -P3 iSCSI Transport Class version 2.0-870 version 6.2.0.874-7 Target: iqn.2006-08.********************:21008041266ebf8e::20602:***.***22.1 (non-flash) Current Portal: ***.***22.1:3260,1539 Persistent Portal: ***.***22.1:3260,1539 ********** Interface: ********** Iface Name: c_eth5 Iface Transport: tcp Iface Initiatorname: iqn.2024-06.*********xcp-01*********:7203c069 Iface IPaddress: ***.***21.155 Iface HWaddress: <empty> Iface Netdev: xenbr5 [...] ********** Interface: ********** Iface Name: c_eth4 Iface Transport: tcp Iface Initiatorname: iqn.2024-06.*********xcp-01*********:7203c069 Iface IPaddress: ***.***20.155 Iface HWaddress: <empty> Iface Netdev: xenbr4 [...] Target: iqn.2006-08.********************:21008041266ebf8e::1020602:***.***23.1 (non-flash) Current Portal: ***.***23.1:3260,1549 Persistent Portal: ***.***23.1:3260,1549 ********** Interface: ********** Iface Name: c_eth5 Iface Transport: tcp Iface Initiatorname: iqn.2024-06.*********xcp-01*********:7203c069 Iface IPaddress: ***.***21.155 Iface HWaddress: <empty> Iface Netdev: xenbr5 [...] ********** Interface: ********** Iface Name: c_eth4 Iface Transport: tcp Iface Initiatorname: iqn.2024-06.*********xcp-01*********:7203c069 Iface IPaddress: ***.***20.155 Iface HWaddress: <empty> Iface Netdev: xenbr4 SID: 5 [...]So we do have a problem with the new version of sm
-
@pierre-c I dont use iSCSI in my lab anymore, but yesterday when I did a "yum update" of 8.3 Beta, I got a script error when yum was running through all the updates. The script that failed was part of the sm update.
To be honest, I didnt bother doing anything with the error as everything seemed to work OK for me after, so I just ignored it. But.. Maybe I should have said something.. Sorry guys..
-
@Anonabhar We discussed the script error above. It's benign and will be fixed.
-
@brezlord said in XCP-ng 8.3 betas and RCs feedback
:I did an update of a 8.2 host to 8.3 via ISO install. Everything is working as it should but I get the below error on the host advanced tab with PCI passthrough. I had a Nvidia GPU passed through to a RHEL 9 VM on the 8.2 host. This was done via the command line.
I will load 8.3 on a new host with the same hardware config later in the week to confirm that it must be something to do with the 8.2 --> 8.3 upgrade.
Let me know if you need more info.
@olivierlambert I can confirm that a host with the exact same hardware config and a fresh install of 8.3-RC does not have this issue. Only the host upgraded from 8.2 LTS.
-
That's interesting. Thanks for the feedback!
-
@olivierlambert Do you need any further information before I re-image with the host 8.3?
-
While installing 8.3 RC1 it says BIOS boot mode is deprecated and I should use UEFI. But if I boot in UEFI, when I choose to upgrade the existing installation, an error occurs: "Installer mode (UEFI) is mismatched with target host mode (legacy)".
To be clear, it is not possible to migrate from BIOS mode to UEFI during an upgrade?
In that case, the only option would be to remove the host from the pool, install XCP-ng (not upgrade) and then add it to the pool. Am I correct? Thanks.
-
@ecoutinho at the moment, reinstalling is indeed the only solution to switch from BIOS to UEFI.
Note that the deprecation announcement comes with 8.3, but BIOS boot mode will still work and is still tested for this release. So you have some time to plan the switch.
-
@stormi I've upgraded the master in BIOS mode, and proceeded to reinstall one of the other hosts in UEFI mode, after having removed it from the pool. It went fine, until I tried to add the host back into the pool. This was not possible because the reinstalled host has Certificate Verification enabled, while the pool doesn't. Even if I host-emergency-disable-tls-verification, it's not possible to add the server back into the pool.
It seems I'll have to upgrade the other hosts in BIOS mode, enable certificate verification on the pool and then add this host. I guess I'll reinstall the other hosts in UEFI mode on a future upgrade.
-
@ecoutinho You can enable TLS verification on the pool then join the new host. Or disable it on the new host but that's a downgrade of this new security feature meant to protect against MITM attacks.
-
@stormi Thanks for your suggestions. I've tried to enable it on the pool:
# xe pool-enable-tls-verification This operation is not supported during an upgrade.I have to finish the upgrade of the other hosts before enabling it on the pool.
As for disabling it on the new host, I didn't find any way to do it permanently. I just found the host-emergency-disable-tls-verification option, which does not disable it completely, and doesn't allow to add it to a pool without TLS verification. Would you clarify how to disable it on the new host?
I will enable it on the pool when the upgrade is finished.
-
@ecoutinho I don't see a way to disable TLS verification, but anyway I wouldn't join a host to a pool which is currently being upgraded. I even suspect XAPI would refuse.
-
@stormi OK, thanks, I'll finish upgrading the other hosts.
-
@brezlord If you haven't reinstalled it yet, yes, we could use more information about the host, the PCI passthrough setup on it, how the error is triggered exactly, and various logs. And/or a support tunnel to have a look by ourselves.
-
@brezlord Can you sahre the value you put in the xen-cmdline on 8.2?
I think the XAPI awaits this format:
xen-pciback.hide=(pci-id1)(pci-id2)...and will fail the value doesn't match this format. -
@BenjiReis Sorry I have destroyed the host and loaded a fresh install of 8.3. If you'd like I can install 8.2 on a host and pass through a pci device via the cmd then upgrade to 8.3 and see if the error is reproducible.
-
@brezlord If it's not to much a bother that would be great yeah.
Comparing the xen-cmdline when doing the passthrough manually on 8.2 VS how it looks on 8.3 and when done via the XAPI. -
I'm pushed a new set of updates, hopefully the last one before the release of XCP-ng 8.3.0 RC2, which itself should be followed shortly by the release of XCP-ng 8.3.0 itself.
Main packages
- intel-microcode-20240717-1.xcpng8.3: updated microcode for Intel vulnerabilities
- sm-3.2.3-1.4.xcpng8.3: fix the cause of a warning displayed during update, and restore changes that we had removed because they were suspected to cause issues in some cases with iSCSI, but revealed themselves necessary to support another kind of setup.
- vim-7.4.629-8.el7_9 (which provides
vim-minimal, installed by default): bugfixes and security fixes - xapi-24.19.2-1.3.xcpng8.3: Fixes an issue where new fields in XAPI DB for certificate fingerprints were not populated, which under some circumstances caused joining new hosts to a pool fail.
- xcp-ng-release-8.3.0-28:
- Update repository files for CentOS and EPEL.
- Point at repo.vates.tech for CentOS since mirrorlist.centos.org was cut
- Add "(EOL)" to repo descriptions for EOL repos
- Drop unused repos
Optional package
- kernel-alt-4.19.316+1-2.xcpng8.3: Enable CONFIG_X86_AMD_PLATFORM_DEVICE in kernel config
- ldns-1.7.0-21.xcpng8.3 + libreswan-4.12-2.3.1.xcpng8.3: security updates
-
On my 8.3 test pool I am unable to create SR ISO libary (SMB/cifs).
On my production pools with XCP-NG 8.2.x it does work as expected.
