XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    XCP-ng 8.2 updates announcements and testing

    Scheduled Pinned Locked Moved News
    708 Posts 67 Posters 1.1m Views 86 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Offline
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      @Andrew I believe this is a problem on XO, unrelated to the XCP-ng update itself.

      @gskger so we had the same issue. However, I did something differently: after restarting the toolstack, I could migrate VMs around without any problem, then reboot manually each evacuated host.

      gskgerG 1 Reply Last reply Reply Quote 0
      • gskgerG Offline
        gskger Top contributor @olivierlambert
        last edited by

        @olivierlambert Yes, restarting the toolstack first would have been a better approach. Is this something that needs additional actions on the hosts?

        1 Reply Last reply Reply Quote 0
        • olivierlambertO Offline
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by

          No, that should be enough 🙂

          1 Reply Last reply Reply Quote 0
          • stormiS Offline
            stormi Vates 🪐 XCP-ng Team
            last edited by

            We added a warning on the blog post https://xcp-ng.org/blog/2022/02/28/xcp-ng-8-2-1-update/ and will work on a fix in XO.

            H H 2 Replies Last reply Reply Quote 1
            • H Offline
              HeMaN @stormi
              last edited by

              @stormi
              now realise I had the same behaviour after applying the latest 8.2.0 security updates a few weeks ago.
              At that time thought it was because I patched the master manually already (test repo release) and updated the entire pool only after the official release 2 days later (roling pool update).

              So it is not (only) related to the 8.2.1 release

              stormiS 1 Reply Last reply Reply Quote 0
              • stormiS Offline
                stormi Vates 🪐 XCP-ng Team @HeMaN
                last edited by

                @HeMaN I think it's more likely to happen with the 8.2.1 update because more components are updated. Else I agree.

                1 Reply Last reply Reply Quote 0
                • stormiS Offline
                  stormi Vates 🪐 XCP-ng Team
                  last edited by stormi

                  New security updates (xen, Intel microcode)

                  Impact: newly disclosed security vulnerabilities may allow attackers from within a guest to access memory of the host or other VMs. Only AMD CPUs are affected. To know if your specific model is affected, consult the vendor publications. Xen has been patched to mitigate the hardware issue.

                  Additionnally but unrelated to the security issue, firmware is updated for some models.

                  Citrix' security bulletin: https://support.citrix.com/article/CTX341586

                  Test on XCP-ng 8.2

                  From an up to date host:

                  yum clean metadata --enablerepo=xcp-ng-testing
                  yum update linux-firmware microcode_ctl xen-dom0-libs xen-dom0-tools xen-hypervisor xen-libs xen-tools --enablerepo=xcp-ng-testing
                  reboot
                  

                  Versions:

                  • xen-*: 4.13.4-9.20.1.xcpng8.2
                  • microcode_ctl: 2.1-26.xs20.xcpng8.2
                  • linux-firmware-20190314-3.xcpng8.2

                  What to test

                  Normal use and anything else you want test. The closer to your actual use of XCP-ng, the better.

                  Test window before official release of the updates

                  ~2 days. Maybe less.

                  A N 2 Replies Last reply Reply Quote 1
                  • A Offline
                    Andrew Top contributor @stormi
                    last edited by

                    @stormi Manual updates done on all my 8.2.1 machines and things are working correctly so far.

                    1 Reply Last reply Reply Quote 2
                    • olivierlambertO Offline
                      olivierlambert Vates 🪐 Co-Founder CEO
                      last edited by

                      Same thing on my EPYC machine.

                      1 Reply Last reply Reply Quote 0
                      • N Offline
                        NielsH @stormi
                        last edited by

                        Thanks!

                        I see there's also another XSA available; XSA-396 (https://xenbits.xen.org/xsa/ )
                        Will these be combined with the microcode patches ?

                        Cheers!

                        stormiS 1 Reply Last reply Reply Quote 0
                        • stormiS Offline
                          stormi Vates 🪐 XCP-ng Team @NielsH
                          last edited by

                          @NielsH XSA-396 does not affect XCP-ng as the device back-ends are in dom0 directly, not in driver domains.

                          1 Reply Last reply Reply Quote 1
                          • stormiS Offline
                            stormi Vates 🪐 XCP-ng Team
                            last edited by

                            Security update released. Thanks @Andrew for testing!

                            https://xcp-ng.org/blog/2022/03/11/march-2022-security-update/

                            1 Reply Last reply Reply Quote 1
                            • H Offline
                              hecki @stormi
                              last edited by

                              @stormi I read the warning about problems with the rolling-pool-update, so after updating the pool with xen-orchestra, i wanted to live-migrate the Vms manually with xen-center. But live-migration fails, an the VMs crashed. I had to stop the other vms on the master and then reboot to get them back online.
                              After that I shut down the other VMs to savely reboot the other nodes.

                              So I think, the warning is not fully correct, also without using the rolling-pool-update feature you can get into trouble. Maybe the mentioned toolstack-restart after the update could have helped me, but there was no info about that in the blog post warning ...

                              stormiS 1 Reply Last reply Reply Quote 0
                              • stormiS Offline
                                stormi Vates 🪐 XCP-ng Team @hecki
                                last edited by

                                @hecki Thanks for the feedback. I agree that we could try to make it even more obvious how to avoid the issue, but the blog post does already point at the documentation for updating, as always when we publish an update, and the documentation clearly states you need to restart the toolstack (and it's not new... It's just that many people just overlook it and fortunately for them in most cases this is without consequences... Hence bad habits taken): https://xcp-ng.org/docs/updates.html#from-xen-orchestra

                                AFAIK the next release of Xen Orchestra will either restart the toolstack or remind you to do it when you apply patches.

                                H 1 Reply Last reply Reply Quote 0
                                • H Offline
                                  hecki @stormi
                                  last edited by

                                  @stormi I alwas used the rolling pool update since its available so i did not read the docs since then any more. If I understand you correct, until now the rolling pool update does not do a toolstack restart during the node restarts although it is so important?

                                  stormiS 1 Reply Last reply Reply Quote 0
                                  • stormiS Offline
                                    stormi Vates 🪐 XCP-ng Team @hecki
                                    last edited by

                                    @hecki In the case of Rolling Pool Update it's not a matter of toolstack restart anymore but rather of updating and rebooting hosts one by one rather than all at once.

                                    H 1 Reply Last reply Reply Quote 0
                                    • H Offline
                                      hecki @stormi
                                      last edited by

                                      @stormi ok, so "Install pool patches" and "Rolling pool update" internally behave completely different. This is new for me, until now, i thought, the Rolling Pool Update is a "Install poool patches" with following evacuation and reboot of the nodes, so thats what I have done manually today. Thanks for the explanation ...

                                      stormiS 1 Reply Last reply Reply Quote 0
                                      • stormiS Offline
                                        stormi Vates 🪐 XCP-ng Team @hecki
                                        last edited by

                                        @hecki That's what it was (with extra steps also such as putting hosts in maintenance mode), but this will change in the next release of Xen Orchestra as Rolling Pool Update will now evacuate, update then reboot every host one by one

                                        1 Reply Last reply Reply Quote 0
                                        • N Offline
                                          NielsH
                                          last edited by

                                          Looks like yet another security patch from Xenserver available now 😞

                                          https://xenbits.xen.org/xsa/advisory-398.html

                                          stormiS 1 Reply Last reply Reply Quote 0
                                          • stormiS Offline
                                            stormi Vates 🪐 XCP-ng Team @NielsH
                                            last edited by

                                            @NielsH No, they just updated the existing advisory. See "UPDATES IN VERSION 2".

                                            N 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post