Live migrate of Rocky Linux 8.8 VM crashes/reboots VM
-
@Weppel It looks like you wrote KVM instead of Xen in the title.
-
@stormi Thanks for noticing, my bad
-
-
@stormi Confirmed
-
So, after our investigations, we were able to pinpoint the issue.
It seem to happen on most RHEL derivative distributions when migrating from 8.7 to 8.8. As suggested, the bug is in the kernel.
Starting with
4.18.0-466.el8the patch: x86/idt: Annotate alloc_intr_gate() with __init is integrated and will create the issue. It is missing x86/xen: Split HVM vector callback setup and interrupt gate allocation that should have been integrated as well.The migration to 8.8 will move you to
4.18.0-477.*versions that are also raising this issue, that's what you reported.We found that the
4.18.0-488that can be found in CentOS 8 Stream integrates the missing patch, and do indeed work when installed manually.Your report helped us identify and reproduce the issues. That allowed us to provide a callstack to Xen devs. Then Roger Pau Monné found that it was this patch missing quickly, and we were able to find which versions of the kernel RPMs were integrating it and when the fix was integrated.
This means the issue was identified on RH side, and it is now a matter of having an updated kernel in derivative distributions like Rocky and Alma.
-
@bleader Thank you very much for the quick discovery of this, impressive work! I'm glad I could help!
-
O olivierlambert marked this topic as a question on
-
O olivierlambert has marked this topic as solved on
-
FYI this is not fixed yet in the latest EL kernel 4.18.0-477.15.1.el8_8.x86_64
-
Thanks for keeping us posted…
Hopefully things will be fixed at some point. Maybe Red Hat is focused on doing other things right now…
-
Makes sense, I was hoping they would go with a -488 on update... Sorry to hear its not the case
-
@bleader Unfortunately, I think we're stuck on -477 until EL 8.9 comes out
it's frustrating that it's taking them so long to fix this, especially when it seems like the bug was caused by a human error to begin with.
-
Not entirely sure, but that may be related to what's happening on redhat side of things
-
Just installed the latest kernel from Rocky and a live migrate seems to work on the 2 dev servers I have tried so far :
4.18.0-477.21.1.el8_8.x86_64 #1 SMP Tue Aug 8 21:30:09 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux -
@KFC-Netearth Surprising as it is still .477 but maybe the patch was backported, thanks for telling us!
-
The Rocky Linux bugtracker indeed mentions it's mostly fixed, but there are still some kernel errors present: https://bugs.rockylinux.org/view.php?id=3565#c4293
