Non-server CPU compatibility - Ryzen and Intel
-
Far from being as detailed as everyone above but just to leave some contribution to the 'Non-server' topic, here are some experiences that I've had.
Everything is already outdated, but it might be useful as some reference anyway.
I have a client running a pair of XCP-ngs 8.1 on Ryzen 7 1800X w/ Gigabyte AB350M-GAMING 3 motherboards, Kingston consumer grade SSDs (almost all the write disk activity goes to a NAS), doing HA with halizard nosan version (DRBD to synchronize storage) for years without a hitch. We have even moved the servers to another location, syncing them through an EoIP vpn with virtually no downtime.
And I have just assembled a Ryzen 5700G with an Asus B550M TUF Plus motherboard and XCP-ng 8.2.1 for a homelab. The new AM5 is still a bit expensive in Brazil for a homelab, and I didn't needed too much cpu power anyway, mostly memory and storage. I had an issue with the RTL8125B NIC (just now I noticed the very first message states the same) but adding an Intel NIC made everything perfectly fine.
-
Today I installed a i350-T4 for testing and not depending on the realtek 2.5g card.
As I guess the computer didn't boot after installing the card.
DDR5 5600@C40 max supported on the QVL. Had to clear cmos and reconfigure again the bios so the computer can post again. Set up the L2APIC again, and SR-IOV, IOMMU.Got access to the server through SSH, but the server can't start any VM and have issues with the API not working locally. (XOA LITE) not working neither VMS.
With
xe vm-list
sometimes list the vms, even withxe-toolstack-restart
.The error:
Error : Connection Refused (calling connect)
On the display in the vm list :
("'NoneType' object has no attribute 'xenapi' ", )
Also in the xensource.log some erros on the string.
I will dump the logs and copy some over here.
-
I've got some logs:
xapi: [error||0 |starting up database engine D:93df1d58153e|backtrace] dbsync (update_env) R:ff17b7372476 failed with exception Stdlib.Scanf.Scan_failure("scanf: bad input at char number 6: looking for ':', found '.'")
Also the xapi keep restarting, and:
Cannot add dependency job for unit lvm2-activation-early.service, ignoring: Unit is masked
Cannont add deppendency job for unit lvm2-activation.service, ignoring: Unit is masked
This is a test on this machine. I'll clone the disk if you need further info of how to recover.
-
That sounds more like a damaged XAPI DB due to a corrupted disk/record than anything else
-
@olivierlambert that was my thought. I cloned live to a nother SSD, and that SSD reinstall the 8.3 on top of it and updated. But same result. I wanted also to reset the BM but keep the SR with the disks (thin) LVM.
This is a test, for a DR. The VM are not important. I can clone that SSD (nvme) and leave it for testing on the same HW.
If you want to test something, be my guest.
-
If you clone, you can clone the defect/corrupted files.
-
@olivierlambert I just cloned the drive, the issue is the same. I was thinking of cleaning the DB or trying to recover that instance.
I think I also saw on the screen the menu flashing with some colours.
-
All patches which were made available to XCP-ng 8.3 alpha through
yum update
are included directly in the XCP-ng 8.3 beta 1 installation images. -
@stormi
what about support for 8.2 and new CPUs like 7900/7950 ? -
@dave-opc We have internal nightly builds of 8.2 ISOs currently. I plan to publish them, as test ISOs. I don't have the hardware to test, but in theory they should support recent CPUs.
-
@stormi How soon can this be expected?
We planned to purchase a server on this hardware and include it in our 8.2 pool for work tasks.
But so far, the purchase has been suspended until the situation is clarified. -
If you have pro support, please open a ticket so we can see how to prioritize this
-
@dave-opc said in Non-server CPU compatibility - Ryzen and Intel:
@stormi
what about support for 8.2 and new CPUs like 7900/7950 ?I saw this post, but haven't had time to log back in to say anything. We were actually deploying a few virtualizations, and ran into one of the most incredible hacks I've ever seen on a client (I had never, ever heard of someone using AI to hack voice from an externally compromised Zoom call recording before.. until now)
But I've also had time to go through and check a few things out, as it is often easier for me to stress test units that will be for engineering with a hypervisor than it is for me to just throw windows on it and their licensed product and assume things will be good.
Here is what I can tell you: I've had zero issues with the 7900/7950X. Even better news: now that 48MB DDR5 DIMMS are now available, and BIOS update available, if you're using an X670 platform, I've had success at 192GB of RAM. That's a nice boost over 128GB for a platform so that you can get more RAM on board at a lesser cost than hopping to Threadripper, Epyc, or Xeon.
I have NOT had great luck with 7950X3D. Not frequent but not safe for production kernel panic.
-
@tmservo433
Hmm.. I don't see 48 GB modules on sale, only 2x24
Maybe you had the opportunity to compare the performance with the 5900X ? -
@alex821982 Plenty of 48Gb modules/96Gb Kits on the market right now. Here's an example: https://www.amazon.com/Crucial-2x48GB-5600MT-Desktop-CP2K48G56C46U5/dp/B0C79RMMCL/ref=sr_1_1_sspa?crid=9OY04CIGEEZH&keywords=96gb+ddr5&qid=1692893900&sprefix=96gb+ddr5%2Caps%2C143&sr=8-1-spons&sp_csd=d2lkZ2V0TmFtZT1zcF9hdGY&psc=1
Thanks to newer BIOS updates on the X670 boards, making memory work together (as long as same manufacturer/same speeds) is not as difficult. As to your question of between the 5900X.. the real question is what are you doing with your virtualization as a home lab? I generally say this because I don't think of Ryzens as what I use in production atmosphere; that is generally Epyc at this point on my end.
But if you virtualize for say, Plex/HomeAssistant/some Ubuntu/test environments/etc. then you're probably set with the 5900X.. IF, however, you are utilizing it for things that will intensively task passthrough IO and you want to need it (we have a few virtualized workstations running MS Project, and Adobe) then yes, being able to hand out more memory and cores does in fact help; then again, setting up on very fast NVMEs also helps.
Decide for yourself what the goal is. For most, the jump from a 5900x to a 7950 for virtualization is one where it is a "wait".. but the 8000 series is around the corner, and the one really nice thing about AMD is they aren't always switching sockets; so buyers of the X670 are going to be able to grab the next CPU, whereas it appears Intel's 14000 series is going to require new boards/sockets.
-
@tmservo433
Did I understand you correctly that on X670 and 7950 you have version 8.2 running from open access with the latest updates?
And no problems have been noticed in the work?
And according to the memory configuration, did you just say that there is an option with 96+96 or do you use it in your configurations too?
And can I ask what specific models of motherboards and memory you use for this configuration? -
@alex821982 A few notes: this was done using the Asrock Taichi board; at this point, in testing numerous boards, I no longer recommend ASUS boards for anything AM5. Nothing but trouble and their performance significantly lags everyone else. At first, I thought it was just me, but having talked to several others (like Gamer's Nexus/etc.) it seems as though this problem is universal and may be related to something they've done in the design process.
Out of the box, you likely will not be able to support 192Gb. You will need to flash the BIOS using a 16Gb module or something smaller to the newest BIOS. Do not boot directly to 192Gb. Boot to 96Gb, then 192Gb.
The "retrain" mode will take a bit. Your first time you boot is going to take you at least a minute, in my experience.. prepare for a blank screen for a while.
After BIOS has trained memory modules, boot modes are going to be fast and things are going to move exactly as you expect.
I have not had time to try on other AMD boards with this configuration on XCP-NG, as right now I've been spending too much of the later half of my summer in major Acronis and Sage/Mas update rollouts to clients to cover their SQL configurations, and that is what pays the bills..
Still, I'm looking at potentially upgrading my own home machines this fall; and I like the AM5 platform. For reference, I used Crucial 48Gb modules, as I linked above..I think those were the models. There are many others on the market now. In speaking to our AMD partner, I was told that 64Gb single modules should ship Q1 next year, and they expect AM5 to be fully compatible via BIOS update.
-
@tmservo433
Hmm.. interesting information, thanks...
and I was just choosing from ASUS...
Let's see what Asrock offers on AM5
If we consider the configuration with 192 Gb, then only 96Gb DDR5 6800MHz G.Skill 2 x 48 Gb KIT is available to me so far, that is, I can take two such kits, I hope there will be no problems... -
@alex821982 Go to YouTube and anywhere and find their Asus AM5 problems. If you go back in this thread, I started talking about it before they were talking about it there, but I could see some performance problems and we kept running into strange issues. MSI works, but I really just dislike their BIOS. I don't see many Gigabyte around here, and that leaves me Asrock. Now, Asrock's rack product (Asrack) is great stuff, and I will look into that soon enough for homelab purposes.
Right now, to be honest, outside of rolling out that software, we upgraded several PC units there, and took away 5-X99 Xeon PCs and 3-Threadripper 2950X PCs, and all of them are absolutely everything I would need (outside of power hunger) for a homelab test environment.
I can't vouch for that memory kit you are trying, but I'd assume you'd be OK. Do not expect DDR5-8000. Slow it down if you can for stability. You aren't trying to play for gamer-overclocker purposes.
-
@tmservo433
Yes, of course, I was also not going to overclock I'm even ready to use it at a lower frequency than 6800, the main thing is that it works stably. This choice is only due to the fact that only such a kit is available to me for purchase so far.
Here is an offer available to me from ASRock
X670E Taichi Carrara