I finally got my lab updated and the two vms started, so far so good. Stats data is present, the first time I've seen any of my hosts pull 100% CPU. Hosts are little HP T740 thin clients with AMD V1756B processors and 64GB of ram, in a 3 host pool.
Sorry I can't bring more detail, not really doing work on my XCP lab right now, and lots of shake up around tech. space at work.
I decided to burn my lab down because of some trouble and wanted to start fresh to isolate any problems I may have created in the past. Wiped the disks, built a new NFS share ready for work, installed the XCP-ng OS and configured networking for the management interface on the local machines, all normal stuff. Went back to my desk and logged into XO Lite on each machine, using console --> xsconsole I was able to get all the hosts into a pool, and add an ISO and NFS SR, all seemed to work.
Went to the New VM to create a simple Debian vm on which I intended to host XO-CE from sources. Typed the info in, chose the Debian image from my ISO SR, the rest of the config as normal. Uncheck the boot after creation box, and create.
Click on the VM to bring the console up, then click power on... UEFI loader comes up, and ... Can't find the boot disk. Tried another iso that I knew was capable of EFI boot, same.
Realized I was trying to start in EFI, made a new one in BIOS mode, this one worked but now my screen shots are messed up so I'll probably have to go through and delete stuff with a different XO and go back to grabbing images of the process to write up "for the next guy".
Other than this small issue, it's working and doing it all from XO Lite. Yes still a bunch of missing features, but I know you are working on this. I just wanted to try things this way on this fresh build and see what I could get done from local console and XO Lite.
BTW, the ram increase made zero difference in the VDI migration times.
I may still change the ram for each host in production, but I only have like 12 VMs right now and probably not many more to create in my little system. Might be useful if I ever get down to a single host because of a catastrophe. Currently running what it chose for default at 7.41 MiB, roughly doubled that in my lab to see what might happen.
Just got my VMware lab started so all this other stuff is going to back burner for a while. I will say I like the basic ESXi interface that they give you, I can see why smaller systems may not bother buying VCenter. I hope XO-lite gives us the same amount of function when it gets done (or more).
I was looking for a way to mark this solved, can't find it.
I haven't moved things, but after migrating my big lab to my mini-lab, I'm confident that the warm migration is the way to go. It was fast and seamless as long as you have the right network adapters set up. I had to fool with one of my networks to make a VM function, but that was certainly something I overlooked while setting up the mini-lab. A little testing before moving the VMs should make this go easily if using the old servers is the option for this project.
Having what is essentially XCP-NG Center from a browser would be nice, no more need to install something on a Windows machine just to get some basic stuff set up until you get a full XOA instance running. Yes I know you can just grab the demo with a single command, but sometimes you want to configure a few things first.
Tom Lawrence has a bit hub with all the artwork that he uses, you might want to find that and check it out.
Documentation is the first thing to get pushed to the back burner, same in my area, same in my larger IT department. Never enough time to document things correctly.
I need to get going with Netbox and see if I can make this speed up what I want to document.
Ummm... Your documentation sure makes a lot of us jealous!
Was that just a layout program like draw.io, or are you using something like Netbox for that work?
I'm starting on GLPI to handle more than just flow paths going forward, need to track serial numbers, date of purchase, maybe installed software as I go forward. A project for the summer.
So there might be two other things to look into if you get bored.
It is not cheaper, but it draws about half the power when idle. When doing work the power still gets up there, they are 60-90 watt computers, which is still less than the 300 watt capable HP servers at full go.
If you really stress your lab a lot, real servers are a win as they will draw less power for more performance, but if yours is like mine and it idles a lot, cutting the power is nice. I'm about 200 watts at idle with the above, and that's two labs worth. I was 400 with the single old lab system.
Mounts are cheap book ends, drilled and screwed to that specific shelf, and drilled for short m4 thumbscrews to get into the VESA mount on the t740.
If anyone reading this wants to duplicate, and they see HP T755 cheap enough, I recommend these because it has 6 cores / 12 threads over the t740 with 4 cores / 8 threads. Both are DDR4 sodimm and top out at 64GB. Both have a PCI 3.0 x8 (x16 slot) that takes half height cards. And if the BIOS is locked, you can write over them with a programmer and enter the data needed to function (see badcaps forum for my guide).
Here is mine
HP DL360e Gen 8 for Truenas, 96GB of RAM, more processors than it needs, and 8x500 drives, NFS share for the VMs
3x HP DL360p gen 8 for XCP-NG with 128GB of RAM and 20c40t worth of processors.
10gbps networking to a Mikrotik switch, also an old Cisco 2960s for a second gigabit network (with POE+)
There is also a cheap GPS/GNSS NTP clock at the top of the rack, just too far to show these other items.
I like the spinning lights on the drives, just wish it was a little faster.
I'm doing the latest production level updates announced yesterday... My pool has never migrated VMs as fast as it is now.
That was migrating several at a time, moving VMs back to "balanced" at the end is moving them at about half that speed one at a time. This is more than double what I was able to do with the same hardware on 8.2.1. It looks like it is actually capping at the maximum 10gbps speeds that the x710 cards and my switch can handle, that's never happened, not even on my lab which has been on v8.3 for over a year.
(note to self, might be time to upgrade those x520 cards in the lab to x710)
Next month's Windows updates might be interesting, hope this increase holds for that process too.
Uggg... Just after I upgraded 8.2.1 to 8.3.x and did updates. Guess I have more waiting for me for later today or tomorrow.
I went from Citrix 9.3.3 to 9.4.1, and generally they have remained manual when I've upgraded. All these VMs started out with 9.2.x so this is probably the fourth update to them.
And all that said, I know the MAC address did not change, because I had a reservation for one of them and it was found properly before putting it back to manual. I think the XCP-ng side of things worked properly (no MAC change), but the driver side was the issue, and nothing you can fix since you don't write this driver.
I probably should have used the cleaner first, but I went straight to the Citrix installer like I've done in the past. Took about an hour to get the 5 VMs updated, now I can move on to other things that have been lacking. I've mentioned it a few times, but this construction has me way behind for the summer, and only a few weeks of work time left before students come back.
Better late than never I guess 
4 out of 5 of my Server 2022 VMs needed to have the networking set back to manual after the driver update. 5 out of 5 need to have the system drive marked as non-removeable, but I need to move on for a couple other things before swinging back to the system drives.
I let it sit for an hour while I was at lunch, if it didn't pick up by then, it wasn't going to restart. I haven't had time to look through the logs but I'd guess there was a timer that expired since it was taking so long to reboot the Master host.
All three of the hosts took about 30 minutes before reboot.
And then the load balancing was all wrong, when I finished the updates I did a rolling pool reboot. It refused to put any VMs on host 2 during this process, and once the pool reboot finished it spent about 30 minutes migrating VMs for what appeared to be no reason, twice ending up with all VMs on host 1 or host 3. After it finally stopped migrating, I manually migrated a few VMs off to host 2 and left it alone for the night. Just got back in and will be checking things this morning.
I'm doing the latest updates on my production pool, and found something that is really just an annoyance more than a problem.
3 hot pool with Intel Silver v2 and 128GB of ram in each host.
Click on the pool, go to updates, hit the rolling pool update button. VMs migrate out as normal, update get's transferred to Master as normal. Took over 30 minutes after this step to reboot.
Upon reboot, VMs did not migrate back. Task for Rolling pool update did not pick up where it left off. Manually migrated a single VM back to Master to see if things were really still working, seemed OK.
Went to lunch to see if it would sort itself out. Nope.
Came back from lunch, went to the third host and entered maintenance mode to migrate all the VMs, when done told it to install updates, when done told it to reboot. Waiting about 20 minutes so far and guessing it will be a full 30 before it reboots.
Why I say this is an annoyance more than a problem, because we need to be on XCP-ng 8.3 in another two months so I'm not sure this is worth a fix as long as everything functions when I have all three hosts updated.
We have a group of colleges together, and they got the price down to $120 per core for VCF, there are no other levels to buy.
And for the small system that we have, Vates would not be a huge amount less, only a couple thousand a year less which doesn't really push to find a different solution. But again I have not looked into education discounts yet so if that cuts the price in half, then it would be substantial enough that they might think about changing. We also pay for Dell vxrail, not sure how much that costs, but allows us to not employ a person to handle the cluster.
There are scripts to run that will set up the XO-CE, even an image you can download directly and answer a few questions to set the IP, etc. while downloading it. It's not hard and easy to document. If that user goes away, then it might get more complex, but there are a couple people that have made scripts on github to get the XO-CE running on many Debian based and many RHEL based linux, I think there is even a docker image if you are using docker stuff.
But I agree looking out for "the next guy" is something that needs to be done whenever possible.
As far as pricing for non-profit education, I'll have to contact sales again and see what I can do. I checked several years ago when things were kind of separate, now that support is all encompassing I need to check back and see what it will cost. I've just been running the XO-CE version but I like to support projects where I can, and if I can wedge a little money into my budget for support, I certainly will do that. With only 3 hosts and a handful of VMs, it's hard to come up with the money for the lowest tier.
One thing I really want to work with is XOstor, I think in my system this might be a good way to go forward for me. Cheaper than building new NAS (about $5000 each for two of them).
All that said, if it is a simple enough system, you probably aren't going to need much support beyond these forums.
[edit] Are we allowed to attach PDF documents to a post? I have simple instructions from when I set up 8.2 in my lab. I don't have newer documents made for 8.3 using XO-lite yet, but screenshots to put to words. XO-lite is changing the knowledge burden to get up and running by a significant factor, and I like where it is going!
Has anyone tried turning off delta, and turning off compression?
Not ideal, but its how I'm dealing with some different issues (windows with big empty disks).
OK, 3 months is good because I'm in a nasty bind right now and this may need to wait until August. I would expect many other places to have the same issues.