VM’s Slow booting
-
@olivierlambert hi! Thank you.
Well. I’ve been googling around and watching some videos of xcp-ng and what thought was slow boot times are normal boot times for this hypervisor. I guess I was used to proxmox being much faster booting vms.
-
I don't have such time myself to boot VMs
Maybe you are talking about the emulated BIOS boot time, be sure to have hard disk first in the boot order, maybe it's waiting for network boot. -
@olivierlambert hi, again!
Nah, as told before it’s on initramdisk. After loading grub. A Ubuntu test install I did freezes for almost 20 seconds there.
I do have some warnings when I boot xcp-ng regarding x-273 and x-297 .... would that cripple performance that much. ( consumer hardware )
-
@bassopt did you ever work this out? seeing the same thing at the moment. and with a lot of time passed XCP has improved but I'm still seeing this same thing with debian 12.5
-
Nobody reported the same behavior, so I assume it might be specific to a configuration combo or something like that. For example, if you use Cloudinit with DHCP, the VM could take up to 2 min to boot (while it's instant otherwise). So I'm not sure it's on XCP-ng from the start.
Let's get a bit more datapoint: how long it takes to boot after grub up to the moment you got the login screen?
-
To give one datapoint here.
I booted a Ubuntu 22.04.2 LTS VM using bios.
From grub hitting enter to boot to the login 11 sec.
Host: AMD Ryzen 7 7840HS 64GB RAM
VM VDI is on an NFS share connected through 2,5Gb Ethernet -
Ubuntu server or desktop?
-
I haven’t used XCP-ng for a while , but the issues I had were similar. Around 10-12 secs from grub to prompt. Both in Debian or Ubuntu server. For some reason I remember the machines booted way faster using uefi than bios, so I always thought it was some odd issue with your bio’s implementation
I have a machine I can install xcp-ng to test … I’ll give it a go soon.
-
@olivierlambert said in VM’s Slow booting:
Ubuntu server or desktop?
Sorry, I should have added that. Ubuntu Server it is. A short stop is always on Cloud Init - 2-4 sec.
-
Well mini was on initramfs. Boot part. I never used cloud init for anything
-
Cloudinit is loading many things, so I wouldn't be surprised it makes the boot longer. Can we check with a default/basic Ubuntu server install and give the timing?
-
Installed a new 22.04.2 Server in default installation and removed cloud-init. Hitting enter in grub to login screen 6 sec. on the same host as noted above
-
Let see in the community around if they have a similar experience. My impression is 6 seconds is relatively fine.
-
@olivierlambert I have one Ubuntu server 22.04, fresh install and it has had this "slow" booting (black screen foir a few seconds) since the install. Doesn't bother me much. While all my Debian 12 boot instantly without this hang.
-
Could this be the grub menu and it's wait timer? I had it once that I did no saw grub but the system bootet fine. In the end grub was the black screen and depending on the wait interval it stayed black.
This might be a thing with how the console handles image grabbing during boot
-
@imaginapix Don't know enough of this. I only use debian and know my way around.
The ubuntu VM was just a test....Here is a video of the VM booting: https://www.dropbox.com/scl/fi/z7urjkcubq8vnjjbcs9nn/ScreenShot-2024-04-19-at-18.01.45.mov?rlkey=iufbqfqy7758pke3hsiv58zpt&dl=0
-
@manilx I can tell you this is extremely dois compare to proxmox for exemple. My Debian VMs with one CORe on a i5-12400 boot in half of that time.
-
Ubuntu 20-22 boot is slow by design. It may take 1-2min.
Debian or any rhel boot in 20sec. -
@olivierlambert Out of curiosity, I carried out a few tests this weekend. My tests are not really scientific and must be taken with a grain of salt. I started with the bare metal installs, followed by the VM installs on the hypervisors. The current server ISOs have been used for OS or hypervisor installs. All OS or hypervisor were updated, but otherwise no tweaking was done (e.g. remove snap from Ubuntu).
The tests were carried out manually by starting the (bare metal/virtualized) OS and taking the time until the login prompt appeared. Where necessary, the grub menu was confirmed manually as quickly as possible. Up to three runs were averaged. The host is a HP ProDesk 400 G6 with a i5-10500T CPU, 32GB RAM and a KIOXIA 512GB M.2 NVMe SSD (KXG70ZNV512G). VMs had 2 CPU, 4 GB RAM and 32 GB storage.
Host OS Time to login [BIOS/EUFI in s] bare metal Ubuntu 22.04.4 -/39 Debian 12.5 -/20 XCP-ng 8.2.1 Ubuntu 22.04.4 28/12 Debian 12.5 18/8 Proxmox 8.1.4 Ubuntu 22.04.4 12/15 Debian 12.5 10/10 Even if the differences are measurable, they don't have much significance for me in normal everyday operation. The result is still interesting though.
Edit: Added Time to login for EUFI boot on the hypervisors.
-
Thanks @gskger
Have you tried UEFI vs BIOS?
