@Biggen At the moment, xcp-ng center provides some better views and overviews not yet available in XO.. Hoping next major version fixes this

Sorry for spamming the thread.

I have two identical servers (srv01 and srv02) with AMD EPYC 7402P 24 Core CPUs. On srv02 I enabled the LLC as NUMA Node.

I've done some quick benchmarks with Sysbench on Ubuntu 20.10 with 12 assigned cores. Command line: sysbench cpu run --threads=12

It would seem that in this test the NUMA option is much faster, 194187 events vs 103769 events. Perhaps I am misunderstanding how sysbench works?

With 7-zip the gain is much less, but still meaningful. A little slower in single-threaded performance but quite a bit faster in multi-threaded mode.

Problem was a stale connection with the NFS server. A reboot of the NFS server fixed the issue.

@xcprocks said in Restoring a downed host ISNT easy:

So, we had a host go down (OS drive failure). No big deal right? According to instructions, just reinstall XCP on a new drive, jump over into XOA and do a metadata restore.

Well, not quite.

First during installation, you really really must not select any of the disks to create an SR as you could potentially wipe out an SR.

Second, you have to do the sr-probe and sr-introduce and pbd-create and pbd-plug to get the SRs back.

Third, you then have to use XOA to restore the metadata which according to the directions is pretty simple looking. According to: https://xen-orchestra.com/docs/metadata_backup.html#performing-a-restore

"To restore one, simply click the blue restore arrow, choose a backup date to restore, and click OK:"

But this isn't quite true. When we did it, the restore threw an error:

"message": "no such object d7b6f090-cd68-9dec-2e00-803fc90c3593",
"name": "XoError",

Panic mode sets in... It can't find the metadata? We try an earlier backup. Same error. We check the backup NFS share--no its there alright.

After a couple of hours scouring the internet and not finding anything, it dawns on us... The object XOA is looking for is the OLD server not a backup directory. It is looking for the server that died and no longer exists. The problem is, when you install the new server, it gets a new ID. But the restore program is looking for the ID of the dead server.

But how do you tell XOA, to copy the metadata over to the new server? It assumes that you want to restore it over an existing server. It does not provide a drop down list to pick where to deploy it.

In an act of desperation, we copied the backup directory to a new location and named it with the ID number of the newly recreated server. Now XOA could restore the metadata and we were able to recover the VMs in the SRs without issue.

This long story is really just a way to highlight the need for better host backup in three ways:

A) The first idea would be to create better instructions. It ain't nowhere as easy as the documentation says it is and it's easy to mess up the first step so bad that you can wipe out the contents of an SR. The documentation should spell this out.

B) The second idea is to add to the metadata backup something that reads the states of SR to PBD mappings and provides/saves a script to restore them. This would ease a lot of the difficulty in the actual restoring of a failed OS after a new OS can be installed.

C) The third idea is provide a dropdown during the restoration of the metadata that allows the user to target a particular machine for the restore operation instead of blindly assuming you want to restore it over a machine that is dead and gone.

I hope this helps out the next person trying to bring a host back from the dead, and I hope it also helps make XOA a better product.

Thanks for a good description of the restore process.

I was wary of the metadata-backup option. It sounds simple and good to have, but as you said it is in no way a comprehensive restore of a pool.

I'd like to add my own oppinion here. A full pool restore, including network, re-attaching SRs and everything else that is needed to quickly get back up and running. Also a restore pool backup should be available on the boot media. It could look for a NFS/CIFS mount or a USB disk with the backup files on. This would avoid things like issues with bonded networks not working.

Might a different solution be to use a USB network bridge instead of direct attached USB? Something like this https://www.seh-technology.com/products/usb-deviceserver/utnserver-pro.html (There are different options available)... We use my-utn-50a with hardware USB keys and it has shown to be very reliable over the years.

@andrewm4894 said in Netdata package is now available in XCP-ng:

Qq, what would be the best way for me to try spin up a sort of test or dev XCP-ng env for me to try things out on? Or is there sort of hardware involved such that this might not be so easy. In my mind I'm imagining spinning up a VM lol which probably shows my level of naivety

You can run XCP-ng inside a VM, as long as the hypervisor underneath exposes nested virtualisation. The actual installation of XCP-ng is very easy. Mostly click and run.

@olivierlambert looks nice, also with the improved docs

@olivierlambert hi. I'm also eager to see how the new v3 is progressing. From my company point of view, being able to compact VDIs using guest trim/unmap is very valuable as it minimises storage space usage and improves backup/restore speeds.

For now, a warning in XOA when changing the management IP would be nice. It could include an instruction on how to update the pool members after the IP of the master was changed.

Is it possible to use hostnames instead of IPs? It could make things easier?

@olivierlambert said in IP Address changed for a slave within a Pool, How do I reconfigure it?:

On a slave host, the database is in read only. If the slave lost the connection with the master, there's no way to make any change into the "local" slave XAPI database.

It makes sense. It would have been nice if pool members get the updated IP through XAPI before the actual change on the master happens.

@Kajetan321 we use the digi anywhere USB 24 because we needed so many devices. But it works great. We also have a my-utn USB dongle server for year. Really good stuff both of them.

https://www.seh-technology.com/services/downloads/download-deviceserver/myutn-50.html

https://hub.digi.com/support/products/infrastructure-management/digi-anywhereusb-24-plus/

Thanks. Then, what about Linux guests? Most of mine seem to have this enabled, but not all. I do know that the Linux kernel supports Hyper-V extensions, so is it an advantage on Linux too?

Hi,

I just noticed a new toggle called "Viridian". What exactly does this do and what impact does it have if it is on or off?

https://github.com/vatesfr/xen-orchestra/issues/6572

There is a hotfix from Citrix that seems to indicate that viridian should be enabled for optimal performance. https://support.citrix.com/article/CTX258320/hotfix-xs80e003-for-citrix-hypervisor-80
I did check and it seems some vms have it enabled and others not.

For now, a warning in XOA when changing the management IP would be nice. It could include an instruction on how to update the pool members after the IP of the master was changed.

Is it possible to use hostnames instead of IPs? It could make things easier?

@olivierlambert said in IP Address changed for a slave within a Pool, How do I reconfigure it?:

On a slave host, the database is in read only. If the slave lost the connection with the master, there's no way to make any change into the "local" slave XAPI database.

It makes sense. It would have been nice if pool members get the updated IP through XAPI before the actual change on the master happens.

@olivierlambert said in IP Address changed for a slave within a Pool, How do I reconfigure it?:

If you changed the master IP, the XAPI slave can't reach the master anymore, and so you can't make any modification via XAPI (since everything is going to the master, and then if needed to the slave).

On the slave, you might need to modify manually the master IP address in /etc/xensource/pool.conf. You should have:
slave:<OLD MASTER IP> and change it to slave:<NEW MASTER IP>

I had exactly this error an hour ago. I changed the management interface IP, but the member server could not re-establish contact. Looking in xensource logs I saw it was trying to connect using the old IP, but I thought this was stored in the xapi database and could not be updated...

@olivierlambert said in XCP-ng 8.3 public alpha :

It's an alpha not because it's unstable Just that we can make some updates before the official release. Happy to see it works well!

A thought. Is there a planned list of stuff that we can vote on to have on the next release?

@julien-f Would it help if I add the pool member to the "Servers" list as http:// ?

Thanks!

I tried the ESC option but could never get it to work. I thing the UEFI is set to 0s waiting time for boot options, which makes it tricky to time it.

Is it possible to change the default resolution in the VM templates for the UEFI resolution? It is possible to enter UEFI BIOS if you disable all boot devices, but it is a little cumbersome to adjust when creating new VMs.