New guest tools ISO for Linux and FreeBSD. Can you help with the tests?

gskger

@stormi Updated my two host playlab (XCP-ng 8.2.0 fully patched) as per 1 and did a reboot of the hosts.

Created a new Debian 10 VM from scratch, installed the new guest tools and did a reboot of the VM. IP addresses and Management agent are shown as expected. Clean shutdown and reboot is working (from XO from source and from the VM console). Live migration is working as well.

Did the same with a Debian 10 VM restored from backup and it basically works as well. I experienced some "blibs" along the way which I attribute to my impatience (e.g. I was unable to eject the new guest tools disk after a live migration and needed a toolstack restart). Can not reproduce this, so most likely nothing.

Edit #1: Exported a Debian 10 VM with the "old" guest tools installed from another pool and imported it to my playlab pool, installed the new guest tools, did a reboot and it works as expected.

Edit #2: Created a new Ubuntu 20.04 server VM and everything works as well.

stormi

@ruskofd There's also one directly in the ISO, that is apparently used by install.sh on CoreOS.

chey

@stormi Fresh CentOS 8 install and migration working.

Screen Shot 2021-03-25 at 9.21.26 AM.png
Screen Shot 2021-03-25 at 9.25.38 AM.png

chey

Fresh install of FreeBSD good.

Screen Shot 2021-03-25 at 10.06.56 AM.png

Reboot and migration working as well.

gskger

@chey @stormi shouldn't the management agent register as version 7.20 ?

chey

@gskger For FreeBSD the distro packages were used.

So there is no change for FreeBSD which I believe is intended.

Screen Shot 2021-03-25 at 9.59.51 AM.png

Anonabhar

I really wish they would update the ports on FreeBSD. I am a heavy user of BSD and have all sorts of problems with migrations between servers. I normally get a lockup and some strange "Yellow and Black" bios screen, but not always.. 10% of the time it will migrate properly.

gskger

@chey Ah, I see - - thought that would have changed due to the topic and the test results.

chey

Fresh install of CentOS 7

ravenet

SLES 12.5 (usual warnings of sles12 xe-guest-utilities-xenstore conflicts with SUSE xen-tools)
IP addresses reporting : OK
Management agent detected : OK
Clean shutdown/reboot : OK

SLES 15.1 seems fine
IP addresses reporting : OK
Management agent detected : OK
Clean shutdown/reboot : OK

OpenSUSE LEAP 15.2 - Failed to determine Linux distribution and version

stormi

I have made version 7.20.0-5 of the tools available in the testing repository. The only difference is it should fix installation on FreePBX.

Could someone test?

The test instructions in the first post are still relevant. In addition, you can check that the tools can be installed from the guest tools ISO on a FreePBX VM and that the reported distro in XO's advanced parameters is "sangoma".

stormi

I didn't get feedback but I have hopes for the next one: xcp-ng-pv-tools-8.2.0-6.xcpng8.2 adds support for two new CentOS clones: Almalinux and Rocky Linux.

Still interested in feedback regarding FreePBX though.

And about tests for regressions.

Please refer to first post for installation instructions.

jmccoy555

Saw FreeBSD and got excited......

./install.sh 
Detected `FreeBSD 12.2-RELEASE-p6' (FreeBSD version 12).

xe-guest-utilities-6.2.0_3 already installed
No updates required to this Virtual Machine.

At least the script now works.

michael2z

@jmccoy555 I just used it on an AlmaLinux OS 8.3 and it installed great.

/mnt/cdrom/Linux/install.sh
Detected `AlmaLinux release 8.3 (Purple Manul)' (almalinux version 8).

The following changes will be made to this Virtual Machine:
  * packages to be installed/upgraded:
    - xe-guest-utilities-7.20.0-7.x86_64.rpm
    - xe-guest-utilities-xenstore-7.20.0-7.x86_64.rpm

Continue? [y/n] y

Verifying...                          ################################# [100%]
Preparing...                          ################################# [100%]
Updating / installing...
   1:xe-guest-utilities-xenstore-7.20.################################# [ 50%]
   2:xe-guest-utilities-7.20.0-7      ################################# [100%]

You should now reboot this Virtual Machine.

michael2z

@michael2z I neglected to mention that there's a newer guest utilities in the epel repository (xe-guest-utilities-latest-7.21.0-1.el8.x86_64).

gskger

@stormi Did some regression testing with fresh installs of

Debian 10.7
Ubuntu 20.04
Centos 8
FreePBX 15 (based on Centos 7.6 and testing only on request)

and checked IP, Management agent, shutdown/reboot, live migration with
a. no guest tools (fresh install)
b. current guest tools (from XCP-ng 8.2.0)
c. testing guest tools (from yum update xcp-ng-pv-tools --enablerepo=xcp-ng-testing)

So 1a is fresh install of Debian 10 without guest tools, 4b is FreeBX install with current guest tools installed, 4b-c is FreePBX with testing guest tool installed over current guest tools and 3a-c is CentOS with testing guest tools installed over a fresh install without guest tools.

Fresh install
1-4a worked as expected.

From fresh install to current guest tool
1a-b, 2a-b installed with bash /mnt/Linux/install.sh
3a-b only installed with bash /mnt/Linux/install.sh -d centos -m 8
4a-b only installed with bash /mnt/Linux/install.sh -d centos -m 7

1a-b, 2a-b showed Management Agent 8.1.50-1 with icon
3a-b, 4a-b showed Management Agent 8.1.50-1 but no icon

From current guest tool to testing guest tool
After installing the new guest tools iso on both hosts
1b-c, 2b-c, 3b-c installed with bash /mnt/Linux/install.sh, so CentOS 8 is now autodetected - nice
4b-c only installed with bash /mnt/Linux/install.sh -d centos -m 7

1b-c, 2b-c, 3b-c showed Management Agent 7.20.0.7 with icon
4b-c showed Management Agent 7.20.0.7 but still no icon

From fresh install to testing guest tool
1a-c, 2a-c, 3a-c and 4a-c give the same results as b-c.

Apart from the change in Management Agent version, CentOS now being autodetected, and FreePBX not beeing autodetected I had no issues with the new guest tools.

Edit: Typos and version information for FreePBX, where cat /etc/os-release on 4a returns

NAME="Sangoma Linux"
VERSION="7 (Core)"
ID="sangoma"
ID_LIKE="centos rhel fedora"
VERSION_ID="7"
PRETTY_NAME="Sangoma Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:sangoma:sng:7::server:utf8"
HOME_URL="https://distro.sangoma.net/"
BUG_REPORT_URL="https://issues.sangoma.net/"

CENTOS_MANTISBT_PROJECT="Sangoma-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="sangoma"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

jmccoy555

@michael2z Yes, I get 7.20.0-7 on Linux (Debian 10).

stormi

@michael2z said in New guest tools ISO for Linux and FreeBSD. Can you help with the tests?:

@michael2z I neglected to mention that there's a newer guest utilities in the epel repository (xe-guest-utilities-latest-7.21.0-1.el8.x86_64).

Newer... Maybe. Ours is version 7.20.0 + various patches. 7.20.1 is not that different and may even lack support for Almalinux or Rocky Linux, depending on whether @cheese backported their support (that was added post 7.20.1) yet or not. Support can be considered full only once the installed tools are able to detect what distro they run on.

However, it's good to remind people that this package exists in EPEL and that you can use it instead of the guest tools ISO. Just don't forget to enable the xe-linux-distribution service after installation, as described in the docs: https://xcp-ng.org/docs/guests.html#centos-and-fedora

stormi

@gskger said in New guest tools ISO for Linux and FreeBSD. Can you help with the tests?:

1b-c, 2b-c, 3b-c installed with bash /mnt/Linux/install.sh, so CentOS 8 is now autodetected - nice

To be more precise, CentOS 8 > 8.2 is now detected. It worked until 8.2 included then the structure of the release file changed slightly and detection didn't work anymore. By the way I'm more and more convinced that we should use /etc/os-release rather than those fragile seds on release files. At least for distros recent enough.

See https://github.com/xenserver/xe-guest-utilities/issues/108

4b-c only installed with bash /mnt/Linux/install.sh -d centos -m 7

Thanks for testing that OS although you don't use it. Much appreciated. Can you share the contents of /etc/centos-release from that FreePBX 15 system? And the ouput of bash install.sh (without any extra options) and xe-linux-distribution from the testing guest tools? The installer script was supposed to detect the distro and offer the package installation right away.

4b-c showed Management Agent 7.20.0.7 but still no icon

The icon is added by Xen Orchestra so they probably don't know about FreePBX, simply. I suppose you can create an enhancement request for that. You can still check that correct information about the OS is displayed in the Advanced tab despite the absence of icon.

Apart from the change in Management Agent version, CentOS now being autodetected, and FreePBX not beeing autodetected I had no issues with the new guest tools.

About those versioning differences, our 7.20.0 is actually newer than Citrix' 8.1.50 (which is the version XCP-ng 8.2 has currently in its guest tools ISO). The reason for that is that one gets to choose the version number arbitrarily when building the tools. Citrix uses the version of Citrix Hypervisor (where 8.1.50 used to mean "the future CH 8.2" when the tools were built) and I chose to use the version of the tools themselves, from the tags in the upstream https://github.com/xenserver/xe-guest-utilities repository.

7.20.0-7 means "tools built from version 7.20.0 + XCP-ng patches, 7th build". Where the higher the build number, the more likely you are to have patches added by us, either backported from ustream or specific to XCP-ng.

stormi created this issue in xenserver/xe-guest-utilities

closed Use `/etc/os-release` for recent distros #108

gskger

@stormi Sure, no problem. But there is no /etc/centos-release, only a /etc/centos-release-upstream

[root@freepbx /]# ls /etc/*release* -la
-rw-r--r--. 1 root root  51 Sep  8  2020 /etc/centos-release-upstream
-rw-r--r--. 1 root root 423 Sep  8  2020 /etc/os-release
lrwxrwxrwx. 1 root root  15 May 14 12:26 /etc/redhat-release -> sangoma-release
-rw-r--r--. 1 root root  39 Sep  8  2020 /etc/sangoma-release
-rw-r--r--. 1 root root  39 Sep  8  2020 /etc/sangoma-release-upstream
lrwxrwxrwx. 1 root root  15 May 14 12:26 /etc/system-release -> sangoma-release
-rw-r--r--. 1 root root  34 Sep  8  2020 /etc/system-release-cpe

and cat /etc/centos-release-upstream returns

[root@freepbx /]# cat /etc/centos-release-upstream
Derived from Red Hat Enterprise Linux 7.8 (Source)

Running install.sh when the testing guest tool iso is mounted returns

[root@freepbx Linux]# bash /mnt/Linux/install.sh
Fatal Error: Failed to determine Linux distribution and version.

and xe-linux-distribution returns nothing

[root@freepbx Linux]# /mnt/Linux/xe-linux-distribution
[root@freepbx Linux]#