Problems with latest XOA update - failed to start xo-server [SOLVED]

Forza

Hi! I just ran the XOA updater in the webui. It took a long time and eventually I just got a blank screen.

I waited some minutes and rebooted though that did not help. In journalctl I get the following:

Apr 14 08:31:41 xoa systemd[1]: Started LSB: Virtual Machine daemon providing host integration services.
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Service RestartSec=100ms expired, scheduling restart.
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Scheduled restart job, restart counter is at 2.
Apr 14 08:31:41 xoa systemd[1]: Stopped XO Server.
Apr 14 08:31:41 xoa systemd[1]: Started XO Server.
Apr 14 08:31:41 xoa systemd[579]: xo-server.service: Failed to execute command: No such file or directory
Apr 14 08:31:41 xoa systemd[579]: xo-server.service: Failed at step EXEC spawning /usr/local/bin/xo-server: No such file or directory
Apr 14 08:31:41 xoa systemd[1]: Starting XOA init on first run...
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Main process exited, code=exited, status=203/EXEC
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Failed with result 'exit-code'.
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Service RestartSec=100ms expired, scheduling restart.
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Scheduled restart job, restart counter is at 3.
Apr 14 08:31:41 xoa systemd[1]: Stopped XO Server.
Apr 14 08:31:41 xoa systemd[1]: Started XO Server.
Apr 14 08:31:41 xoa systemd[650]: xo-server.service: Failed to execute command: No such file or directory
Apr 14 08:31:41 xoa systemd[650]: xo-server.service: Failed at step EXEC spawning /usr/local/bin/xo-server: No such file or directory
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Main process exited, code=exited, status=203/EXEC
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Failed with result 'exit-code'.
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Service RestartSec=100ms expired, scheduling restart.
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Scheduled restart job, restart counter is at 4.
Apr 14 08:31:41 xoa systemd[1]: Stopped XO Server.
Apr 14 08:31:41 xoa systemd[1]: Started XO Server.
Apr 14 08:31:41 xoa systemd[912]: xo-server.service: Failed to execute command: No such file or directory
Apr 14 08:31:41 xoa systemd[912]: xo-server.service: Failed at step EXEC spawning /usr/local/bin/xo-server: No such file or directory
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Main process exited, code=exited, status=203/EXEC
Apr 14 08:31:41 xoa systemd[1]: xo-server.service: Failed with result 'exit-code'.
Apr 14 08:31:42 xoa systemd[1]: xo-server.service: Service RestartSec=100ms expired, scheduling restart.
Apr 14 08:31:42 xoa systemd[1]: xo-server.service: Scheduled restart job, restart counter is at 5.
Apr 14 08:31:42 xoa systemd[1]: Stopped XO Server.
Apr 14 08:31:42 xoa systemd[1]: xo-server.service: Start request repeated too quickly.
Apr 14 08:31:42 xoa systemd[1]: xo-server.service: Failed with result 'exit-code'.
Apr 14 08:31:42 xoa systemd[1]: Failed to start XO Server.

xoa-check does work. No command "xoa" found.

when I run xoa-updater form the shell I get:

[08:38 14] xoa:log$ xoa-updater
latest channel selected
Following packages will be removed:
  xoa-updater 0.37.0
New versions available:
  node 14.16.1 (14.16.0 installed)
  npm 6.14.13 (6.14.11 installed)
New versions available:
  xoa-updater 0.37.0 (0.37.0 installed)
New packages available:
  xen-orchestra-upload-ova 0.1.4
  xen-orchestra 5.57.1
  xo-server-auth-github-enterprise 0.2.2
  xo-server-auth-google-enterprise 0.2.2
  xo-server-auth-ldap-enterprise 0.10.2
  xo-server-auth-saml-enterprise 0.8.0
  xo-server-backup-reports-enterprise 0.16.9
  xo-server-telemetry 0.4.1
  xo-server-transport-email-enterprise 0.6.0
  xo-server-transport-icinga2-enterprise 0.1.1
  xo-server-transport-nagios-enterprise 0.1.1
  xo-server-transport-slack-enterprise 0.0.0
  xo-server-transport-xmpp-enterprise 0.1.1
  xo-server-usage-report-enterprise 0.10.0
  xo-server-xoa 0.11.3
  xo-server 5.78.4
  xo-web-enterprise 5.80.1
  xoa-cli 0.26.0

ℹ xoa-updater may be run again to upgrade packages

xoa-updater --upgrade seems to get stuck:

 xoa-updater --upgrade
latest channel selected
Downloading packages...
  xo-server-transport-nagios-enterprise ..... ok ✔
  xen-orchestra . ok ✔
  xo-server-transport-icinga2-enterprise ............................... ok ✔
  xo-server-auth-github-enterprise .......... ok ✔
  xo-server-auth-google-enterprise ........... ok ✔
  xo-server-transport-email-enterprise ................... ok ✔
  xo-server-telemetry ..................................... ok ✔
  xo-server-xoa ............................................................. ok ✔
  xo-server-backup-reports-enterprise ............................................................................................. ok ✔
  xen-orchestra-upload-ova .................................................................................................... ok ✔
  xo-server-auth-ldap-enterprise ........................................................................................................................ ok ✔
  xo-server-transport-slack-enterprise ..................................................................................................................... ok ✔
  xo-server-transport-xmpp-enterprise ..................................................................................................................................... ok ✔
  xo-server-usage-report-enterprise ............................................................................................................................................................................... ok ✔
  xo-server-auth-saml-enterprise ....................................................................................................................................................................................... ok ✔
  xoa-cli ........................................................................................................................................................................................................................... ok ✔
  xoa-updater ................................................................................................................................................................................................................................................................................................................................................... ok ✔
  xo-web-enterprise ................................................................................................................................................................................................................................................................................................................................................................................ ok ✔
  xo-server ................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................ ok ✔
Following packages will be removed:
  xoa-updater 0.37.0
Removing packages...
Saving current updater version in /usr/local/lib/node_modules/xoa-updater/dist-1618382753080 ...ok ✔

Here it was stuck for 4 minutes but did eventually continue.

After a restart everything is back to working again

olivierlambert

If you have a slow CPU, extracting/rebuilding can take some time. If the process is interrupted in the middle, you can have this issue. So in general, let the update work for a bit before restarting anything

Forza

@olivierlambert said in Problems with latest XOA update - failed to start xo-server [SOLVED]:

If you have a slow CPU, extracting/rebuilding can take some time. If the process is interrupted in the middle, you can have this issue. So in general, let the update work for a bit before restarting anything

That's the thing. Not a very slow CPU (EPYC server) and according to top there was no cpu usage. Seemed some kind of timeout thing happening.

olivierlambert

Maybe slow disk then? Hard to know from here.