XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Some dashboard loading issues with v6

    Scheduled Pinned Locked Moved Xen Orchestra
    11 Posts 4 Posters 198 Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • acebmxerA Online
      acebmxer
      last edited by

      Just noticed my V6 dashboard for the XO appliance does not load... Commit - d810e

      Screenshot_20260514_172209.png

      Reboot xo and the dashboard may load or after a few refreshes it will load or partially load.

      Screenshot_20260514_172919.png

      Pool Dashboard loads...

      Screenshot_20260514_172342.png

      Screenshot_20260514_173222.png

      Screenshot_20260514_173236.png

      After some trouble shooting with my script and AI this is what we think to be the issue...

      After pulling master (at 8c00ccef / d810ea0c), @xen-orchestra/web/dist is empty after a fresh build. Turbo reports all 33 tasks successful, but the browser gets text/html for every JS chunk under /assets/ because xo-server serves / from an empty directory.
      
      Yarn warns about unmet peer deps for @xen-orchestra/web-core@0.52.0:
      
      pinia@^3.0.1
      vue@~3.5.13
      vue-router@^5.0.0
      vue-i18n@^11.1.2
      These appear to not be resolved correctly, likely causing Vite to produce no output while still exiting 0. The old UI is accessible at /v5.
      
      Environment: Node 24.15.0, yarn 1.22.22, turbo 2.9.12, built from fresh clone.
      

      Another issue found

      After a token flush (or after any update where session tokens are cleared), xo-server logs:
      
      
      TypeError: Cannot destructure property 'client' of 'token' as it is undefined.
          at Tokens._unserialize (packages/xo-server/src/models/token.mjs:16:13)
          at packages/xo-server/src/collection/redis.mjs:194:48
      Root cause: collection/redis.mjs iterates xo:token:* keys but does not filter out the xo:token::indexes key, which is a Redis HASH (not a STRING). Calling GET on a hash-type key returns a WRONGTYPE error; the code receives undefined and passes it to _unserialize, which destructures it and crashes. The fix would be to skip keys containing :: when iterating token records, since those are collection index metadata, not auth token entries.
      
      simonpS 1 Reply Last reply Reply Quote 0
      • olivierlambertO Offline
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        Ping @Team-XO-Frontend

        1 Reply Last reply Reply Quote 0
        • simonpS Offline
          simonp Vates 🪐 XO Team @acebmxer
          last edited by

          @acebmxer Hi,

          The empty /dist might be due to the node version, we do not yet support node 24, could you change your node version to 22 and try to build xen-orchestra again ?

          Thanks.

          acebmxerA 1 Reply Last reply Reply Quote 1
          • acebmxerA Online
            acebmxer @simonp
            last edited by

            @simonp

            I keep asking that about Node version. And every time i was told use the latest LTS which is 24.15... Yet i see 22 being used.

            I can try later today and report back.

            acebmxerA 1 Reply Last reply Reply Quote 0
            • acebmxerA Online
              acebmxer @acebmxer
              last edited by

              I managed to down grade to node 22.22.3 and still same issue. Its seem better on node 22.22.3 but still an issue.

              simonpS 1 Reply Last reply Reply Quote 0
              • simonpS Offline
                simonp Vates 🪐 XO Team @acebmxer
                last edited by

                @acebmxer Ok thanks.

                I'm guessing that switching to node 22 solved the dist issue but you still have the Redis issue.

                We have identified a possible problem with Redis that looks like your issue, would you mind checking out this branch fix_redis_orphaned_entry ?

                Try loading the v6 dashboard again after a rebuild and restart of your XO.

                Thank for your help.

                acebmxerA 1 Reply Last reply Reply Quote 0
                • acebmxerA Online
                  acebmxer @simonp
                  last edited by acebmxer

                  @simonp

                  With node = 22.22.3

                  Screenshot_20260519_061514.png

                  Screenshot_20260519_061535.png

                  with node = 24.15.0

                  Screenshot_20260519_062729.png

                  Screenshot_20260519_063025.png

                  Screenshot_20260519_063457.png

                  ❯ sudo journalctl -u xo-server -n 75
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.516Z xo:plugin INFO register sdn-controller
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.517Z xo:plugin INFO register test-plugin
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.517Z xo:plugin INFO register transport-email
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.518Z xo:plugin INFO register transport-icinga2
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.518Z xo:plugin INFO register transport-nagios
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.519Z xo:plugin INFO register transport-slack
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.519Z xo:plugin INFO register transport-xmpp
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.519Z xo:plugin INFO register usage-report
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.520Z xo:plugin INFO register web-hooks
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.890Z xo:xo-server-openmetrics INFO Plugin initialized
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register auth-github
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register auth-google
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register auth-oidc
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register auth-saml
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register auth-ldap
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register netbox
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register test-plugin
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register transport-icinga2
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register transport-slack
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register transport-nagios
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register transport-xmpp
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:plugin INFO successfully register usage-report
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.936Z xo:xo-server-openmetrics INFO Starting OpenMetrics server { port: 9004, bindAddress: 'localhost' }
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.942Z xo:plugin INFO successfully register web-hooks
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.942Z xo:plugin INFO successfully register backup-reports
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.942Z xo:plugin INFO successfully register load-balancer
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.942Z xo:plugin INFO successfully register transport-email
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.942Z xo:plugin INFO successfully register perf-alert
                  May 19 10:26:15 xo-ce xo-server[77015]: 2026-05-19T10:26:15.952Z xo:plugin INFO successfully register audit
                  May 19 10:26:16 xo-ce xo-server[77015]: 2026-05-19T10:26:16.020Z xo:plugin INFO successfully register sdn-controller
                  May 19 10:26:16 xo-ce xo-server[77015]: 2026-05-19T10:26:16.034Z xo:plugin INFO successfully register openmetrics
                  May 19 10:26:16 xo-ce xo-server[77015]: 2026-05-19T10:26:16.035Z xo:main INFO Setting up /v5 → /opt/xen-orchestra/packages/xo-web/dist
                  May 19 10:26:16 xo-ce xo-server[77015]: 2026-05-19T10:26:16.035Z xo:main INFO Setting up /v6 → /opt/xen-orchestra/@xen-orchestra/web/dist
                  May 19 10:26:16 xo-ce xo-server[77015]: 2026-05-19T10:26:16.035Z xo:main INFO Setting up / → /opt/xen-orchestra/@xen-orchestra/web/dist
                  May 19 10:26:16 xo-ce sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=999)
                  May 19 10:26:16 xo-ce sudo[77059]: xo-service :  PWD=/opt/xen-orchestra/packages/xo-server ; USER=root ; COMMAND=/usr/bin/mount -o  -t nfs 10.100.2.23:/volume1/Backups /run/xo-server/mounts/a5e54e04-d7e4-48cb-bafc-b2f306d39679
                  May 19 10:26:16 xo-ce sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=999)
                  May 19 10:26:16 xo-ce sudo[77060]: xo-service :  PWD=/opt/xen-orchestra/packages/xo-server ; USER=root ; COMMAND=/usr/bin/mount -o  -t nfs 10.100.2.23:/volume1/backup /run/xo-server/mounts/3ba9eed2-55f1-4760-ac08-655c252aa316
                  May 19 10:26:16 xo-ce sudo[77059]: pam_unix(sudo:session): session closed for user root
                  May 19 10:26:16 xo-ce sudo[77060]: pam_unix(sudo:session): session closed for user root
                  May 19 10:26:30 xo-ce xo-server[77015]: 2026-05-19T10:26:30.018Z xo:rest-api:error-handler INFO [POST] /events/2203cd6f-1023-456b-9cf0-338f35f67be9/subscriptions (401)
                  May 19 10:26:30 xo-ce xo-server[77015]: 2026-05-19T10:26:30.030Z xo:rest-api:error-handler INFO duplicates of the previous log were hidden { nDuplicates: 2 }
                  May 19 10:26:30 xo-ce xo-server[77015]: 2026-05-19T10:26:30.030Z xo:rest-api:error-handler INFO [GET] /srs (401)
                  May 19 10:26:30 xo-ce xo-server[77015]: 2026-05-19T10:26:30.031Z xo:rest-api:error-handler INFO [GET] /alarms (401)
                  May 19 10:26:31 xo-ce xo-server[77015]: 2026-05-19T10:26:31.900Z xo:rest-api:error-handler INFO [GET] /srs (401)
                  May 19 10:26:35 xo-ce xo-server[77015]: 2026-05-19T10:26:35.617Z xo:rest-api:error-handler INFO [GET] /tasks (401)
                  May 19 10:26:36 xo-ce xo-server[77015]: 2026-05-19T10:26:36.842Z xo:rest-api:error-handler INFO [GET] /backup-jobs (401)
                  May 19 10:26:36 xo-ce xo-server[77015]: 2026-05-19T10:26:36.845Z xo:rest-api:error-handler INFO [DELETE] /events/62644a6b-b513-42be-97a4-8fd478f995a6/subscriptions/alarm (401)
                  May 19 10:26:47 xo-ce xo-server[77015]: 2026-05-19T10:26:47.014Z xo:rest-api:error-handler INFO [POST] /events/126a3f5b-672e-418b-b632-28aa7f83b3fd/subscriptions (401)
                  May 19 10:26:52 xo-ce xo-server[77015]: 2026-05-19T10:26:52.622Z xo:rest-api:error-handler INFO [GET] /dashboard (401)
                  May 19 10:26:52 xo-ce xo-server[77015]: 2026-05-19T10:26:52.643Z xo:rest-api:error-handler INFO [GET] /vm-controllers (401)
                  May 19 10:26:54 xo-ce xo-server[77015]: 2026-05-19T10:26:54.260Z xo:rest-api:error-handler INFO [GET] /hosts (401)
                  May 19 10:26:54 xo-ce xo-server[77015]: 2026-05-19T10:26:54.261Z xo:rest-api:error-handler INFO [GET] /tasks (401)
                  May 19 10:26:56 xo-ce xo-server[77015]: 2026-05-19T10:26:56.101Z xo:rest-api:error-handler INFO [GET] /hosts (401)
                  May 19 10:26:57 xo-ce xo-server[77015]: 2026-05-19T10:26:57.546Z xo:rest-api:error-handler INFO [POST] /events/bb27f28f-7660-4ce5-a31c-fcb9b64fdb9f/subscriptions (401)
                  May 19 10:26:57 xo-ce xo-server[77015]: 2026-05-19T10:26:57.587Z xo:rest-api:error-handler INFO [GET] /vdis (401)
                  May 19 10:26:59 xo-ce xo-server[77015]: (node:77015) [DEP0060] DeprecationWarning: The `util._extend` API is deprecated. Please use Object.assign() instead.
                  May 19 10:26:59 xo-ce xo-server[77015]: (Use `node --trace-deprecation ...` to show where the warning was created)
                  May 19 10:26:59 xo-ce xo-server[77015]: 2026-05-19T10:26:59.509Z xo:xo-server WARN Node warning {
                  May 19 10:26:59 xo-ce xo-server[77015]:   error: DeprecationWarning: The `util._extend` API is deprecated. Please use Object.assign() instead.
                  May 19 10:26:59 xo-ce xo-server[77015]:       at ProxyServer.ws (/opt/xen-orchestra/node_modules/http-proxy/lib/http-proxy/index.js:50:26)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at app.<anonymous> (file:///opt/xen-orchestra/packages/xo-server/src/index.mjs:697:15)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at app.emit (node:events:509:28)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at app.emit (/opt/xen-orchestra/@xen-orchestra/log/configure.js:52:17)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at Server.<anonymous> (file:///opt/xen-orchestra/packages/xo-server/src/index.mjs:977:13)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at Server.emit (node:events:521:24)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at Server.patchedEmit [as emit] (/opt/xen-orchestra/@xen-orchestra/log/configure.js:52:17)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at onParserExecuteCommon (node:_http_server:987:14)
                  May 19 10:26:59 xo-ce xo-server[77015]:       at onParserExecute (node:_http_server:891:3) {
                  May 19 10:26:59 xo-ce xo-server[77015]:     code: 'DEP0060'
                  May 19 10:26:59 xo-ce xo-server[77015]:   }
                  May 19 10:26:59 xo-ce xo-server[77015]: }
                  May 19 10:27:21 xo-ce xo-server[77015]: 2026-05-19T10:27:21.248Z xo:rest-api:error-handler INFO [GET] /tasks (401)
                  May 19 10:27:21 xo-ce xo-server[77015]: 2026-05-19T10:27:21.251Z xo:rest-api:error-handler INFO [GET] /srs (401)
                  May 19 10:29:55 xo-ce xo-server[77015]: 2026-05-19T10:29:55.798Z xo:rest-api:error-handler INFO [DELETE] /events/8c7df237-3069-4c8e-8b63-d2b7a1233799/subscriptions/SR (401)
                  lines 4-75/75 (END)
                  

                  Back to node 22.22.3

                  Screenshot_20260519_064831.png

                  Screenshot_20260519_064527.png

                  ❯ sudo journalctl -u xo-server -n 75
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.721Z xo:main INFO Setting up /robots.txt → /opt/xen-orchestra/packages/xo-server/robots.txt
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.796Z xo:plugin INFO register audit
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.796Z xo:plugin INFO register auth-github
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.796Z xo:plugin INFO register auth-google
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.797Z xo:plugin INFO register auth-ldap
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.797Z xo:plugin INFO register auth-oidc
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.797Z xo:plugin INFO register auth-saml
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.797Z xo:plugin INFO register backup-reports
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.797Z xo:plugin INFO register load-balancer
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.797Z xo:plugin INFO register netbox
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.797Z xo:plugin INFO register openmetrics
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.798Z xo:plugin INFO register perf-alert
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.798Z xo:plugin INFO register sdn-controller
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.798Z xo:plugin INFO register test-plugin
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.798Z xo:plugin INFO register transport-email
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.798Z xo:plugin INFO register transport-icinga2
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.798Z xo:plugin INFO register transport-nagios
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.799Z xo:plugin INFO register transport-slack
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.799Z xo:plugin INFO register transport-xmpp
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.799Z xo:plugin INFO register usage-report
                  May 19 10:44:30 xo-ce xo-server[79847]: 2026-05-19T10:44:30.799Z xo:plugin INFO register web-hooks
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.184Z xo:xo-server-openmetrics INFO Plugin initialized
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.232Z xo:plugin INFO successfully register auth-google
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.232Z xo:plugin INFO successfully register auth-github
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.232Z xo:plugin INFO successfully register auth-ldap
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.232Z xo:plugin INFO successfully register auth-oidc
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.232Z xo:plugin INFO successfully register netbox
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.232Z xo:plugin INFO successfully register test-plugin
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.232Z xo:plugin INFO successfully register transport-icinga2
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.233Z xo:plugin INFO successfully register transport-nagios
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.233Z xo:plugin INFO successfully register transport-xmpp
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.233Z xo:plugin INFO successfully register transport-slack
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.233Z xo:plugin INFO successfully register usage-report
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.233Z xo:plugin INFO successfully register web-hooks
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.233Z xo:plugin INFO successfully register auth-saml
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.233Z xo:xo-server-openmetrics INFO Starting OpenMetrics server { port: 9004, bindAddress: 'localhost' }
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.239Z xo:plugin INFO successfully register backup-reports
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.239Z xo:plugin INFO successfully register load-balancer
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.239Z xo:plugin INFO successfully register transport-email
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.239Z xo:plugin INFO successfully register perf-alert
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.321Z xo:plugin INFO successfully register audit
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.327Z xo:plugin INFO successfully register openmetrics
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.334Z xo:plugin INFO successfully register sdn-controller
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.336Z xo:main INFO Setting up /v5 → /opt/xen-orchestra/packages/xo-web/dist
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.336Z xo:main INFO Setting up /v6 → /opt/xen-orchestra/@xen-orchestra/web/dist
                  May 19 10:44:31 xo-ce xo-server[79847]: 2026-05-19T10:44:31.336Z xo:main INFO Setting up / → /opt/xen-orchestra/@xen-orchestra/web/dist
                  May 19 10:44:36 xo-ce xo-server[79847]: (node:79847) [DEP0060] DeprecationWarning: The `util._extend` API is deprecated. Please use Object.assign() instead.
                  May 19 10:44:36 xo-ce xo-server[79847]: (Use `node --trace-deprecation ...` to show where the warning was created)
                  May 19 10:44:36 xo-ce xo-server[79847]: 2026-05-19T10:44:36.542Z xo:xo-server WARN Node warning {
                  May 19 10:44:36 xo-ce xo-server[79847]:   error: DeprecationWarning: The `util._extend` API is deprecated. Please use Object.assign() instead.
                  May 19 10:44:36 xo-ce xo-server[79847]:       at ProxyServer.ws (/opt/xen-orchestra/node_modules/http-proxy/lib/http-proxy/index.js:50:26)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at Function.<anonymous> (file:///opt/xen-orchestra/packages/xo-server/src/index.mjs:697:15)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at Function.emit (node:events:519:28)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at Function.emit (/opt/xen-orchestra/@xen-orchestra/log/configure.js:52:17)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at Server.<anonymous> (file:///opt/xen-orchestra/packages/xo-server/src/index.mjs:977:13)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at Server.emit (node:events:531:35)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at Server.patchedEmit [as emit] (/opt/xen-orchestra/@xen-orchestra/log/configure.js:52:17)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at onParserExecuteCommon (node:_http_server:977:14)
                  May 19 10:44:36 xo-ce xo-server[79847]:       at onParserExecute (node:_http_server:881:3) {
                  May 19 10:44:36 xo-ce xo-server[79847]:     code: 'DEP0060'
                  May 19 10:44:36 xo-ce xo-server[79847]:   }
                  May 19 10:44:36 xo-ce xo-server[79847]: }
                  May 19 10:44:42 xo-ce xo-server[79847]: 2026-05-19T10:44:42.247Z xo:rest-api:error-handler INFO [GET] /tasks (401)
                  May 19 10:44:47 xo-ce xo-server[79847]: 2026-05-19T10:44:47.602Z xo:rest-api:error-handler INFO [DELETE] /events/cd7bcc9d-15ba-4ce0-b31e-5d8798a4ff2e/subscriptions>
                  May 19 10:44:50 xo-ce xo-server[79847]: 2026-05-19T10:44:50.643Z xo:rest-api:error-handler INFO [GET] /vms/ff7214ce-de09-fe31-bfe9-5994af558ddb/alarms (401)
                  May 19 10:44:50 xo-ce sudo[79915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=999)
                  May 19 10:44:50 xo-ce sudo[79915]: xo-service :  PWD=/opt/xen-orchestra/packages/xo-server ; USER=root ; COMMAND=/usr/bin/mount -o  -t nfs 10.100.2.23:/volume1/bac>
                  May 19 10:44:50 xo-ce sudo[79916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=999)
                  May 19 10:44:50 xo-ce sudo[79916]: xo-service :  PWD=/opt/xen-orchestra/packages/xo-server ; USER=root ; COMMAND=/usr/bin/mount -o  -t nfs 10.100.2.23:/volume1/Bac>
                  May 19 10:44:50 xo-ce sudo[79915]: pam_unix(sudo:session): session closed for user root
                  May 19 10:44:50 xo-ce sudo[79916]: pam_unix(sudo:session): session closed for user root
                  May 19 10:45:09 xo-ce xo-server[79847]: 2026-05-19T10:45:09.413Z xo:rest-api:error-handler INFO [GET] /vms/138538a8-ef52-4d0a-4433-5ebb31d7e152/alarms (401)
                  May 19 10:45:10 xo-ce xo-server[79847]: 2026-05-19T10:45:10.197Z xo:rest-api:error-handler INFO [GET] /backup-repositories (401)
                  May 19 10:45:10 xo-ce xo-server[79847]: 2026-05-19T10:45:10.197Z xo:rest-api:error-handler INFO [POST] /events/cd7bcc9d-15ba-4ce0-b31e-5d8798a4ff2e/subscriptions (>
                  May 19 10:45:15 xo-ce xo-server[79847]: 2026-05-19T10:45:15.187Z xo:rest-api:error-handler INFO [GET] /schedules (401)
                  lines 33-75/75 (END)
                  
                  MathieuRAM 1 Reply Last reply Reply Quote 0
                  • MathieuRAM Offline
                    MathieuRA Vates 🪐 XO Team @acebmxer
                    last edited by MathieuRA

                    @acebmxer Hi,
                    Do you use an admin users or do you use a non admin users with RBAC/ACL-V2?

                    What is the ouput of /rest/v0/users/me?
                    Also, what is the ouput of /rest/v0/dashboard?

                    acebmxerA 1 Reply Last reply Reply Quote 0
                    • acebmxerA Online
                      acebmxer @MathieuRA
                      last edited by

                      @MathieuRA

                      I cleared the username with username....
                      This was taken from master branch and on commit e3a58

                      I only have the 1 admin user account.

                      {
                        "email": "username",
                        "permission": "admin",
                        "pw_hash": "***obfuscated***",
                        "groups": [],
                        "preferences": {},
                        "id": "0344d88b-0fe8-4462-811b-5c04a92981aa",
                        "name": "username"
                      }
                      
                      {
                        "nPools": 1,
                        "nHosts": 2,
                        "backupRepositories": {
                          "other": {
                            "size": {
                              "backups": 2816744846336,
                              "available": 10377301327872,
                              "other": 93359104,
                              "total": 13194139533312,
                              "used": 2816838205440
                            }
                          }
                        },
                        "resourcesOverview": {
                          "nCpus": 48,
                          "memorySize": 137438953472,
                          "srSize": 31154095382528
                        },
                        "poolsStatus": {
                          "connected": 1,
                          "disconnected": 0,
                          "unreachable": 0,
                          "unknown": 0,
                          "total": 1
                        },
                        "missingPatches": {
                          "hasAuthorization": true,
                          "nHosts": 2,
                          "nHostsFailed": 0,
                          "nHostsWithMissingPatches": 0,
                          "nHostsEol": {
                            "isEmpty": true
                          },
                          "nPools": 1,
                          "nPoolsWithMissingPatches": 0
                        },
                        "storageRepositories": {
                          "size": {
                            "available": 28331320532992,
                            "other": 2822774849536,
                            "replicated": 0,
                            "total": 31154095382528,
                            "used": 2822774849536
                          }
                        },
                        "backups": {
                          "jobs": {
                            "disabled": 5,
                            "failed": 0,
                            "noRecentRun": 0,
                            "skipped": 0,
                            "successful": 0,
                            "total": 5
                          },
                          "issues": [],
                          "vmsProtection": {
                            "protected": 0,
                            "unprotected": 8,
                            "notInJob": 13
                          }
                        },
                        "hostsStatus": {
                          "disabled": 0,
                          "running": 2,
                          "halted": 0,
                          "unknown": 0,
                          "total": 2
                        },
                        "vmsStatus": {
                          "active": 5,
                          "inactive": 16,
                          "running": 5,
                          "halted": 16,
                          "paused": 0,
                          "suspended": 0,
                          "unknown": 0,
                          "total": 21
                        }
                      }
                      
                      MathieuRAM 1 Reply Last reply Reply Quote 0
                      • MathieuRAM Offline
                        MathieuRA Vates 🪐 XO Team @acebmxer
                        last edited by

                        @acebmxer Thanks.
                        So, no issue to compute the dashboard.

                        In your log, I see unexpected 401 responses code.

                        Could you try /rest/v0/schedules and let me know the result? (and any XO-server errors that occur)

                        acebmxerA 1 Reply Last reply Reply Quote 0
                        • acebmxerA Online
                          acebmxer @MathieuRA
                          last edited by

                          @MathieuRA

                          [
                            "/rest/v0/schedules/8cf0dcb7-2122-41c6-8a2c-5c150308b292",
                            "/rest/v0/schedules/22ce7eb8-ea62-4cbd-8e9b-646f99b6896c",
                            "/rest/v0/schedules/f3504435-9e2b-4e43-a4f4-2f70aa51aa30",
                            "/rest/v0/schedules/d5f4478e-4bba-4679-be5b-375f7c9aeb09",
                            "/rest/v0/schedules/77e3804e-2180-458a-969b-d08f44504c3a",
                            "/rest/v0/schedules/aa8ee2fb-6587-4a5f-a7c7-f292f563b43c",
                            "/rest/v0/schedules/70c6cfc3-baa6-4c8f-804b-ba273b14267d",
                            "/rest/v0/schedules/da426cb4-9bc2-46bf-a5c6-268bb67b80ad",
                            "/rest/v0/schedules/b4fa328a-856a-4e00-8e14-7353d45a79e1",
                            "/rest/v0/schedules/5906f9f7-ca8f-4623-954c-744f0615fb55",
                            "/rest/v0/schedules/3059d28e-eaf1-449f-a0d1-fece3712df0c",
                            "/rest/v0/schedules/14b6af3b-5d2f-4bd2-9d80-440c1d773e2a",
                            "/rest/v0/schedules/f45a8928-bf4b-4d36-bfb2-3d96735ef8fd"
                          ]
                          
                          ❯ journalctl -u xo-server -f -n 50
                          May 21 07:20:45 xo-ce xo-server[8974]:   }
                          May 21 07:20:45 xo-ce xo-server[8974]: }
                          May 21 07:20:45 xo-ce xo-server[8974]: 2026-05-21T07:20:45.705Z xo:xapi:xapi-disks INFO export through vhd
                          May 21 07:20:47 xo-ce xo-server[8974]: 2026-05-21T07:20:47.589Z xo:xapi:vdi WARN invalid HTTP header in response body {
                          May 21 07:20:47 xo-ce xo-server[8974]:   body: 'HTTP/1.1 500 Internal Error\r\n' +
                          May 21 07:20:47 xo-ce xo-server[8974]:     'content-length: 318\r\n' +
                          May 21 07:20:47 xo-ce xo-server[8974]:     'content-type: text/html\r\n' +
                          May 21 07:20:47 xo-ce xo-server[8974]:     'connection: close\r\n' +
                          May 21 07:20:47 xo-ce xo-server[8974]:     'cache-control: no-cache, no-store\r\n' +
                          May 21 07:20:47 xo-ce xo-server[8974]:     '\r\n' +
                          May 21 07:20:47 xo-ce xo-server[8974]:     '<html><body><h1>HTTP 500 internal server error</h1>An unexpected error occurred; please wait a while and try again. If the problem persists, please contact your support representative.<h1> Additional information </h1>VDI_INCOMPATIBLE_TYPE: [ OpaqueRef:fdeb8877-741a-d753-988f-34f20417f451; CBT metadata ]</body></html>'
                          May 21 07:20:47 xo-ce xo-server[8974]: }
                          May 21 07:20:47 xo-ce xo-server[8974]: 2026-05-21T07:20:47.598Z xo:xapi:xapi-disks WARN can't compute delta OpaqueRef:e17293bd-788e-1391-4567-4a3b9f2be433 from OpaqueRef:fdeb8877-741a-d753-988f-34f20417f451, fallBack to a full {
                          May 21 07:20:47 xo-ce xo-server[8974]:   error: Error: invalid HTTP header in response body
                          May 21 07:20:47 xo-ce xo-server[8974]:       at checkVdiExport (file:///opt/xen-orchestra/@xen-orchestra/xapi/vdi.mjs:37:19)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async Xapi.exportContent (file:///opt/xen-orchestra/@xen-orchestra/xapi/vdi.mjs:261:5)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async #getExportStream (file:///opt/xen-orchestra/@xen-orchestra/xapi/disks/XapiVhdStreamSource.mjs:123:20)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async XapiVhdStreamSource.init (file:///opt/xen-orchestra/@xen-orchestra/xapi/disks/XapiVhdStreamSource.mjs:135:23)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async #openExportStream (file:///opt/xen-orchestra/@xen-orchestra/xapi/disks/Xapi.mjs:182:7)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async #openNbdStream (file:///opt/xen-orchestra/@xen-orchestra/xapi/disks/Xapi.mjs:97:22)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async XapiDiskSource.openSource (file:///opt/xen-orchestra/@xen-orchestra/xapi/disks/Xapi.mjs:260:18)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async XapiDiskSource.init (file:///opt/xen-orchestra/@xen-orchestra/disk-transform/dist/DiskPassthrough.mjs:28:41)
                          May 21 07:20:47 xo-ce xo-server[8974]:       at async file:///opt/xen-orchestra/@xen-orchestra/backups/_incrementalVm.mjs:66:5
                          May 21 07:20:47 xo-ce xo-server[8974]: }
                          May 21 07:20:47 xo-ce xo-server[8974]: 2026-05-21T07:20:47.600Z xo:xapi:xapi-disks INFO export through vhd
                          May 21 07:33:57 xo-ce xo-server[8974]: 2026-05-21T07:33:57.365Z xo:backups:worker INFO backup has ended
                          May 21 07:33:57 xo-ce xo-server[8974]: 2026-05-21T07:33:57.558Z xo:backups:worker INFO process will exit {
                          May 21 07:33:57 xo-ce xo-server[8974]:   duration: 2036887755,
                          May 21 07:33:57 xo-ce xo-server[8974]:   exitCode: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:   resourceUsage: {
                          May 21 07:33:57 xo-ce xo-server[8974]:     userCPUTime: 2331929487,
                          May 21 07:33:57 xo-ce xo-server[8974]:     systemCPUTime: 555709233,
                          May 21 07:33:57 xo-ce xo-server[8974]:     maxRSS: 273572,
                          May 21 07:33:57 xo-ce xo-server[8974]:     sharedMemorySize: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     unsharedDataSize: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     unsharedStackSize: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     minorPageFault: 11509457,
                          May 21 07:33:57 xo-ce xo-server[8974]:     majorPageFault: 3,
                          May 21 07:33:57 xo-ce xo-server[8974]:     swappedOut: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     fsRead: 21664,
                          May 21 07:33:57 xo-ce xo-server[8974]:     fsWrite: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     ipcSent: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     ipcReceived: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     signalsCount: 0,
                          May 21 07:33:57 xo-ce xo-server[8974]:     voluntaryContextSwitches: 3572469,
                          May 21 07:33:57 xo-ce xo-server[8974]:     involuntaryContextSwitches: 248999
                          May 21 07:33:57 xo-ce xo-server[8974]:   },
                          May 21 07:33:57 xo-ce xo-server[8974]:   summary: { duration: '34m', cpuUsage: '142%', memoryUsage: '267.16 MiB' }
                          May 21 07:33:57 xo-ce xo-server[8974]: }
                          
                          ❯ journalctl -u xo-server
                          May 03 18:14:41 xo-ce systemd[1]: Starting xo-server.service - Xen Orchestra Server...
                          May 03 18:14:41 xo-ce systemd[1]: Started xo-server.service - Xen Orchestra Server.
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.248Z xo:main INFO Starting xo-server v5.200.0 (https://github.com>
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.255Z xo:main INFO Configuration loaded.
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.260Z xo:main INFO Web server listening on http://0.0.0.0:80
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.263Z xo:main INFO Web server listening on https://0.0.0.0:443
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.473Z xo:mixins:hooks WARN start failure {
                          May 03 18:14:43 xo-ce xo-server[6780]:   error: Error: spawn xenstore-read ENOENT
                          May 03 18:14:43 xo-ce xo-server[6780]:       at Process.ChildProcess._handle.onexit (node:internal/child_process:287:19)
                          May 03 18:14:43 xo-ce xo-server[6780]:       at onErrorNT (node:internal/child_process:508:16)
                          May 03 18:14:43 xo-ce xo-server[6780]:       at processTicksAndRejections (node:internal/process/task_queues:90:21) {
                          May 03 18:14:43 xo-ce xo-server[6780]:     errno: -2,
                          May 03 18:14:43 xo-ce xo-server[6780]:     code: 'ENOENT',
                          May 03 18:14:43 xo-ce xo-server[6780]:     syscall: 'spawn xenstore-read',
                          May 03 18:14:43 xo-ce xo-server[6780]:     path: 'xenstore-read',
                          May 03 18:14:43 xo-ce xo-server[6780]:     spawnargs: [ 'vm' ],
                          May 03 18:14:43 xo-ce xo-server[6780]:     cmd: 'xenstore-read vm'
                          May 03 18:14:43 xo-ce xo-server[6780]:   }
                          May 03 18:14:43 xo-ce xo-server[6780]: }
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.478Z xo:mixins:hooks WARN start failure {
                          May 03 18:14:43 xo-ce xo-server[6780]:   error: Error: Command failed with exit code 5: vgchange -an
                          May 03 18:14:43 xo-ce xo-server[6780]:     WARNING: Running as a non-root user. Functionality may be unavailable.
                          May 03 18:14:43 xo-ce xo-server[6780]:     /run/lock/lvm/P_global:aux: open failed: Permission denied
                          May 03 18:14:43 xo-ce xo-server[6780]:       at makeError (file:///opt/xen-orchestra/packages/xo-server/node_modules/execa/l>
                          May 03 18:14:43 xo-ce xo-server[6780]:       at handlePromise (file:///opt/xen-orchestra/packages/xo-server/node_modules/exe>
                          May 03 18:14:43 xo-ce xo-server[6780]:     shortMessage: 'Command failed with exit code 5: vgchange -an',
                          May 03 18:14:43 xo-ce xo-server[6780]:     command: 'vgchange -an',
                          May 03 18:14:43 xo-ce xo-server[6780]:     escapedCommand: 'vgchange -an',
                          May 03 18:14:43 xo-ce xo-server[6780]:     exitCode: 5,
                          May 03 18:14:43 xo-ce xo-server[6780]:     signal: undefined,
                          May 03 18:14:43 xo-ce xo-server[6780]:     signalDescription: undefined,
                          May 03 18:14:43 xo-ce xo-server[6780]:     stdout: '',
                          May 03 18:14:43 xo-ce xo-server[6780]:     stderr: '  WARNING: Running as a non-root user. Functionality may be unavailable.>
                          May 03 18:14:43 xo-ce xo-server[6780]:       '  /run/lock/lvm/P_global:aux: open failed: Permission denied',
                          May 03 18:14:43 xo-ce xo-server[6780]:     cwd: '/opt/xen-orchestra/packages/xo-server',
                          May 03 18:14:43 xo-ce xo-server[6780]:     failed: true,
                          May 03 18:14:43 xo-ce xo-server[6780]:     timedOut: false,
                          May 03 18:14:43 xo-ce xo-server[6780]:     isCanceled: false,
                          May 03 18:14:43 xo-ce xo-server[6780]:     killed: false
                          May 03 18:14:43 xo-ce xo-server[6780]:   }
                          May 03 18:14:43 xo-ce xo-server[6780]: }
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.556Z xo:xo-mixins:subjects INFO Default user created: admin@admin>
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.565Z xo:main INFO Setting up /robots.txt → /opt/xen-orchestra/pac>
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.616Z xo:plugin INFO register audit
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.618Z xo:plugin INFO register auth-github
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.619Z xo:plugin INFO register auth-google
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.620Z xo:plugin INFO register auth-ldap
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.621Z xo:plugin INFO register auth-oidc
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.621Z xo:plugin INFO register auth-saml
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.622Z xo:plugin INFO register backup-reports
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.623Z xo:plugin INFO register load-balancer
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.623Z xo:plugin INFO register netbox
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.624Z xo:plugin INFO register openmetrics
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.625Z xo:plugin INFO register perf-alert
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.626Z xo:plugin INFO register sdn-controller
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.627Z xo:plugin INFO register test-plugin
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.628Z xo:plugin INFO register transport-email
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.628Z xo:plugin INFO register transport-icinga2
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.629Z xo:plugin INFO register transport-nagios
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.629Z xo:plugin INFO register transport-slack
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.630Z xo:plugin INFO register transport-xmpp
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.630Z xo:plugin INFO register usage-report
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.631Z xo:plugin INFO register web-hooks
                          May 03 18:14:43 xo-ce xo-server[6780]: 2026-05-03T18:14:43.998Z xo:xo-server-openmetrics INFO Plugin initialized
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin auth-gith>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin audit for>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin auth-oidc>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin auth-goog>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin auth-ldap>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin auth-saml>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin load-bala>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin netbox fo>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin perf-aler>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin sdn-contr>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin backup-re>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin test-plug>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin transport>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin transport>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin transport>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin transport>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin transport>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin web-hooks>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin usage-rep>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.012Z xo:xo-mixins:plugins INFO [NOTICE] register plugin openmetri>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.027Z xo:plugin INFO successfully register auth-github
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.027Z xo:plugin INFO successfully register auth-oidc
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.027Z xo:plugin INFO successfully register auth-google
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.027Z xo:plugin INFO successfully register auth-ldap
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.027Z xo:plugin INFO successfully register auth-saml
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.027Z xo:plugin INFO successfully register load-balancer
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.040Z xo:plugin INFO successfully register audit
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register netbox
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register test-plugin
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register transport-nagios
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register transport-email
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register transport-icinga2
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register transport-slack
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register transport-xmpp
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register web-hooks
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:plugin INFO successfully register usage-report
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.056Z xo:xo-server-openmetrics INFO Starting OpenMetrics server { >
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.062Z xo:plugin INFO successfully register backup-reports
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.062Z xo:plugin INFO successfully register perf-alert
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.142Z xo:plugin INFO successfully register openmetrics
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.480Z xo:plugin INFO successfully register sdn-controller
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.481Z xo:main INFO Setting up /v5 → /opt/xen-orchestra/packages/xo>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.481Z xo:main INFO Setting up /v6 → /opt/xen-orchestra/@xen-orches>
                          May 03 18:14:44 xo-ce xo-server[6780]: 2026-05-03T18:14:44.481Z xo:main INFO Setting up / → /opt/xen-orchestra/@xen-orchestr>
                          May 03 18:15:16 xo-ce xo-server[6780]: (node:6780) [DEP0060] DeprecationWarning: The `util._extend` API is deprecated. Pleas>
                          May 03 18:15:16 xo-ce xo-server[6780]: (Use `node --trace-deprecation ...` to show where the warning was created)
                          May 03 18:15:16 xo-ce xo-server[6780]: 2026-05-03T18:15:16.063Z xo:xo-server WARN Node warning {
                          May 03 18:15:16 xo-ce xo-server[6780]:   error: DeprecationWarning: The `util._extend` API is deprecated. Please use Object.>
                          May 03 18:15:16 xo-ce xo-server[6780]:       at ProxyServer.ws (/opt/xen-orchestra/node_modules/http-proxy/lib/http-proxy/in>
                          May 03 18:15:16 xo-ce xo-server[6780]:       at app.<anonymous> (file:///opt/xen-orchestra/packages/xo-server/src/index.mjs:>
                          May 03 18:15:16 xo-ce xo-server[6780]:       at app.emit (node:events:509:28)
                          May 03 18:15:16 xo-ce xo-server[6780]:       at app.emit (/opt/xen-orchestra/@xen-orchestra/log/configure.js:52:17)
                          May 03 18:15:16 xo-ce xo-server[6780]:       at Server.<anonymous> (file:///opt/xen-orchestra/packages/xo-server/src/index.m>
                          May 03 18:15:16 xo-ce xo-server[6780]:       at Server.emit (node:events:521:24)
                          May 03 18:15:16 xo-ce xo-server[6780]:       at Server.patchedEmit [as emit] (/opt/xen-orchestra/@xen-orchestra/log/configur>
                          May 03 18:15:16 xo-ce xo-server[6780]:       at onParserExecuteCommon (node:_http_server:987:14)
                          May 03 18:15:16 xo-ce xo-server[6780]:       at onParserExecute (node:_http_server:891:3) {
                          May 03 18:15:16 xo-ce xo-server[6780]:     code: 'DEP0060'
                          May 03 18:15:16 xo-ce xo-server[6780]:   }
                          May 03 18:15:16 xo-ce xo-server[6780]: }
                          May 03 18:15:30 xo-ce xo-server[6780]: 2026-05-03T18:15:30.553Z xo:rest-api:listener ERROR cannot handle data for task liste>
                          May 03 18:15:30 xo-ce xo-server[6780]:   error: XoError: no such user a7eed653-d733-4909-99b6-88afb4baf6c4
                          May 03 18:15:30 xo-ce xo-server[6780]:       at noSuchObject (/opt/xen-orchestra/packages/xo-common/api-errors.js:26:11)
                          May 03 18:15:30 xo-ce xo-server[6780]:       at default._getUser (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixins>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at default.getUser (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixins/>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at XoListener.getAclEvent (file:///opt/xen-orchestra/@xen-orchestra/rest-api/di>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at XoListener.handleData (file:///opt/xen-orchestra/@xen-orchestra/rest-api/dis>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at file:///opt/xen-orchestra/@xen-orchestra/rest-api/dist/abstract-classes/list>
                          May 03 18:15:30 xo-ce xo-server[6780]:     code: 1,
                          May 03 18:15:30 xo-ce xo-server[6780]:     data: { id: 'a7eed653-d733-4909-99b6-88afb4baf6c4', type: 'user' }
                          May 03 18:15:30 xo-ce xo-server[6780]:   }
                          May 03 18:15:30 xo-ce xo-server[6780]: }
                          May 03 18:15:30 xo-ce xo-server[6780]: 2026-05-03T18:15:30.553Z xo:rest-api:listener ERROR cannot handle data for task liste>
                          May 03 18:15:30 xo-ce xo-server[6780]:   error: XoError: no such user a7eed653-d733-4909-99b6-88afb4baf6c4
                          May 03 18:15:30 xo-ce xo-server[6780]:       at noSuchObject (/opt/xen-orchestra/packages/xo-common/api-errors.js:26:11)
                          May 03 18:15:30 xo-ce xo-server[6780]:       at default._getUser (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixins>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at default.getUser (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixins/>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at XoListener.getAclEvent (file:///opt/xen-orchestra/@xen-orchestra/rest-api/di>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at XoListener.handleData (file:///opt/xen-orchestra/@xen-orchestra/rest-api/dis>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at file:///opt/xen-orchestra/@xen-orchestra/rest-api/dist/abstract-classes/list>
                          May 03 18:15:30 xo-ce xo-server[6780]:     code: 1,
                          May 03 18:15:30 xo-ce xo-server[6780]:     data: { id: 'a7eed653-d733-4909-99b6-88afb4baf6c4', type: 'user' }
                          May 03 18:15:30 xo-ce xo-server[6780]:   }
                          May 03 18:15:30 xo-ce xo-server[6780]: }
                          May 03 18:15:30 xo-ce xo-server[6780]: 2026-05-03T18:15:30.557Z xo:authentification ERROR no such user a7eed653-d733-4909-99>
                          May 03 18:15:30 xo-ce xo-server[6780]:   error: XoError: no such user a7eed653-d733-4909-99b6-88afb4baf6c4
                          May 03 18:15:30 xo-ce xo-server[6780]:       at noSuchObject (/opt/xen-orchestra/packages/xo-common/api-errors.js:26:11)
                          May 03 18:15:30 xo-ce xo-server[6780]:       at default._getUser (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixins>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at default.getUser (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixins/>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at default._authenticateUser (file:///opt/xen-orchestra/packages/xo-server/src/>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at auth (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixins/authenticat>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at Task.runInside (/opt/xen-orchestra/@vates/task/index.js:204:22)
                          May 03 18:15:30 xo-ce xo-server[6780]:       at Task.run (/opt/xen-orchestra/@vates/task/index.js:188:20)
                          May 03 18:15:30 xo-ce xo-server[6780]:       at Xo.signIn (file:///opt/xen-orchestra/packages/xo-server/src/api/session.mjs:>
                          May 03 18:15:30 xo-ce xo-server[6780]:       at Task.runInside (/opt/xen-orchestra/@vates/task/index.js:204:22)
                          May 03 18:15:30 xo-ce xo-server[6780]:       at Task.run (/opt/xen-orchestra/@vates/task/index.js:188:20)
                          May 03 18:15:30 xo-ce xo-server[6780]:       at Api.#callApiMethod (file:///opt/xen-orchestra/packages/xo-server/src/xo-mixi>
                          May 03 18:15:30 xo-ce xo-server[6780]:     code: 1,
                          May 03 18:15:30 xo-ce xo-server[6780]:     data: { id: 'a7eed653-d733-4909-99b6-88afb4baf6c4', type: 'user' }
                          May 03 18:15:30 xo-ce xo-server[6780]:   }
                          May 03 18:15:30 xo-ce xo-server[6780]: }
                          May 03 18:15:30 xo-ce xo-server[6780]: 2026-05-03T18:15:30.560Z xo:api WARN (unknown user) | session.signIn(...) [8ms] =!> X>
                          May 03 18:15:53 xo-ce sudo[6982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=999)
                          May 03 18:15:53 xo-ce sudo[6982]: xo-service :  PWD=/opt/xen-orchestra/packages/xo-server ; USER=root ; COMMAND=/usr/bin/mou>
                          May 03 18:15:53 xo-ce sudo[6984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=999)
                          May 03 18:15:53 xo-ce sudo[6984]: xo-service :  PWD=/opt/xen-orchestra/packages/xo-server ; USER=root ; COMMAND=/usr/bin/mou>
                          May 03 18:15:54 xo-ce sudo[6984]: pam_unix(sudo:session): session closed for user root
                          May 03 18:15:54 xo-ce sudo[6982]: pam_unix(sudo:session): session closed for user root
                          May 03 18:16:45 xo-ce xo-server[6780]: 2026-05-03T18:16:45.301Z xo:main INFO + Console proxy (nick - 127.0.0.1)
                          May 03 18:16:47 xo-ce xo-server[6780]: 2026-05-03T18:16:47.299Z xo:main INFO - Console proxy (nick - 127.0.0.1)
                          May 03 23:04:20 xo-ce xo-server[6780]: 2026-05-03T23:04:20.943Z xo:api WARN nick | token.create(...) [1ms] =!> Error: too hi>
                          May 03 23:04:38 xo-ce xo-server[6780]: 2026-05-03T23:04:38.359Z xo:api WARN nick | token.create(...) [1ms] =!> Error: too hi>
                          May 03 23:04:52 xo-ce xo-server[6780]: 2026-05-03T23:04:52.662Z xo:api WARN nick | token.create(...) [1ms] =!> Error: too hi>
                          May 03 23:05:19 xo-ce xo-server[6780]: 2026-05-03T23:05:19.432Z xo:api WARN nick | token.create(...) [1ms] =!> Error: too hi>
                          May 03 23:34:52 xo-ce xo-server[6780]: 2026-05-03T23:34:52.293Z xo:main INFO + Console proxy (nick - 127.0.0.1)
                          May 03 23:36:04 xo-ce xo-server[6780]: 2026-05-03T23:36:04.989Z xo:main INFO - Console proxy (nick - 127.0.0.1)
                          May 04 04:08:33 xo-ce xo-server[8919]: 2026-05-04T04:08:33.617Z xo:backups:worker INFO starting backup
                          May 04 04:08:33 xo-ce sudo[8932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=999)
                          May 04 04:08:33 xo-ce sudo[8932]: xo-service :  PWD=/opt/xen-orchestra/packages/xo-server ; USER=root ; COMMAND=/usr/bin/mou>
                          May 04 04:08:33 xo-ce sudo[8932]: pam_unix(sudo:session): session closed for user root
                          May 04 04:08:36 xo-ce xo-server[8919]: 2026-05-04T04:08:36.432Z xo:xapi:xapi-disks INFO export through vhd
                          May 04 04:08:37 xo-ce xo-server[8919]: 2026-05-04T04:08:37.874Z xo:xapi:xapi-disks INFO export through vhd
                          May 04 04:12:16 xo-ce xo-server[8919]: 2026-05-04T04:12:16.797Z xo:xapi:xapi-disks INFO export through vhd
                          May 04 04:37:10 xo-ce xo-server[8919]: 2026-05-04T04:37:10.906Z xo:xapi:xapi-disks INFO export through vhd
                          May 04 04:46:44 xo-ce xo-server[8919]: {
                          May 04 04:46:44 xo-ce xo-server[8919]:   err: [Error: Unknown system error -122: Unknown system error -122, write] {
                          May 04 04:46:44 xo-ce xo-server[8919]:     errno: -122,
                          May 04 04:46:44 xo-ce xo-server[8919]:     code: 'Unknown system error -122',
                          May 04 04:46:44 xo-ce xo-server[8919]:     syscall: 'write'
                          May 04 04:46:44 xo-ce xo-server[8919]:   }
                          May 04 04:46:44 xo-ce xo-server[8919]: }
                          May 04 04:46:44 xo-ce xo-server[8919]: 2026-05-04T04:46:44.907Z xo:backups:AbstractVmRunner WARN writer step failed {
                          May 04 04:46:44 xo-ce xo-server[8919]:   error: Error: ENOENT: no such file or directory, open '/run/xo-server/mounts/3ba9ee>
                          May 04 04:46:44 xo-ce xo-server[8919]:   From:
                          May 04 04:46:44 xo-ce xo-server[8919]:       at NfsHandler.addSyncStackTrace (/opt/xen-orchestra/@xen-orchestra/fs/dist/loca>
                          May 04 04:46:44 xo-ce xo-server[8919]:       at NfsHandler._openFile (/opt/xen-orchestra/@xen-orchestra/fs/dist/local.js:154>
                          May 04 04:46:44 xo-ce xo-server[8919]:       at /opt/xen-orchestra/@xen-orchestra/fs/dist/utils.js:29:26
                          May 04 04:46:44 xo-ce xo-server[8919]:       at new Promise (<anonymous>)
                          May 04 04:46:44 xo-ce xo-server[8919]:       at NfsHandler.<anonymous> (/opt/xen-orchestra/@xen-orchestra/fs/dist/utils.js:2>
                          May 04 04:46:44 xo-ce xo-server[8919]:       at loopResolver (/opt/xen-orchestra/node_modules/promise-toolbox/retry.js:83:46)
                          May 04 04:46:44 xo-ce xo-server[8919]:       at new Promise (<anonymous>)
                          May 04 04:46:44 xo-ce xo-server[8919]:       at loop (/opt/xen-orchestra/node_modules/promise-toolbox/retry.js:85:22)
                          May 04 04:46:44 xo-ce xo-server[8919]:       at NfsHandler.retry (/opt/xen-orchestra/node_modules/promise-toolbox/retry.js:8>
                          May 04 04:46:44 xo-ce xo-server[8919]:       at NfsHandler._openFile (/opt/xen-orchestra/node_modules/promise-toolbox/retry.>
                          May 04 04:46:44 xo-ce xo-server[8919]:     errno: -2,
                          May 04 04:46:44 xo-ce xo-server[8919]:     code: 'ENOENT',
                          May 04 04:46:44 xo-ce xo-server[8919]:     syscall: 'open',
                          May 04 04:46:44 xo-ce xo-server[8919]:     path: '/run/xo-server/mounts/3ba9eed2-55f1-4760-ac08-655c252aa316/xo-vm-backups/f>
                          May 04 04:46:44 xo-ce xo-server[8919]:   },
                          May 04 04:46:44 xo-ce xo-server[8919]:   step: 'writer.updateUuidAndChain()',
                          May 04 04:46:44 xo-ce xo-server[8919]:   writer: 'IncrementalRemoteWriter'
                          May 04 04:46:44 xo-ce xo-server[8919]: }
                          May 04 04:46:51 xo-ce xo-server[8919]: 2026-05-04T04:46:51.605Z xo:xapi:xapi-disks INFO export through vhd
                          May 04 04:46:51 xo-ce xo-server[8919]: 2026-05-04T04:46:51.606Z xo:xapi:xapi-disks INFO export through vhd
                          May 04 04:46:53 xo-ce xo-server[8919]: {
                          May 04 04:46:53 xo-ce xo-server[8919]:   err: [Error: Unknown system error -122: Unknown system error -122, write] {
                          May 04 04:46:53 xo-ce xo-server[8919]:     errno: -122,
                          May 04 04:46:53 xo-ce xo-server[8919]:     code: 'Unknown system error -122',
                          May 04 04:46:53 xo-ce xo-server[8919]:     syscall: 'write'
                          May 04 04:46:53 xo-ce xo-server[8919]:   }
                          May 04 04:46:53 xo-ce xo-server[8919]: }
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.434Z vates:nbd-client WARN will retry reading block  13
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  14
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  15
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  16
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  17
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  18
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  19
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  20
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z vates:nbd-client WARN will retry reading block  21
                          May 04 04:46:53 xo-ce xo-server[8919]: 2026-05-04T04:46:53.435Z xo:backups:AbstractVmRunner WARN writer step failed {
                          May 04 04:46:53 xo-ce xo-server[8919]:   error: Error: ENOENT: no such file or directory, open '/run/xo-server/mounts/3ba9ee>
                          May 04 04:46:53 xo-ce xo-server[8919]:   From:
                          May 04 04:46:53 xo-ce xo-server[8919]:       at NfsHandler.addSyncStackTrace (/opt/xen-orchestra/@xen-orchestra/fs/dist/loca>
                          May 04 04:46:53 xo-ce xo-server[8919]:       at NfsHandler._openFile (/opt/xen-orchestra/@xen-orchestra/fs/dist/local.js:154>
                          May 04 04:46:53 xo-ce xo-server[8919]:       at /opt/xen-orchestra/@xen-orchestra/fs/dist/utils.js:29:26
                          May 04 04:46:53 xo-ce xo-server[8919]:       at new Promise (<anonymous>)
                          May 04 04:46:53 xo-ce xo-server[8919]:       at NfsHandler.<anonymous> (/opt/xen-orchestra/@xen-orchestra/fs/dist/utils.js:2>
                          May 04 04:46:53 xo-ce xo-server[8919]:       at loopResolver (/opt/xen-orchestra/node_modules/promise-toolbox/retry.js:83:46)
                          May 04 04:46:53 xo-ce xo-server[8919]:       at new Promise (<anonymous>)
                          May 04 04:46:53 xo-ce xo-server[8919]:       at loop (/opt/xen-orchestra/node_modules/promise-toolbox/retry.js:85:22)
                          May 04 04:46:53 xo-ce xo-server[8919]:       at NfsHandler.retry (/opt/xen-orchestra/node_modules/promise-toolbox/retry.js:8>
                          May 04 04:46:53 xo-ce xo-server[8919]:       at NfsHandler._openFile (/opt/xen-orchestra/node_modules/promise-toolbox/retry.>
                          May 04 04:46:53 xo-ce xo-server[8919]:     errno: -2,
                          May 04 04:46:53 xo-ce xo-server[8919]:     code: 'ENOENT',
                          May 04 04:46:53 xo-ce xo-server[8919]:     syscall: 'open',
                          May 04 04:46:53 xo-ce xo-server[8919]:     path: '/run/xo-server/mounts/3ba9eed2-55f1-4760-ac08-655c252aa316/xo-vm-backups/4>
                          May 04 04:46:53 xo-ce xo-server[8919]:   },
                          May 04 04:46:53 xo-ce xo-server[8919]:   step: 'writer.updateUuidAndChain()',
                          May 04 04:46:53 xo-ce xo-server[8919]:   writer: 'IncrementalRemoteWriter'
                          May 04 04:46:53 xo-ce xo-server[8919]: }
                          May 04 04:46:58 xo-ce xo-server[8919]: 2026-05-04T04:46:58.298Z xo:xapi WARN retry {
                          May 04 04:46:58 xo-ce xo-server[8919]:   attemptNumber: 0,
                          May 04 04:46:58 xo-ce xo-server[8919]:   delay: 5000,
                          May 04 04:46:58 xo-ce xo-server[8919]:   error: XapiError: VDI_IN_USE(OpaqueRef:50dc4331-ae9e-5cfe-fbb0-d5f60e311ee6, data_d>
                          May 04 04:46:58 xo-ce xo-server[8919]:       at XapiError.wrap (file:///opt/xen-orchestra/packages/xen-api/_XapiError.mjs:16>
                          
                          
                          
                          1 Reply Last reply Reply Quote 0

                          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                          With your input, this post could be even better 💗

                          Register Login
                          • First post
                            Last post