XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Install XO from sources.

    Scheduled Pinned Locked Moved Xen Orchestra
    27 Posts 9 Posters 3.6k Views 8 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • G Offline
      Greg_E @acebmxer
      last edited by

      @acebmxer

      I haven't tried this yet, but liking the menu you just showed!

      1 Reply Last reply Reply Quote 0
      • AlexanderKA Offline
        AlexanderK
        last edited by

        which is the difference with this?
        https://github.com/ronivay/XenOrchestraInstallerUpdater

        Using the above around 5-6 years with no issues at all

        acebmxerA VertuxV 2 Replies Last reply Reply Quote 0
        • acebmxerA Online
          acebmxer @AlexanderK
          last edited by acebmxer

          @AlexanderK

          I just wanted my own script to install Xen Orchestra from sources with a few additional features not found in Ranivays script. Mine is built completely from scratch but with inspiration form his script.

          If you wanted to give my script a try I would appropriate any feedback to any improvements. I would suggest creating a new vm as i have not test my script against an installation done by Ronivays script.

          AlexanderKA 1 Reply Last reply Reply Quote 0
          • AlexanderKA Offline
            AlexanderK @acebmxer
            last edited by

            @acebmxer
            what have you added? what are the differences?
            i will definetely try it.

            acebmxerA 1 Reply Last reply Reply Quote 0
            • acebmxerA Online
              acebmxer @AlexanderK
              last edited by acebmxer

              @AlexanderK
              The inter-active menu, The menu will show the running script commit against main commit along with showing Xen Orchestra installed commit vs master commit. The script should automatically self-update to latest version.

              Just to name a few...

              AlexanderKA 1 Reply Last reply Reply Quote 0
              • AlexanderKA Offline
                AlexanderK @acebmxer
                last edited by

                @acebmxer i think that only the menu. the "old" script also auto updates....

                G 1 Reply Last reply Reply Quote 0
                • G Offline
                  Greg_E @AlexanderK
                  last edited by

                  @AlexanderK

                  The ronivay script requires you to select an option (#2 to update).

                  I look at things this way, it's good to have more people working on scripts like this.

                  1 Reply Last reply Reply Quote 0
                  • F Offline
                    fatek
                    last edited by

                    Very nice job @acebmxer
                    Well done

                    1 Reply Last reply Reply Quote 1
                    • VertuxV Offline
                      Vertux @AlexanderK
                      last edited by

                      @AlexanderK said:

                      which is the difference with this?
                      https://github.com/ronivay/XenOrchestraInstallerUpdater

                      Using the above around 5-6 years with no issues at all

                      e.g. XenOrchestraInstallerUpdater does not support Debian 13 yet.

                      1 Reply Last reply Reply Quote 0
                      • acebmxerA Online
                        acebmxer
                        last edited by acebmxer

                        Made some updates to this project. Any existing users please see note. I have also updated the initial post.

                        ⚠️ Upgrading from an earlier version of this script? Read this first.
                        This version bumps the config schema to v2 (adds PUBLIC_URL and ENCRYPT_REDIS_CREDENTIALS) and corrects two config.toml generation bugs. Your xo-config.cfg is migrated automatically and non-destructively, but the corrected /etc/xo-server/config.toml is only written by --reconfigure.

                        Run --reconfigure once before resuming normal updates:

                        ./install-xen-orchestra.sh --reconfigure
                        This regenerates config.toml with the fixes (your old file is backed up first; data in /var/lib/xo-server is untouched). It is strongly recommended if you set both REDIRECT_TO_HTTPS=true and REVERSE_PROXY_TRUST — that combination previously produced a duplicate [http] section and silently dropped one of the settings.

                        Afterwards, run --update as normal for routine XO updates — --update does not need to be preceded by --reconfigure again.

                        Also added option to adjust Xen Orchestras memory allocation. Useful if you are getting out of memory errors or added more memory to XO.

                        Update - Previous info was incorrect. I have removed and updated.
                        On fresh install Debian 13 with 8gb ram node -v 24.15.0.

                        ==============================================
                          Xen Orchestra Memory Allocation
                        ==============================================
                        
                          Setting                       Value
                          ----------------------------- -----------------------------------
                          Total system RAM              7943 MB
                          Current xo-server heap limit  ~2240 MB (node default, no --max-old-space-size set)
                          Recommended heap limit        7431 MB
                        
                        poddingueP 1 Reply Last reply Reply Quote 0
                        • poddingueP Offline
                          poddingue Vates 🪐 @acebmxer
                          last edited by poddingue

                          This is a nice bit of community tooling, and thanks for keeping it updated and being upfront about the "use at your own risk" part. 👍
                          On the naming point a few people raised, I think the distinction folks are drawing is fair: XOA is the Vates-built appliance, and anything you compile yourself is XO from sources. 🤷
                          The official docs cover that path at https://docs.xen-orchestra.com/xo5/installation#from-the-sources, including the note that there is no pro support for that method.
                          Hope the project keeps going well!

                          1 Reply Last reply Reply Quote 1
                          • acebmxerA acebmxer referenced this topic
                          • acebmxerA Online
                            acebmxer
                            last edited by

                            While looking into the following issue - https://xcp-ng.org/forum/topic/11976/trying-to-enable-v2v-and-difficulty-adding-nbdinfo-on-xo-6/10

                            I found a few issues with my install script... Looking for recommendations on the fix approach.

                            I am noticing that are some confusion or inconsistencies with the documentation. Areas it suggest to use root and/or a non root account. Part of these issues would not be if the account used was root or with root access.

                            The two failures
                            Reason 1 — privileges (SERVICE_USER=xo-service, non-root):
                            XO's button runs apt-get install ..., make install, and ldconfig with no sudo (confirmed in esxi.mjs source). As xo-service, those commands are permission-denied: it can't apt-install, can't write to /usr/local/..., can't run ldconfig. XO's own dependency checker even says V2V requires root (UID 0) — which is why your sample-xo-config.cfg:56 already warns "V2V import requires root."

                            So yes — your instinct is correct. With SERVICE_USER=xo-service, the button cannot succeed no matter what.

                            But Reason 2 — build tools absent:
                            Even if you set SERVICE_USER=root and click the button, it will then try apt-get install -y git dh-autoreconf pkg-config make libxml2-dev ocaml libc-bin and compile from GitLab. That will work if the box has internet and apt is healthy — but it's a multi-minute source compile pulling ~hundreds of MB (ocaml!) every time, done live inside the web request. Pre-staging those packages via the installer makes the button fast and reliable instead of a long live compile.

                            So, is the fix "just set SERVICE_USER=root"?
                            To make the button function: yes, that is the necessary fix. Pre-installing build deps is an optional reliability/speed improvement on top.

                            Given your answers, here's my refined proposal — minimal, docs-aligned:

                            Proposed changes

                            1. Add INSTALL_V2V_DEPS=false opt-in to sample-xo-config.cfg. When true, the installer pre-stages XO's exact build-dep list (git dh-autoreconf pkg-config make libxml2-dev ocaml libc-bin) on apt systems only, so the button compiles quickly instead of installing them live. Default false → no ocaml bloat on normal installs.

                            2. Root guard (your "Warn only" preference): When INSTALL_V2V_DEPS=true and SERVICE_USER is non-root, print a prominent warning:

                            "VMware V2V import requires xo-server to run as root (per XO docs). The in-XO 'install nbdinfo' button runs apt-get/make install without sudo and will fail as user '$SERVICE_USER'. Set SERVICE_USER=root to use V2V import."
                            …and continue (don't abort).

                            1. RHEL/dnf: if INSTALL_V2V_DEPS=true on a non-apt system, log "VMware V2V import is only officially supported on Debian 12/13 per XO docs — skipping V2V dependency setup." and do nothing.

                            2. Keep the existing /usr/local/lib/vddk dir creation (it's correct — XO untars VDDK there), and don't touch APT contrib/multiverse or pre-compile nbdkit (XO compiles from source itself; distro packages are never used by the button).

                            3. Docs: README row for INSTALL_V2V_DEPS + a sharpened note in sample-config that V2V needs SERVICE_USER=root, linking the official guide.

                            This stays strictly within what XO's own code does, scopes the heavy deps behind opt-in, and surfaces the real root-user requirement you correctly identified.

                            Shall I implement this? If yes, I'll make the edits and run shellcheck/bats afterward to verify nothing breaks. (I have not edited anything yet.)

                            Prior to looking into this issue. I was trying to work on switching from standard user to root but that broke alot of things and will need rework. Dont belive it would be an issue if root was used to initially deploy xo.

                            1 Reply Last reply Reply Quote 0
                            • acebmxerA Online
                              acebmxer
                              last edited by

                              After building new xo with root and more testing, I have come to this conclusion...

                              Both things are true, and they're in tension
                              The official docs prefer non-root for the long-running service — that's a least-privilege hardening recommendation for the daemon. Normal XO (UI, backups, hosts, VMs, NFS/CIFS remotes) works fine non-root.
                              But several XO features assume root anyway. The ESXi/VMware import "install from source" buttons are hard-coded to refuse unless id -u == 0. You already hit this same pattern once before — the credential-encryption/XenStore work (commit 5e8b7fd) existed precisely because non-root broke that too.
                              So "everything fails non-root" isn't quite it — what fails is the specific subset of features XO wrote assuming it runs as root. Each one needs a separate workaround. The import button is one that cannot be worked around for a non-root process: it's a uid check on the running daemon, full stop.

                              The honest trade-off
                              You can pick at most two of these three:

                              Service runs non-root (docs' preference)
                              In-app "install nbd from source" button works
                              Script doesn't pre-install packages
                              The button (#2) requires the daemon to be uid 0. So:

                              Want the button to work → run that box as SERVICE_USER=root. Simplest, everything XO ships just works, zero manual steps. You give up the non-root hardening.
                              Want to stay non-root → the button is permanently dead; the only way to get import working is the binaries being placed by root once (script or by hand). The binaries run fine as non-root — only their installation needs root.
                              My recommendation
                              Use SERVICE_USER=root on this box. XO's own codebase keeps assuming root (import, and you already saw it with encryption/XenStore), so non-root is a recurring fight against upstream for marginal hardening. Root is fully supported, it's what the official XO appliance ships, and it makes the buttons you want work with no manual package steps. Keep non-root only if hardening that box is a hard requirement and you're fine never using the in-app import installer.

                              1 Reply Last reply Reply Quote 0

                              Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                              Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                              With your input, this post could be even better 💗

                              Register Login
                              • First post
                                Last post