Subcategories

  • VMs, hosts, pools, networks and all other usual management tasks.

    486 Topics
    4k Posts
    tjkreidlT
    @coolsport00 Sorry about the VMW need for the Cisco product. SOunds like you have a number of constraints, finances being I'm sure one of them! At least you have time on your hands and the means to experiment. You may, als, end up with a number of different platforms to meet your needs. We ran both Sun Microsystems and Red Hat Linux and Microsoft WIndows servers, each taking on specific duties. It's far from ideal and probably not very cost-effective, but you do what you have to to get stuff to work.
  • ACLs, Self-service, Cloud-init, Load balancing...

    106 Topics
    869 Posts
    T
    @mpiton Thanks for looking into this, I guess it wasn't apparent that I needed to click the Save Configuration button for that plugin. I did that and confirmed that the secret now survives an xo-server restart. Thanks again!
  • All XO backup features: full and incremental, replication, mirrors...

    529 Topics
    6k Posts
    acebmxerA
    I have received a very long update back from Veeam on my backup issues.... There appears to be another user with similar setup / issue not sure if that user is the OP this post specifically... Hello, Thank you for your patience. The QA team has finished the analysis, and I am going to outline the details as below: 1. CBT Inconsistency Issue Whenever you see the Warning about CBT showing: 2026-08-16 17:37:27.459 00079 ERROR | [XenRpcClient]: Failed ListChangedBlocks. Error: [Task 291af3d7-28c1-15a9-7f13-c6a1a12283e9 (Async.VDI.list_changed_blocks) failed: . SR_BACKEND_FAILURE_460. . Failed to calculate changed blocks for given VDIs. [opterr=Source and target VDI are unrelated]. We can go to the previous run and see that we get reports that the CBT of the previous snapshot is inconsistent and thus removed by XCP: 2026-08-16 09:54:34.120 00004 ERROR | [XenBackupManager]: Failed to retain the data for the snapshot 5a17fb31-2616-4e72-a85c-e235883c8c91 Veeam.Vbf.Common.Exceptions.ExceptionWithDetail: [Task 39c0f25f-e811-ee45-1b0b-e4a9ca9839ae (Async.VDI.data_destroy) failed: . VDI_NO_CBT_METADATA. OpaqueRef:a005d328-6da0-b8b7-34ef-0607ed44c2ed The team has been reviewing and testing, and this is what they see. We send the request for the snapshot to be created, and it is sent to the coordinator: xcp-ng-vyadytkn Aug 16 09:50:08 xcp-ng-vyadytkn SM: [1555017][MainThread] vdi_clone: introduced VDI: OpaqueRef:a005d328-6da0-b8b7-34ef-0607ed44c2ed (5a17fb31-2616-4e72-a85c-e235883c8c91) CBT shows as open and reading fine: Aug 16 09:50:08 xcp-ng-vyadytkn SM: [1555017][MainThread] ['/usr/sbin/cbt-util', 'set', '-n', '/var/run/sr-mount/7911c9c5-5f20-01e1-8b8d-39c6a98a2704/5a17fb31-2616-4e72-a85c-e235883c8c91.cbtlog', '-f', '1'] Aug 16 09:50:08 xcp-ng-vyadytkn SM: [1555017][MainThread] pread SUCCESS But look at how on xcp-ng-host2 the CBT gets marked as inconsistent by XCP, even though it's open and reading: Aug 16 09:51:05 xcp-ng-host2 SM: [1683689][MainThread] Changed Block Tracking metadata is inconsistent for disk 5a17fb31-2616-4e72-a85c-e235883c8c91. The Breakdown: xcp-ng-vyadytkn was the coordinator—the one we talk to, who then passes everything around to the hosts. xcp-ng-host2 was the host that the VM resided on at that time. xcp-ng-host2 is marking the CBT as inconsistent and deleting the snapshot CBT log, which means we cannot reference it on the next run. We do not see anything else interacting with the CBT besides that host. This matches exactly what we see with another client running the same setup. The team successfully replicated the environment, which is configured as follows: VM storage is NFS. The VM is running on a host that is not the coordinator. They have been able to reproduce this behavior occasionally, and the working theory is that the VM host keeps its own tracking separate from the coordinator. Part of the backup process requires the VM host to issue a pause/resume via a process called tapdisk. When it resumes, it pushes a data cache (likely inside the NFS cache), overwriting the CBT reference held by the coordinator server. It acts as a race condition—whoever pushes the CBT data last wins. If the VM host pushes last, it breaks what the coordinator is sending. Next Steps for CBT: The team is working to raise this issue directly with Vates so they can address the race condition. We ask that you also open a Vates ticket if possible to help draw more attention to the bug. We are trying to find ways to code around this race condition in the future, but there are currently no ETAs or guarantees. 2. Synthetic Full Failures (Delilah_ArcFS01) In addition to the CBT bug, the team discovered a separate issue. Recently, the synthetic fulls for Delilah_ArcFS01 have been failing. This appears to be related to the NFS repository: [30.08.2026 00:43:22.856] <24> [0007] Error (1) Failed to execute full transform task [30.08.2026 00:43:22.856] <24> [0007] Error (1) Agent: Failed to process method {Transform.CompileFIB}: NfsFileEx was already stopped. File: [Host:, Mount: [/volume1/veeam], Disk: [Delilah ArcFS01 Backup/Delilah ArcFS01 Backup_2026-08-29T232336.vib], Type: [nfs3 (1)]] (Veeam.Backup.Common.CCppComponentException) [30.08.2026 00:43:22.856] <24> [0007] Error (1) in c++: Failed to execute command Command: READ, Offset: 2523136, Data size: 659456, Chunk size: 131072 [30.08.2026 00:43:22.856] <24> [0007] Error (1) in c++: Failed to read file: Offset: 2523136, Block size: 659456, File: Path: [Host:, Mount: [/volume1/veeam], Disk: [Delilah ArcFS01 Backup/Delilah ArcFS01 Backup_2026-08-29T232336.vib], Type: [nfs3 (1)]], Handle: [01000702080061030000000007fffd5f65840fb20000000000000000150061038a2f7c0b0400610379207c0b], Read chunk size: 131072, Write chunk size: 131072, Read only: true Because it continuously fails during the synthetic full, it eventually causes the snapshot to be lost when retries fail. The team will change this logic in a future update. Action Items for the NFS Issue: To help prevent these snapshot loss failures, could you please provide the logs from the repository NFS (192.168.20.91)? Export the logs from the Veeam server and select the repository host. Provide the results of running this command directly on the Repository host: journalctl --since "30 days ago" > journal_repo.log Temporary Workaround: If you can, please temporarily switch to active fulls instead of synthetic fulls to help stabilize the job. Please let me know if you have any questions, and if you are able to raise that ticket with Vates. They also just responded back with this statment... Regarding the second part of the last email with the noticed Synthetic full issue, I actually would like you to also make this registry entry on the Veeam server and keep synthetic fulls enabled to see if it helps with that issue: Path: HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication Name: Nfs3CommandWaitTimeoutSec Type: DWORD Value (In Decimal): 86400
  • Everything related to Xen Orchestra's REST API

    88 Topics
    654 Posts
    poddingueP
    Pretty cool, @samuelolavo, thanks for clarifying!
  • Terraform, Packer or any tool to do IaC

    51 Topics
    485 Posts
    CyrilleC
    @koushik you have to use the Helm controller addons for RKE2 to deploy autmatically the Helm chart for the Xen Orchestra CCM with the field spec.bootstrap set to true: Field | Default | Description -------------------------------------------------- `spec.bootstrap` | `false` | Set to True if this chart is needed to bootstrap the cluster (Cloud Controller Manager, etc) EDIT: I wrote a wiki page with what I've tested https://github.com/vatesfr/xenorchestra-cloud-controller-manager/wiki/Rancher-RKE2
  • repost: Backup to cold spare

    Solved
    5
    0 Votes
    5 Posts
    1k Views
    olivierlambertO
    You are welcome @Justin-Goldberg ! Enjoy
  • Questions: Delta backup initial seed

    8
    0 Votes
    8 Posts
    2k Views
    olivierlambertO
    Great!
  • 'yarn build' failure

    19
    1 Votes
    19 Posts
    5k Views
    A
    @julien-f thx for the quick fix. works perfectly now.
  • Backup error: "no writers left"

    6
    0 Votes
    6 Posts
    2k Views
    julien-fJ
    @vmpr Not much, this is a system issue which means that it's either due to your NFS server or to the connection between your XO and the NFS server. First, try to unmount the share and restart xo-server, if it keeps happening, restart the whole machine on which XO is. If that does not help, you should mount the share manually and do some tests directly on it.
  • Backup solutions?

    2
    0 Votes
    2 Posts
    1k Views
    olivierlambertO
    Most users are relying NFS shares. However, we are open to build something for tapes. The problem is: we have no knowledge on that technology nor have any tape system in our lab. If there's enough traction for this, or even sponsored dev to do it, we'll be happy to work on that!
  • What happens when a delta backup fails?

    9
    0 Votes
    9 Posts
    2k Views
    julien-fJ
    @olivierlambert XO does not test the full VHD structure because that would be too long, but does check both the begining and the end of the file (and all other VHDs in the chain) before each backup to make sure the files were not truncated. For full backup we are using a simple heuristic to attempt to validate XVA files, but it's very basic and unfortunately it does not applies to compressed files.
  • 0 Votes
    8 Posts
    5k Views
    D
    @danp Thanks for the tips... Ran the command to do a force rebuild and started up ok now... sudo curl https://raw.githubusercontent.com/Jarli01/xenorchestra_updater/master/xo-update.sh | bash -s -- -f
  • Hourly Error: "fs_usage"

    Solved
    11
    0 Votes
    11 Posts
    3k Views
    M
    Have created an SMB share and shoved them all there - problem seems to have gone away. Thanks for the help!
  • Yarn install error with latest XO github update

    Solved
    7
    0 Votes
    7 Posts
    4k Views
    P
    For the installation of the correct node version for some major Linux distributions please follow the installation instructions in this readme: https://github.com/nodesource/distributions/blob/master/README.md The Ubuntu section worked for me.
  • Backup Strategy

    2
    0 Votes
    2 Posts
    871 Views
    DarkbeldinD
    To change your IP address see doc here
  • Installation form sources missing xo-server module

    7
    0 Votes
    7 Posts
    2k Views
    DanpD
    @julien-f I believe that you already updated the docs, but that occurred after the postings above. You may want to review the section discussing forever-service to be sure it doesn't need modified.
  • restoring META

    7
    0 Votes
    7 Posts
    3k Views
    C
    @s-pam i'd say use them, always use the. Only a few KB of space and could be every handy. We have 3 servers in the pool so overlooked requirement for full pool recovery. (p.s we didn't fail, it's during DR testing it was flagged) we had the backups on already and if this had been a real issue, would have saved a lot of bacon!! turn it on ! (and check you can get it without a running XOA for quicker restore in full meltdown.)
  • Build from source Error

    Solved
    12
    0 Votes
    12 Posts
    2k Views
    olivierlambertO
    Thanks for the report!
  • NTP Settings XOA?

    13
    2
    0 Votes
    13 Posts
    9k Views
    olivierlambertO
    This section has nothing to do with XOA IP address, but useful to restrict some VMs to some IP address. I agree it's unclear. But as I said, for now, there's 0 GUI to configure the system per se. That's why I said it could be an addition sure, but there's nothing yet, so adding it will take some time or efforts, and it's not a priority as we speak (our backlog is already pretty big). But again, as an Open Source project, we are welcoming contributions!
  • 0 Votes
    2 Posts
    531 Views
    olivierlambertO
    To pick a pool: it's up to you to decide, depending on available pool storage capacity, speed. Same for compute and network. It's very very specific to your own needs, there's no universal rules. Host selection for a VM: it's not decided by XO but by XAPI (except if you specifically ask to boot on a host). IIRC, it's a mix of load and memory available, but if you want to dig further, it should be written in the XAPI code somewhere
  • USB Hard drives for VM exports

    13
    0 Votes
    13 Posts
    6k Views
    IndyJI
    @indyj FYI when I ran this test again it worked. this time: I ran it as a "Delta" backup. And then rescanned the removable media. I was then able to restore an individual file from the backup on USB media.
  • creating trunked connections through physical interfaces.

    3
    0 Votes
    3 Posts
    1k Views
    fohdeeshaF
    @garrya Hi, it sounds like you've set up VLAN interfaces correctly on the XCP-ng side, but the switch they are connected to also needs to be aware of VLAN tags to pass them, or else it will only pass untagged traffic as you noticed. You'll need a smart/managed switch with VLAN capability to do so
  • Authentication via Active Directory

    3
    0 Votes
    3 Posts
    2k Views
    B
    @deoccultist Sadly, none of this seemed to make any difference.
  • Can Network be selected for Backups?

    4
    1
    0 Votes
    4 Posts
    1k Views
    olivierlambertO
    See my answer in the other thread.
  • Support for XO in docker container

    21
    0 Votes
    21 Posts
    15k Views
    olivierlambertO
    We are investigating an elegant solution called RunX. Basically, it might be able to transparently any standard "container stack" (Docker and/or k8s). See https://www.youtube.com/watch?v=9m95hojMtsU There's some work to adapt that to XAPI, but it might be doable. This means XCP-ng could be "container" native while having very good level of isolation with very small VMs (only few MiB overhead).