XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login
    • Profile
    • Following 0
    • Followers 1
    • Topics 18
    • Posts 450
    • Groups 0
    J Offline
    1. Home
    2. john.c

    john.c

    @john.c

    140
    Reputation
    122
    Profile views
    450
    Posts
    1
    Followers
    0
    Following
    Joined
    Last Online
    Location United Kingdom

    john.c Unfollow Follow
    • RE: WORM Backups with XCP-ng / Xen Orchestra - Seeking Solutions & Experience

      @SylvainB said in WORM Backups with XCP-ng / Xen Orchestra - Seeking Solutions & Experience:

      Hello everyone,

      I'm exploring options for implementing WORM (Write Once, Read Many) capabilities for my backups within my XCP-ng environment, specifically using Xen Orchestra.

      My current setup:

      • XCP-ng Version: 8.3
      • Xen Orchestra Version: 5.106.4 (Stable)
      • Intended Backup Target: Synology NAS

      My primary goal is to ensure that my backup data, once written, becomes immutable for a defined retention period, offering protection against accidental deletion or ransomware attacks.

      My questions are:

      1. Does Xen Orchestra offer any native WORM features or integrations that I might be overlooking for its backup jobs?
      2. If not directly, has anyone successfully implemented WORM backups with a similar perimeter (XCP-ng, Xen Orchestra, and potentially a Synology NAS or other storage solution)? I'm very interested in learning about your setup, the specific technologies you used (e.g., storage features, specific configurations), and any lessons learned or best practices.

      Any insights, architectural recommendations, or shared experiences would be highly valuable.

      Thank you in advance for your help!

      Best regards,

      SylvainB

      You can setup in the Synology its WriteOnce feature, then configure the appropriate configuration settings, including retention ones.

      This will prepare the appropriate WORM environment you’re looking for. It will work well due it being the equivalent to Vates solution and/or the S3 based one.

      https://kb.synology.com/en-in/search?tags[]=WriteOnce

      posted in Backup
      J
      john.c
    • Vates

      @olivierlambert Hi Vates Team,

      I’m a member of the tech community in East Anglia (UK), and I recently proposed Vates as a speaker for our upcoming regional developer conference, nor(DEV):con 2027 (taking place 24th–26th February in Norwich).

      The proposal generated immediate interest on the official event Discord, with the organizing committee explicitly reaching out to note that "more sponsors are always welcome."

      Sponsorship packages at nor(DEV):con include prominent exhibition spaces at the King's Centre venue and guaranteed 30-minute speaking slots (which can be commercial/product-focused, unlike the strictly technical CFP tracks). Given your work with XCP-ng and Xen Orchestra, it would be an incredible fit for the region's infrastructure, DevOps, and backend engineering audience.

      You can check out the sponsorship tiers directly at https://nordevcon.com/sponsor or submit a talk via their Sessionize CFP at https://sessionize.com/nordevcon-2027/.

      Would love to see Vates represented here!

      posted in Vates events vates open source conferences development
      J
      john.c
    • RE: Broadcom removed public access to VDDK download links

      @afk said:

      Hi everyone,

      Some of you may already be aware of this but I learned the news this morning.

      https://www.virtualizationhowto.com/2026/09/leaving-vmware-just-got-harder-after-broadcom-pulled-vddk-downloads/

      Essentially, Broadcom has decided, without any announcement, to remove all download links (and even some documentation it seems) for VDDK.
      This impacts all migration tools that use the VDDK for copying data of VM disks.

      If you have any version of VDDK, please keep it somewhere safe and make backups.

      I only have a x86-64 linux release from september 2025 that I used for testing V2V. Obviously, I can't share any link here but the release has the following sha256 hash:

      79d215198f1b8fd1d240a16b27ac2543c521ae2afdc1876444c2acf8945d74ca VMware-vix-disklib-9.0.0.0.24742305.x86_64.tar.gz

      Apparently, web archival links are also taken down.

      @olivierlambert
      With Broadcom removing public access to VDDK downloads, we now have users who either cannot obtain VDDK at all or whose existing VDDK installations (main + backup) have become corrupted.

      This creates a real need for a fully open‑source fallback path inside V2V, one that still meets the performance requirements normally associated with VDDK.

      The open‑source community has already demonstrated that VDDK‑level throughput is achievable without VMware’s proprietary stack. Several projects have shown that:

      • Parallel NBD can saturate modern storage bandwidth when implemented correctly
      • Highly multithreaded block pipelines can outperform single‑threaded VDDK transfers
      • A throwaway Linux Proxy Copy VM can act as an efficient intermediary, reading blocks via NBD and streaming them directly to the destination hypervisor.

      This approach avoids VDDK entirely, remains fully open source, and provides a reliable fallback for users who can no longer access VMware’s proprietary components.

      Given the direction Broadcom is taking, having this fallback inside V2V would significantly improve resilience for XCP‑ng users and ensure long‑term independence from VMware licensing changes.

      The Proxy Copy VM must be treated as an ephemeral orchestration component — automatically excluded from the migration set and destroyed once the transfer completes — ensuring it never interferes with HA, LB, or startup/shutdown sequencing.

      This architecture also gives Vates a clean, open‑source answer to Broadcom’s decision to pull public VDDK access — ensuring V2V remains fully functional even if VMware continues removing or restricting proprietary components.

      posted in Migrate to XCP-ng
      J
      john.c
    • RE: Hosts compatibility

      @wtdrisco said in Hosts compatibility:

      As I am starting to build an environment for testing to replace VMWare, I had a question related to hardware.

      When setting up multiple hosts, do these need to match the same specs (like VMWare?) for HA (moving VMs from host to host)?

      I have several DELL R series servers, and some do not have the exact same CPU model or one has less memory than the other.

      When setting up (HOST POOLS??) if I needed to migrate VMs, will this support different host configurations?

      If the the hosts don't match by close enough, especially if their capabilities (e.g. instruction sets) and specifications. Then in the case of capabilities then the non-matching ones will be suppressed by XCP-ng so that they all match. Also when migrating the specifications, of hosts really need to match so that when VMs are placed on the hosts. There's no issues when live migrating between the each of the pool member hosts.

      As the VMs expect at least a certain number of cores dependent on the hosts, and the number specified per each VM. If this number isn't met then that VM can't migrate to a specific host, which don't meet or exceed it.

      posted in Hardware
      J
      john.c
    • RE: XCP-ng 8.3 betas and RCs feedback 🚀

      @ThierryC01 said in XCP-ng 8.3 betas and RCs feedback 🚀:

      @bleader Update successful, no issue so far. There is just a message appearing when starting the update: "Delta RPMs disabled because /usr/bin/applydeltarpm not installed."

      All VM working for now.

      That's harmless. It's just notifying that the system doesn't have deltarpm package installed. This package reduces the size of updates based on what's already installed.

      posted in News
      J
      john.c
    • RE: First SMAPIv3 driver is available in preview

      @still_at_work said in First SMAPIv3 driver is available in preview:

      Hello @olivierlambert ,

      I am joining this topic as I have a few questions about SMAPIv3:

      • Will it allow provisioning of VDIs larger than 2TB?

      • Will it enable thin provisioning on iSCSI SRs?

      Currently, the blockers I encounter are related to my iSCSI storage. This is a major differentiating factor compared to other vendors, and resolving these blockers would significantly increase your market share.

      Thanks !

      @still_at_work The size limit of the VDI is due to the file format used for these, which is VHD (https://en.wikipedia.org/wiki/VHD_(file_format)). This format can't support more than 2TB, it's known about and are dealing with the issue. It will likely result in a change or addition of a new VDI format likely to be qcow2 unless necessary software for VHDX format is fully open sourced and software for Xen is created which enables create, read, write and use of this format.

      It's not a limitation of iSCSI as it also emerges with both NFS and SMB based connections.

      posted in Development
      J
      john.c
    • RE: Tips on installing XO

      @jasonnix The Linux distribution operating system restricts certain commands, operations and/or path (location) to the root account, as well as the location owner.

      The path your trying to write to is just one such location as the location is read only to non-root users. If you really wish to write to /usr/local/src then root account is required.

      If you use the root account to install then the directory and the Xen Orchestra files will be owner by root. You would need to create a non-root user for the xen orchestra server process. As well as change ownership of the Xen Orchestra files and folders to that non-root account. Though at least the ones which Xen Orchestra should be able to modify as required, when needed.

      As well as provide the necessary sudo permissions for the necessary commands to that account.

      Using root account to run exposes any vulnerabilities present to the capacity of being exploited as root (aka Administrator) privileges.

      Also how good is your internet connection and your connection to GitHub? Cause you could be experiencing a time out packet loss connection issue.

      posted in Xen Orchestra
      J
      john.c
    • RE: 🛰️ XO 6: dedicated thread for all your feedback!

      @Octopuss said in 🛰️ XO 6: dedicated thread for all your feedback!:

      @olivierlambert Well ok, it's just that last time I tried to ask about stuff I was politely told off because I used the installation script instead of paying (that's not the literal formulation but it's basically what the person responding meant).

      I know nothing about any blogs, I just check the main xcp website (FFS I am not even allowed to post links, what a forum...) from time to time, so I have no idea. I just updated the admin interfce for the first time since moving over from ESXi, and was puzzled why it looked the same as the "castrated" lite version when previously (which means v5, apparently) it was full of features. I had no idea it wasn't a completed product.

      TL;DR: I am just an idiot who installed this few months ago and has no idea about the details. shrug

      You were told off if the script was 3rd party because officially, the scripts may have made changes to the Xen Orchestra source code prior to compilation. They have a set of steps, for building from source which are able to receive support in the forums for. Anyway getting paid support if an organisation is best as their pro support is top notch!

      With the blogs which are being referred to are under the “News” links. Which detail releases and other news worthy information.

      You can post links but it does take some work, also make sure you’ve read the rules, also going through the introduction training which a forum function bot runs. Doing this will eventually earn you more access and feature functionality. It’ll help you get used to the forums functions.

      The XO 6 is a minimum viable product currently, but is growing from there as features from v5 transitions to v6. If there’s features missing from v5 and v6 that are needed please enter them on the Feedback portal, so they can be voted on. It’s link is in several XOA update and release news posts (especially 6.0 and 6.1).

      Read both these posts along with others along the way, it will help you get caught up on all of the Xen Orchestra releases and updates.

      posted in Xen Orchestra
      J
      john.c
    • RE: [PACKER] soucis avec cd_files

      @olivierlambert said:

      @john.c I really liked your "Jean C." signature before your edit 😎 You should keep it 😄

      I learned a bit of French in 6th form college many years ago now, as part of learning your culture. As part of a Skillpower course unit assignment. As part of this course during Sept 2001 to Summer 2006 went on an academic day trip visit to Boulogne, France.

      But it was to a level that was useful for when going on holidays, so wasn’t very fluent.

      posted in French (Français)
      J
      john.c
    • RE: [PACKER] soucis avec cd_files

      @jeremie1977 said:

      Bonjour,
      Nous sommes en plein POC de Vates et je test le build de nos images RHEL avec Packer (d'ailleurs un grand merci à @bvivi57 et @ataxyanetwork pour les tutos et exemples qui m'ont fait gagner un temps précieux ^^ ).

      J'ai remarqué que le paramètre "cd_files" ne permettait pas de monter le kickstart au boot
      Le provider expose cd_files, mais le contenu n'est pas visible par l'installeur (ou n'est pas attaché à la VM...je n'ai pas sût identifier).
      J'ai même tenté avec "floppy_files"...idem.
      Est-ce normal ? Voulu ?

      Du coup, dans des environnements sans DHCP pendant l'installation, cela empêche l'utilisation d'un kickstart embarqué et oblige à mettre en place une IP via la "boot_command" avec une configuration réseau statique (ce qui oblige a multiplié les builds si plusieurs environnements/site)
      Rien de dramatique en soit mais sur les provider Packer Vmware et Nutanix que nous utilisons par ex, cd_files nous permet de couvrir les environnements isolés (air-gapped) et/ou sans DHCP et simplifie grandement les builds automatisés en rendant le code le plus idempotent possible.

      L'intérêt est multiple :
      Environnements air-gapped : aucun serveur HTTP nécessaire.
      Moins de dépendances : le build est autonome.
      Compatibilité avec les autres builders Packer (VMware, Nutanix, QEMU...), où nous utilisons cette fonctionnalité pour nos Builds
      Sécurité : le kickstart n'est pas exposé sur le réseau, même temporairement.

      Si la raison pour laquelle le fichier Kickstart ne peut pas être connecté en réseau ou autrement accessible, c'est parce qu'il contient des secrets. Cela peut valoir la peine de regarder et de vérifier le logiciel de service de détenteur sécurisé secret OpenBao (https://openbao.org/). Qui est un fork public open source de Hashicorp Vault, avant l'entrée en vigueur de la licence BUSL dans les versions ultérieures de Vault. Un autre conseil utile est de combiner l'isolation du masque de sous-réseau avec l'isolation basée sur le VLAN.

      Quoi qu'il en soit, saviez-vous qu'une instance de Cockpit, exécutant Cockpit Image Builder peut être utilisée comme Packer, pour créer des images "dorées" de VM via OSBuild ?

      Quoi qu'il en soit, bonjour et bienvenue dans la communauté Vates VMS, j'espère que vous la trouverez utile, épanouissante, accueillante et/ou amusante.

      Sincèrement,

      Jean C.

      posted in French (Français)
      J
      john.c
    • RE: PCIe Pass-through lanes and lane performance

      @pandusen said:

      I get all this.. I was merely trying to help Teddy run into issues with the Intel arc card.

      In regards to reBar, It is partly solved if you run a Linux 7 kernel. It is mostly a challenge from the guest os, rather than the hypervisor. As far as i know, xcp-ng reBar is passed through for complete PCI passthrough (not yet for Dom-0 and vfio), but I didn't concern myself too much with that.. The bigger issue was with the device grouping, the missing endpoints like the audio device and the drivers crashing when calling any of the tool stacks from intel. As well as the PCI link only negotiating a 1x1.

      Those tool-stacks from Intel crashing are evidence of the lack of virtualised ReBAR support, as they’re getting throttled to the point of choking on the 256MB per block limit.

      posted in Compute
      J
      john.c
    • RE: PCIe Pass-through lanes and lane performance

      @Team-XAPI-Network @bleader Looping in the toolstack side as well. Even if the underlying Xen hypervisor layers align to handle large BAR configurations, XAPI will need the native capabilities to orchestrate and pass these extended memory mapping boundaries down to the VM configuration templates. Without XAPI awareness, we won't be able to easily toggle or manage virtual ReBAR allocations via the CLI or Xen Orchestra.

      posted in Compute
      J
      john.c
    • RE: PCIe Pass-through lanes and lane performance

      @JamesG said:

      @john.c I would add that in addition to AI and VDI, media functions would be greatly assisted with GPU accelerated encode/decode. I need to do more with less. Having a GPU I could carve up and assign to VM workloads would be amazing.

      @JamesG Absolutely spot on. Media encoding/decoding and VDI density are huge components of this. Being able to slice up a GPU efficiently means VMs need to interact with that VRAM cleanly without hitting performance walls.

      Whether it's splitting the card via vGPU profiles or passing it through fully for raw compute, lifting these platform memory limitations is what unlocks that "do more with less" capability for media stacks. It all ties back to how robustly the hypervisor fabric can handle modern GPU memory mapping.

      If my feedback on Vates Feedback will help your use case please vote for it.

      posted in Compute
      J
      john.c
    • RE: PCIe Pass-through lanes and lane performance

      @pandusen Your Windows test results are the perfect real-world example of this exact issue.

      When you noted that the Intel driver panel was explicitly complaining about "PCI compatibility and reBar" and that performance was heavily borked, you hit the exact technical bottleneck. Without ReBAR support at the hypervisor layer, the guest OS is forced to interact with that massive 16 GB VRAM space through a rigid 256 MB window, choking it out with massive memory paging overhead.

      Even @teddyastie's Linux testing reflects this—noting that host-device transfer bandwidth is "a bit slower than theoretical."

      @olivierlambert From a strategic standpoint, as home labs and enterprise environments aggressively pivot toward localized AI, LLM inferencing, and heavy GPU compute, raw PCIe passthrough is shifting from an edge case to a core infrastructure requirement. Implementing a virtualized form of ReBAR support within Xen/XCP-ng would natively lift this 256 MB restriction. It ensures modern GPU silicon can run at 100% efficiency, keeping XCP-ng highly competitive against monolithic hypervisors that handle large BAR mapping.

      Especially with VMware VCF 9.0 and up-to-date Hyper-V on Windows Server 2025 advancing their platforms, Vates needs to have virtualised ReBAR support to maintain its edge against this competition.

      posted in Compute
      J
      john.c
    • RE: PCIe Pass-through lanes and lane performance

      @teddyastie I’ve added feedback in regards to the above on Vates Feedback portal, see link below.

      https://feedback.vates.tech/posts/123/feature-request-support-for-virtual-resizable-bar-rebar-large-bar-passthrough

      posted in Compute
      J
      john.c
    • RE: PCIe Pass-through lanes and lane performance

      @pandusen said:

      @TeddyAstie
      Great that you got around to test it.

      I did test with the hvm-pirq=0 both pre and post official patch. As you suggested earlier in the thread,
      It made no difference for me. I still had the same issues, and the 1x1 link detection.. I tested on Ubuntu, Fedora, Debian, Alma and Rocky. (all headless server)
      The only other OS was windows, which was the only OS I could get it to do anything, although heavily borked and slower than expected. Intel driver panel was also complaining about PCI compatibility and reBar

      Ubuntu is (as far as I know) the main distro that intel test and sync with.

      You should test and see if you can get Level Zero and oneApi going. (Needed for any AI work)
      I could never get these to start, driver crashed every time. If you can get that to work on Ubuntu, I would suspect it might be a grouping issue on certain motherboards.

      Also, What about the missing audio device not showing in the list?

      A part of the reason for it being slower without ReBAR (or Resizable BAR) is due to that technology lifting, the 256 MB limit (for per chunk) on CPU accessing GPU VRAM.

      To improve performance when passing through modern GPUs (and graphics cards). With lots of VRAM the limit on accessing GPU VRAM by CPU will really crease the performance of the VM at the minimum. So support for ReBAR present in Xen and XCP-ng would help performance, when passing through the GPU. Basically a virtual form of ReBAR support for VMs, when passing through GPUs.

      posted in Compute
      J
      john.c
    • RE: 🛰️ XO 6: dedicated thread for all your feedback!

      @acebmxer said:

      @john.c

      Updated to latest commit did not help as expected... Also tried firefox an with out reverse proxy...

      Screenshot 2026-10-14 112108.png

      Screenshot 2026-10-14 112302.png

      Screenshot 2026-10-14 112230.png

      If you’re using a script to help with compiling Xen Orchestra From Sources, please check whether there’s been any compilation issues when compiling it (especially ones related to the VM and Host Consoles). If there are any please grab a copy of the logs from the compilation, update the script and try compiling again.

      posted in Xen Orchestra
      J
      john.c
    • RE: 🛰️ XO 6: dedicated thread for all your feedback!

      @coolsport00 said:

      @julienxovates - playing around some more in XO6. I have quite a list I want to submit for feature enhancements (needs, really). One you all already have is being able to open a VM Console in another Tab. I attempted to but it keeps spinning & Console never displays:

      image.jpeg

      I'm using Brave browser. Sometimes this particular browser can cause issues loading pages because of its security. But, I also tried Chrome and same behavior. Thoughts?

      @acebmxer @coolsport00 Just like Microsoft Edge, Brave and Google Chrome both share the same upstream Chromium codebase. If there is an underlying bug in Chromium itself, it can potentially affect both browsers simultaneously.

      However, because this involves the XO6 VM Console spinning indefinitely, it is usually caused by environment configurations or active development bugs. Here are the best steps to troubleshoot:

      • Update XO From Sources: If you are running XO from sources, try updating by building from the head of the master branch. XO6 is moving fast, and this console bug may already have a fix waiting for you in the latest commit.

      • Self-Signed Certificates: Open a new tab and navigate directly to your XO instance's IP/domain to explicitly "Accept the risk and continue". Chromium browsers often silently block background Console WebSocket connections if the root SSL certificate isn't trusted.

      • WebSockets & Proxies: Ensure your reverse proxy, firewall, or ad-blocker isn't dropping or blocking wss:// (Secure WebSocket) connections, which the console relies on to stream the visual data.

      posted in Xen Orchestra
      J
      john.c
    • RE: Win Server 2012 R2 VM: repeated BSOD 0xD1 in xenvbd.sys (Citrix 8.1.0.130) - where to get VM Tools 9.2.3?

      @hrvojer My posts above will help you get out of a technical debt trap that you are currently pitfall-trap trapped in!

      If you do this, it will drastically help to reduce your operational costs. Maintaining an old legacy stack like this—where every component from the hypervisor to the database engine is completely End of Life (EOL)—is scandalously expensive. It sucks up valuable engineering hours in firefighting, forces you into hyper-expensive custom support agreements, and leaves you exposed to massive downtime risks—which is a nightmare scenario, especially if your other organizational costs are going up at the same time.

      I highly recommend framing this to your leadership using these exact terms:

      • The Pitfall Trap: Explain that the infrastructure team is currently stuck at the bottom of a pitfall trap of compounding technical debt due to a historical lack of a system-wide overhaul.

      • The Rescue Plan: Make it clear that trying to find deprecated, 2018-era VM tools is just a short-term sticking plaster fix that buries the team deeper. What you need is a definitive rescue plan—a clean overhaul that decouples your data layer, migrates you to a modern OS/database (or an open-source alternative), and permanently lifts you out of the trap. As well as other dependencies - systems that communicate with that one, but won’t be able to without upgrade or migration, even with configuration tweaks.

      • The Linux Performance & Driver Advantage: If you choose to migrate your database server to Linux (running PostgreSQL or MariaDB), you gain massive performance, reliability, and security boosts. Unlike Windows, you will completely bypass the fragile legacy Citrix xenvbd.sys driver ecosystem. On Linux, the paravirtualized storage and network drivers are compiled directly into the Linux kernel. The only thing you need to install separately is the modern, official XCP-ng guest agent—which Vates has beautifully rewritten as an ultra-secure, memory-safe Rust-language agent. This gives you a lean, stable database foundation that can handle heavy memory allocations and high I/O workloads without ever breaking a sweat.

      posted in Compute
      J
      john.c
    • RE: Win Server 2012 R2 VM: repeated BSOD 0xD1 in xenvbd.sys (Citrix 8.1.0.130) - where to get VM Tools 9.2.3?

      @dinhngtu said:

      @john.c Indeed I skipped over the part that the host is still on 7.6, that's a rather big upgrade blocker I think.

      @dinhngtu Yes definitely a major blocker, but so is their MS SQL Server instance being version 2014. Which is also EOL, additionally not supported by newer Windows Server following version 2019 and will need to be upgraded or migrated to an open source alternative, either of my suggestions above.

      If they do this MS SQL Server upgrade or migration it will then enable an OS upgrade to 2022 or 2025, that will then bypass EOL upcoming for Windows Server 2016 and 2019. It will also get them out of the current EOL trap of Windows Server 2012 and Windows Server 2012 R2.

      As well as upgrading or migrating anything else that depends on this that can’t work with newer components, even with any configuration tweaks.

      Staying on what they’re currently got isn’t a recommended or best option as eventually a crash WILL corrupt the database or other data of that VM. Which will propagate into backups of that VM, meaning that you have an unenviable choice of corrupted backup data loss or data loss through too old backups required (missing some data) but not corrupted.

      posted in Compute
      J
      john.c