XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    How to synchronize Metadata backup with SAN/NAS snaphots/backup?

    Scheduled Pinned Locked Moved Backup
    6 Posts 2 Posters 124 Views 2 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • N Offline
      nodje
      last edited by

      I'm fresh new XCP-NG user, currently evaluating virtualized on Proxmox with the intent to replace it as the baremetal hypervisor for VM and plug it on a TrueNAS instance for SAN/NAS SRs. So far it's a pretty exiting interface and tech stack that I'm discovering, and I like the extensive Hardware Compatibility list issued from xen server.

      It seems a bit hard to automate immutable OS deployment (like CoreOS/Flatcar) because of the ignition file parameter but I'm reasonably confident I'll be able to make do somehow (an adapted PXE config or maybe https://matchbox.psdn.io which seems promising to achieve just this)

      But what I still can't wrap my head around is how I will be a lot to put a backup/snapshot strategy with a ZFS based SAN/NAS.
      As far as I've read, Metadata Backup seems to be what I need, but I haven't found out about any configuration/hook/plugin that would allow me to sync a metadata backup with basically a ZFS zvol/dataset snapshot.

      What would you advise on a way to achieve this ?

      1 Reply Last reply Reply Quote 0
      • olivierlambertO Offline
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        Hi,

        I'm not sure to entirely get the use case, but IIRC you have web hooks for backup jobs (pre and post).

        1 Reply Last reply Reply Quote 0
        • N Offline
          nodje
          last edited by

          thanks, I found out Settings->Plugins->web-hooks which allows just this upon metadataBackup events.

          Aren't there any backup integration existing for backup with SR on SAN?
          Aren't typically the snapshots done on the SAN side in these cases but need to be driven by XOA ?

          I thought it would be a fairly common use case for enterprise setup.

          My personal use case though, is to deploy VMs on an XCP-NG instance deployed on a dedicated baremetal server and use SR from SAN/NAS storage (iSCSI & NFS/SMB) implemented by a dedicated TrueNAS server instance.

          olivierlambertO 1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO @nodje
            last edited by

            @nodje said in How to synchronize Metadata backup with SAN/NAS snaphots/backup?:

            Aren't typically the snapshots done on the SAN side in these cases but need to be driven by XOA ?

            No. By default, everything is done by XCP-ng. The good side is that regardless the storage vendor, it will work. That's a strength, to be agnostic on the hardware. The price to pay is to rely less on the vendor capabilities. We have plans this year to start with some storage vendors to offload snaps and other things, but as you can imagine, since there are hundreds of different vendors with hundreds of different models, you cannot have something universal.

            N 1 Reply Last reply Reply Quote 0
            • N Offline
              nodje @olivierlambert
              last edited by

              I understand, thanks for sharing the plan.

              I'm not sure the community is looking for something like that, but for what it's worth, here is what Proxmox is proposing for ZFS capable SAN appliances: https://pve.proxmox.com/wiki/Storage:_ZFS_over_ISCSI

              AFAIU, it's a storage class based on a framework using ssh to create ZVOL and share them over iSCSI on a SAN appliance. Storage snapshots are then triggered on the SAN.
              And it's apparently possible to provide your own SAN implementation as a plugin.

              Sounds like part of a solution to me, but I have no idea whether it would be suitable/desirable for XCP-NG.

              1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by

                This will come for some vendors (with their own APIs). We do not want to use SSH for that though (XO never use SSH).

                1 Reply Last reply Reply Quote 0
                • First post
                  Last post