XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Is my backup configuration sane? (plus a bonus delta backup question)

    Scheduled Pinned Locked Moved Solved Xen Orchestra
    16 Posts 5 Posters 1.0k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Offline
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      A snapshot is a "frozen" disk state, that's needed to export it. You can't export a disk while it's used by your VM (because blocks are moving!).

      For delta, we export (at first) the full content of a snapshot. This will be the big VHD file on your NAS/remote storage.

      Next run, we'll take another snapshot, but this time, we'll export only the diff between original and new snapshot. This is the small VHD you have on the remote. When it's done, we remove the oldest snapshot, and so on.

      Also, a snapshot doesn't consume a lot of disk space. It's just a small file that will tell we need to freeze the disk content from there.

      If you use ext local SR (or NFS) this will have only a small impact on the space used by your VM disks.

      It's different on local LVM and LVM over iSCSI (thick pro).

      D C 2 Replies Last reply Reply Quote 0
      • D Offline
        dbsoundman @olivierlambert
        last edited by

        @olivierlambert said in Is my backup configuration sane? (plus a bonus delta backup question):

        If you use ext local SR (or NFS) this will have only a small impact on the space used by your VM disks.

        It's different on local LVM and LVM over iSCSI (thick pro).

        My local SRs are still thick provision, I need to change that but that's a different project. 🙂

        Thanks for the help once again!

        1 Reply Last reply Reply Quote 0
        • C Offline
          chr1st0ph9 @olivierlambert
          last edited by

          @olivierlambert Thank you for this explanation of the snapshot. However, does this snapshot decrease the performance of the virtual machine (as with LVM for example) on which it was generated or does it not affect performance at all ?

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by olivierlambert

            Short answer: depends. Longer answer: if you have more than 3 snapshots, you will start to notice the difference, mostly in read. Because each read will have to check the block origin in the whole chain. But one or two snap will not impact the performance in a very visible way.

            All in all, as it's a best practice to avoid more than 3 snapshots for many reasons, don't over think things 🙂

            C 1 Reply Last reply Reply Quote 1
            • C Offline
              CJ @olivierlambert
              last edited by

              @olivierlambert Interesting. So you don't recommend nightly incrementals with a weekly full as it would generate too many snapshots and could start seeing performance degradation?

              C 1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by

                Hmm not at all. 2 different jobs will generate 2 snapshots total, which is perfectly fine 🙂

                C 1 Reply Last reply Reply Quote 0
                • C Offline
                  chr1st0ph9 @CJ
                  last edited by

                  @CJ on my installation, a full followed by an incremental or the reverse does not result in 2 snapshots but only one. 2 snapshots appear temporarily only when the backup is in progress.

                  1 Reply Last reply Reply Quote 0
                  • olivierlambertO Offline
                    olivierlambert Vates 🪐 Co-Founder CEO
                    last edited by

                    You can also have a composite job, doing 2 things at once (like incremental backup and incremental replication), so it will use just one snap for both. But again, 2 and even 3 snaps are OK

                    1 Reply Last reply Reply Quote 0
                    • C Offline
                      CJ @olivierlambert
                      last edited by

                      @olivierlambert Okay, when you say 3 snapshots, you mean number of jobs, not retention? I tend to think of snapshots in ZFS terms so that may be where the disconnect is coming from. 🙂

                      In my example, there would be enough retention of the nightly diff snapshots so that you could restore to any day during the week. Once the weekend full backup occurs the nightly wouldn't be as needed.

                      I think I might be conflating snapshot and backup. I'll need to double check my cluster, but thinking about it, each nightly snapshot could be overwritten as it would have been backed up to the SR.

                      1 Reply Last reply Reply Quote 0
                      • olivierlambertO Offline
                        olivierlambert Vates 🪐 Co-Founder CEO
                        last edited by

                        I'm talking about VM snapshots (and by transitivity, VDI snapshots). Retention is the number of backup you save on the backup repository, and it's totally unrelated to the number of snapshots when doing full or incremental backups.

                        1 Reply Last reply Reply Quote 1
                        • First post
                          Last post