XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Compressed backups

    Scheduled Pinned Locked Moved Solved Backup
    25 Posts 6 Posters 1.1k Views 5 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • abudefA Online
      abudef
      last edited by

      At least the first backup, i.e. the full backup (and maybe every key full backup milestone later) does not look like it is compressed. If the "Store backup as multiple data blocks instead of a whole VHD file" option is off, a .vhd of 116 GiB is stored, if it is on, the whole data block structure is only 67 GiB.

      1 Reply Last reply Reply Quote 0
      • abudefA Online
        abudef
        last edited by

        In addition, I have verified that if the option "Store backup as multiple data blocks instead of a whole VHD file" is enabled, the restore from the data blocks structure takes about 2-3 longer than from the .vhd if this option is disabled (I tested the health check restore).

        1 Reply Last reply Reply Quote 0
        • abudefA Online
          abudef
          last edited by

          (The idea behind is to have both a compressed delta backup (the backup repository itself is backed up to another location via vpn, so the size of the backup matters) and the fastest possible restore option.)

          F 1 Reply Last reply Reply Quote 0
          • F Offline
            frank-s @abudef
            last edited by

            abudef I just had a backup failure. This triggered a full (key) backup on the next run which transferred 165GiB. When I rdpd into the vm I could see that the vm contained 345GiB of data including the system drive. I conclude, therefore that compression is working for full key backups at a ration of around 2:1.
            I hope this helps.

            abudefA 1 Reply Last reply Reply Quote 0
            • abudefA Online
              abudef @frank-s
              last edited by

              frank-s Do you have the "data block" option enabled for remote or not?

              F 1 Reply Last reply Reply Quote 0
              • F Offline
                frank-s @abudef
                last edited by

                abudef Yes, data blocks is enabled on the remote.

                abudefA 1 Reply Last reply Reply Quote 0
                • abudefA Online
                  abudef @frank-s
                  last edited by

                  frank-s This confirms my observations and tests that for compression to be active, data blocks must be enabled for remote.

                  1 Reply Last reply Reply Quote 0
                  • abudefA Online
                    abudef
                    last edited by

                    florent Can you please provide some summary on backup setup versus compression versus remotes configuration?

                    abudefA 1 Reply Last reply Reply Quote 0
                    • abudefA Online
                      abudef @abudef
                      last edited by

                      Hello florent may I remind you to make this question clear, when and under what circumstances is compression used and when is it not? Thanks a lot.

                      florentF 1 Reply Last reply Reply Quote 0
                      • florentF Offline
                        florent Vates 🪐 XO Team @abudef
                        last edited by

                        abudef
                        incremental backups on block storage are compressed with brotli in fastest mode. But this is enough to have a massive gain , since we compress all the zeroes.

                        incremental backup ( *.vhd files ) on non block storage aren't compressed

                        Full backup (as in xva file ) aren't compressed by xo, but can be compressed by xcp ng ( using gzip or zstd )

                        for now, this is not configurable, we are waiting for the future remote form to handle this.

                        abudefA 1 Reply Last reply Reply Quote 1
                        • abudefA Online
                          abudef @florent
                          last edited by

                          florent Clear now, thanks!

                          1 Reply Last reply Reply Quote 0
                          • olivierlambertO olivierlambert marked this topic as a question on
                          • olivierlambertO olivierlambert has marked this topic as solved on
                          • First post
                            Last post