XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Compressed backups

    Scheduled Pinned Locked Moved Solved Backup
    25 Posts 6 Posters 1.1k Views 5 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Online
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      I think we compress everything on flight, but I'm not sure, florent could tell

      1 Reply Last reply Reply Quote 0
      • abudefA Offline
        abudef
        last edited by

        At least the first backup, i.e. the full backup (and maybe every key full backup milestone later) does not look like it is compressed. If the "Store backup as multiple data blocks instead of a whole VHD file" option is off, a .vhd of 116 GiB is stored, if it is on, the whole data block structure is only 67 GiB.

        1 Reply Last reply Reply Quote 0
        • abudefA Offline
          abudef
          last edited by

          In addition, I have verified that if the option "Store backup as multiple data blocks instead of a whole VHD file" is enabled, the restore from the data blocks structure takes about 2-3 longer than from the .vhd if this option is disabled (I tested the health check restore).

          1 Reply Last reply Reply Quote 0
          • abudefA Offline
            abudef
            last edited by

            (The idea behind is to have both a compressed delta backup (the backup repository itself is backed up to another location via vpn, so the size of the backup matters) and the fastest possible restore option.)

            F 1 Reply Last reply Reply Quote 0
            • F Offline
              frank-s @abudef
              last edited by

              abudef I just had a backup failure. This triggered a full (key) backup on the next run which transferred 165GiB. When I rdpd into the vm I could see that the vm contained 345GiB of data including the system drive. I conclude, therefore that compression is working for full key backups at a ration of around 2:1.
              I hope this helps.

              abudefA 1 Reply Last reply Reply Quote 0
              • abudefA Offline
                abudef @frank-s
                last edited by

                frank-s Do you have the "data block" option enabled for remote or not?

                F 1 Reply Last reply Reply Quote 0
                • F Offline
                  frank-s @abudef
                  last edited by

                  abudef Yes, data blocks is enabled on the remote.

                  abudefA 1 Reply Last reply Reply Quote 0
                  • abudefA Offline
                    abudef @frank-s
                    last edited by

                    frank-s This confirms my observations and tests that for compression to be active, data blocks must be enabled for remote.

                    1 Reply Last reply Reply Quote 0
                    • abudefA Offline
                      abudef
                      last edited by

                      florent Can you please provide some summary on backup setup versus compression versus remotes configuration?

                      abudefA 1 Reply Last reply Reply Quote 0
                      • abudefA Offline
                        abudef @abudef
                        last edited by

                        Hello florent may I remind you to make this question clear, when and under what circumstances is compression used and when is it not? Thanks a lot.

                        florentF 1 Reply Last reply Reply Quote 0
                        • florentF Offline
                          florent Vates 🪐 XO Team @abudef
                          last edited by

                          abudef
                          incremental backups on block storage are compressed with brotli in fastest mode. But this is enough to have a massive gain , since we compress all the zeroes.

                          incremental backup ( *.vhd files ) on non block storage aren't compressed

                          Full backup (as in xva file ) aren't compressed by xo, but can be compressed by xcp ng ( using gzip or zstd )

                          for now, this is not configurable, we are waiting for the future remote form to handle this.

                          abudefA 1 Reply Last reply Reply Quote 1
                          • abudefA Offline
                            abudef @florent
                            last edited by

                            florent Clear now, thanks!

                            1 Reply Last reply Reply Quote 0
                            • olivierlambertO olivierlambert marked this topic as a question on
                            • olivierlambertO olivierlambert has marked this topic as solved on
                            • First post
                              Last post