XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    CBT: the thread to centralize your feedback

    Scheduled Pinned Locked Moved Backup
    439 Posts 37 Posters 386.5k Views 29 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • R Offline
      rtjdamen @florent
      last edited by

      @florent hi Florent, i would love to help u test this on our lab, i have XO from sources running there, but i have no cbt options, do i need to download it in a specific way?

      1 Reply Last reply Reply Quote 0
      • D Offline
        Delgado @florent
        last edited by

        @florent I'll be more than happy to help. I will get my homelab instance upgraded to that branch and report back with any issues,

        1 Reply Last reply Reply Quote 0
        • olivierlambertO Offline
          olivierlambert Vates πŸͺ Co-Founder CEO
          last edited by

          @rtjdamen You need to switch on fix_cbt branch, like git checkout fix_cbt and rebuild.

          R 1 Reply Last reply Reply Quote 0
          • R Offline
            rtjdamen @olivierlambert
            last edited by

            @olivierlambert thank you, found it, i will run some backups with one or two vms to start with and will report the results.

            R 1 Reply Last reply Reply Quote 0
            • R Offline
              rtjdamen @rtjdamen
              last edited by

              This seems to be working fine. Once the backup is complete, we'll execute the vdi_data_destroy command, right? Currently, it doesn't appear obvious that this is a CBT metadata-only snapshot. Is there a way to make this more visible?

              1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates πŸͺ Co-Founder CEO
                last edited by

                You mean in the VM view/snapshot tab? You are seeing the VM snapshot, not the VDI snapshot, so I wonder if this VM snapshot can be reverted while being CBT metadata only, and if not, we must make it clear in the UI, yes!

                R A 2 Replies Last reply Reply Quote 0
                • D Offline
                  Delgado
                  last edited by

                  I enabled cbt on the disks and nbd + cbt in my delta backup and so far so good. I plan on letting another backup run over night. I also ran a full backup and it removed the snapshot like it's supposed to.

                  1 Reply Last reply Reply Quote 0
                  • R Offline
                    rtjdamen @olivierlambert
                    last edited by

                    @olivierlambert yes indeed, this is currently visible like a normal snapshot, i think it should be visible like a metadata only snapshot.

                    1 Reply Last reply Reply Quote 0
                    • R Offline
                      rtjdamen
                      last edited by

                      @florent i have been watching the backup process and in the end i only seed vdi.destroy happening nog vdi.data_destroy is this correct? are we handling this last step correct or do we remain data on the snapshot at this time?

                      1 Reply Last reply Reply Quote 0
                      • florentF Offline
                        florent Vates πŸͺ XO Team
                        last edited by

                        dataDestroy will be enable-able (not sure if it's really a word) today, in he meantime, the

                        Please note that the metadata snapshot won't be visible in the UI since it's not a VM Snapshot, but only the metadata of the vdi snapshots

                        latest commits in the fix_cbt branch add an additionnal check on dom0 connect, more error handling

                        R 1 Reply Last reply Reply Quote 0
                        • R Offline
                          rtjdamen @florent
                          last edited by

                          @florent ok so currently the data remains? When do u think this addition is ready for testing? I am interested as we saw some issues with this on nfs and i am curious if it will make a difference with this code.

                          @olivierlambert i now understand there is in general no difference on coalesce as long as the data destroy is not done. So u were right on that part and it’s safe pushing it this way!

                          florentF 1 Reply Last reply Reply Quote 0
                          • olivierlambertO Offline
                            olivierlambert Vates πŸͺ Co-Founder CEO
                            last edited by

                            Yes, that's why we'll be able to offer a safe route for people not using the data destroy but leave people who want to explore it to do so in opt in πŸ™‚

                            1 Reply Last reply Reply Quote 0
                            • florentF Offline
                              florent Vates πŸͺ XO Team @rtjdamen
                              last edited by

                              @rtjdamen it's still fresh, but on the other hand, the worse that can happen is falling back to a full backup. So for now I would not use it on the bigger VM ( multi terabytes )
                              We are sure that it will be a game changer on thick provisioning ( because snapshot cost the full virtual size) or on fast changing VM , where coalescing an older snapshot is a major hurdle

                              If everything goes well it will be on stable by the end of july, and we'll probably enable it by default on new backup in the near future

                              R 3 Replies Last reply Reply Quote 1
                              • Tristis OrisT Offline
                                Tristis Oris Top contributor
                                last edited by

                                can't commit, too small for ticket.

                                typo

                                preferNbdInformation:
                                    'A network accessible by XO or the proxy must have NBD enabled,. Storage must support Change Block Tracking (CBT) to ue it in a backup',
                                

                                enabled,.
                                to ue

                                1 Reply Last reply Reply Quote 0
                                • R Offline
                                  rtjdamen @florent
                                  last edited by

                                  This post is deleted!
                                  1 Reply Last reply Reply Quote 0
                                  • Tristis OrisT Offline
                                    Tristis Oris Top contributor
                                    last edited by

                                    updated to fix_cbt branch.

                                    CR NBD backup works.
                                    Delta NBD backup works.
                                    just once, so we can't be sure yet.

                                    No broken tasks is generated.

                                    Still confused why CBT toggle is enabled on some VMs.
                                    2 similars vms on same pool, same storage, same ubuntu version. One is enabled automaticaly, other is not.

                                    1 Reply Last reply Reply Quote 1
                                    • R Offline
                                      rtjdamen @florent
                                      last edited by

                                      @florent i did some testing with the data_destroy branch on my lab, it seems to work as required, indeed the snapshot is hidden when it is cbt only.

                                      What i am not shure is correct, when the data destroy action is done, i would expect a snapshot is showing up for coalesce but it does not. Is it too small, and quick removed so it will not be visible in XOA? on larger vms with our production i can see these snapshots showing for coalesce? Or when you do vdi.data_destroy will it try to coalesce directly without garbage collection afterwards?

                                      1 Reply Last reply Reply Quote 0
                                      • R Offline
                                        rtjdamen @florent
                                        last edited by

                                        @florent what does happen when we upgrade to this version by the end of july, we do now use NDB without cbt on most backups. will all need to run a full or does it 'convert' the method to the cbt situation? i asume as the checkbox for data destroy will be disabled in general it will not change that much to the backup at day one as long as u not switch to the data destroy option?

                                        1 Reply Last reply Reply Quote 0
                                        • olivierlambertO Offline
                                          olivierlambert Vates πŸͺ Co-Founder CEO
                                          last edited by

                                          The transition to CBT should be done smoothly and without any manual intervention. @florent will provide more details on how πŸ™‚

                                          robytR 1 Reply Last reply Reply Quote 0
                                          • R Offline
                                            rtjdamen
                                            last edited by

                                            All tests with 2 vms were so far succesfull, no issues found in our lab. Good job guys!

                                            1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post