XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    CBT: the thread to centralize your feedback

    Scheduled Pinned Locked Moved Backup
    439 Posts 37 Posters 386.6k Views 29 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A Offline
      Andrew Top contributor @olivierlambert
      last edited by

      @olivierlambert Using current XO (07024). I'm having problems with one VM and hourly Continuous Replication (Delta, CBT/NBD). The VM has three VDIs attached. Sometimes it works just fine. But it does error out at least once a day and transferring hundreds of gigs of data for its retries.

      stream has ended with not enough data (actual: 446, expected: 512)
      Couldn't deleted snapshot data
      Disk is still attached to DOM0 VM
      

      On the next CR job it works (and deletes snapshots) but normally leaves a task running from before on the pool master for the export (that's doing nothing, stuck at 0%). A tool stack restart is required to free it.

      It's odd that it complains about the disk attached to Dom0 on a run where it leaves a Dom0 export task but then on the next run it works without error (and the VDI task still attached to Dom0).

      I can't force the problem to happen, but it keeps happening.

      1 Reply Last reply Reply Quote 0
      • R Offline
        rtjdamen @olivierlambert
        last edited by

        @olivierlambert last week @florent implemented some changed code at our end, but this did not seem to resolve the issue, we are using a proxy for backups, i am not shure is the changed code was deployed to our xoa or xoa proxy, as we are still encountering the issue i have now changed the settings to not use the proxy, so far no stream errors yet. I still see the data destory vdi in use but that could be a different problem. I will keep an eye on it to check if indeed florent did not deploy the upgrade to the proxy and we did therefore not see the changes.

        Anyone using proxy in this situations where the stream error occurs?

        R 1 Reply Last reply Reply Quote 0
        • R Offline
          rtjdamen @flakpyro
          last edited by

          @flakpyro did the same test with nfs based vm, but also can’t reproduce the problem here.

          1 Reply Last reply Reply Quote 0
          • R Offline
            rtjdamen @rtjdamen
            last edited by

            @olivierlambert unfortunatly it did not resolve the stream problem, just got another one.

            M 1 Reply Last reply Reply Quote 0
            • M Offline
              manilx @rtjdamen
              last edited by manilx

              @olivierlambert I just got this error to on our production pools!
              ScreenShot 2024-07-21 at 09.29.37.png

              M julien-fJ 2 Replies Last reply Reply Quote 0
              • M Offline
                manilx @manilx
                last edited by

                @manilx ticket opened.

                1 Reply Last reply Reply Quote 0
                • julien-fJ Offline
                  julien-f Vates πŸͺ Co-Founder XO Team @manilx
                  last edited by

                  @manilx The incorrect backup size warning is a known issue that we will investigate soon πŸ™‚

                  M R 2 Replies Last reply Reply Quote 0
                  • M Offline
                    manilx @julien-f
                    last edited by

                    @julien-f said in CBT: the thread to centralize your feedback:

                    @manilx The incorrect backup size warning is a known issue that we will investigate soon πŸ™‚

                    πŸ‘

                    1 Reply Last reply Reply Quote 0
                    • R Offline
                      rtjdamen @julien-f
                      last edited by

                      @julien-f and the stream error?

                      julien-fJ 1 Reply Last reply Reply Quote 1
                      • julien-fJ Offline
                        julien-f Vates πŸͺ Co-Founder XO Team @rtjdamen
                        last edited by

                        @rtjdamen We are investigating it as well πŸ™‚

                        For the XO backend team, the next few months are focused on stabilization, bug fixes and maintenance πŸ™‚

                        A 1 Reply Last reply Reply Quote 0
                        • A Offline
                          Andrew Top contributor @julien-f
                          last edited by

                          @julien-f @florent @olivierlambert I'm using XO source master (commit c5f6b). Running Continuous Replication with NBD+CBT and Purge Snapshot. With a single (one) NBD connection on the backup job, things work correctly. With two NBD connections I see some Orphan VDIs left almost every time after the backup job runs. They are different ones each time.

                          F 1 Reply Last reply Reply Quote 0
                          • F Offline
                            flakpyro @Andrew
                            last edited by

                            I noticed when migrating some VDIs with CBT enabled from one NFS SR another that the CBT only snapshots are left behind. Perhaps this is why a full backup seems to be required after a storage migration?

                            R 1 Reply Last reply Reply Quote 0
                            • R Offline
                              rtjdamen @flakpyro
                              last edited by

                              @flakpyro i know from our other backup software we use that migrating cbt enabled vdi’s is not supported on xen, when u migrate between sr it will disable cbt on that vdi. This is causing a new full. This is by design

                              https://github.com/vatesfr/xen-orchestra/pull/7756

                              fbeauchamp opened this pull request in vatesfr/xen-orchestra

                              closed feat(xo-server): disable cbt on vdi/VM/host migration #7756

                              F 1 Reply Last reply Reply Quote 0
                              • F Offline
                                flakpyro @rtjdamen
                                last edited by

                                @rtjdamen Makes sense, it would be nice is XOA cleaned up these small CBT snapshots though after a migration from one SR to another.

                                R 1 Reply Last reply Reply Quote 1
                                • R Offline
                                  rtjdamen @flakpyro
                                  last edited by

                                  @flakpyro indeed, sounds like a bug. It should delete the snapshot, disable cbt and then migrate to the other sr.

                                  1 Reply Last reply Reply Quote 0
                                  • Tristis OrisT Offline
                                    Tristis Oris Top contributor
                                    last edited by

                                    I've been out of life for a while.
                                    is it any known problem with CBT file restore?
                                    b11b7872-c829-4cba-8f38-1e199fd7cbe1-image.png

                                    M A 2 Replies Last reply Reply Quote 0
                                    • M Offline
                                      manilx @Tristis Oris
                                      last edited by

                                      @Tristis-Oris Working fine here, with cbt backups.

                                      1 Reply Last reply Reply Quote 0
                                      • A Offline
                                        Andrew Top contributor @Tristis Oris
                                        last edited by

                                        @Tristis-Oris Is your backed up VM using LVM for it's root filesystem?

                                        Tristis OrisT M 2 Replies Last reply Reply Quote 0
                                        • Tristis OrisT Offline
                                          Tristis Oris Top contributor @Andrew
                                          last edited by

                                          @Andrew most of them, yes.

                                          A 1 Reply Last reply Reply Quote 0
                                          • A Offline
                                            Andrew Top contributor @Tristis Oris
                                            last edited by

                                            @Tristis-Oris This is a known issue from before and not related to CBT backups.

                                            Message Posting File restore error on LVMs

                                            File level restoration not working on LVM partition #7029
                                            (https://github.com/vatesfr/xen-orchestra/issues/7029)

                                            andrew64k created this issue in vatesfr/xen-orchestra

                                            open File level restoration not working on LVM partition #7029

                                            Tristis OrisT 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post