XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Our future backup code: test it!

    Scheduled Pinned Locked Moved Backup
    128 Posts 10 Posters 7.2k Views 11 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A Offline
      Andrew Top contributor @florent
      last edited by

      @florent No. The dashboard health is clean. No VDIs attached to control domain

      1 Reply Last reply Reply Quote 1
      • florentF Offline
        florent Vates 🪐 XO Team
        last edited by

        so that is probably only a off by one error in the task code
        Thanks andrew

        florentF 1 Reply Last reply Reply Quote 0
        • florentF Offline
          florent Vates 🪐 XO Team @florent
          last edited by

          @florent code is now merged into master

          A M 2 Replies Last reply Reply Quote 1
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            🍾

            F 1 Reply Last reply Reply Quote 0
            • F Offline
              flakpyro @olivierlambert
              last edited by flakpyro

              @florent updated my homelab XO instance this morning to try this out since its been merged. Seems like concurrency has changed if the field is left empty? It used to default to 2 but now i see it trying to back up every VM in the job at once? I dont think this is the case anymore, its just the completed tasks do not update their progress and clear properly.

              Under the "Backups" Tab in the XO the backup says successful, however none of the concurrent backup tasks have completed under tasks. Looking at the backup "Remote" storage i see it still appears to be writing data so perhaps the job is not actually complete as XO states. --This was the merge operation happening in the background as it turns out the job was actually complete however the tasks were not clearing.

              F 1 Reply Last reply Reply Quote 0
              • F Offline
                flakpyro @flakpyro
                last edited by flakpyro

                @florent Backup did seem to run however the tasks never cleared. I restarted the toolstack on both hosts which cleared the tasks.

                Set job concurrency to 2 manually on the job and ran it again. Once again the task list filled with all the VMs from the job at once, the job seems to process and succeed but the tasks never clear and you cant really tell whats happening since the task window becomes cluttered with VMs from the job with a random state of progress that never seems to clear on its own. I think ill have to roll back to a previous release for now. Hopefully this plan isn't to push this to the XOA appliance just yet!

                Stuck tasks:
                10ab8402-447e-4d4b-8155-7586661133bf-image.png

                Yet completed and successful job:
                d0515313-1e01-4c3f-8749-fb83f080a068-image.png

                1 Reply Last reply Reply Quote 0
                • A Offline
                  Andrew Top contributor @florent
                  last edited by

                  @florent @olivierlambert Not good!... I reverted back due to problems.

                  Replication does run. It seems to work. But it leaves lots of zombie export tasks, like:
                  Exporting content of VDI ftp_root_jgfkd through NBD+CBT (on xcp1) 17%

                  I get about 80% stuck tasks. A toolstack restart clears the tasks....
                  CR settings: CBT enabled. NBD=2. Purge enabled.

                  F 1 Reply Last reply Reply Quote 0
                  • F Offline
                    flakpyro @Andrew
                    last edited by

                    @Andrew I am having the exact same issue! Also rolling back! Glad its not just me haha

                    A 1 Reply Last reply Reply Quote 0
                    • A Offline
                      Andrew Top contributor @flakpyro
                      last edited by

                      @flakpyro @florent I had the same problem with the test branch that did not get solved.

                      1 Reply Last reply Reply Quote 0
                      • florentF Offline
                        florent Vates 🪐 XO Team
                        last edited by

                        thabnks for the test
                        are you doing replication only ? or is a job doiing replication and backup ?

                        F A 2 Replies Last reply Reply Quote 0
                        • F Offline
                          flakpyro @florent
                          last edited by

                          @florent I am just running a "Delta Backup" to an NFS SR. I haven't rolled back yet so if there is any sort of logs i can provide let me know. This is my "home lab" at home where i test new versions of XOA and XCP-NG updates before we end up seeing new features in production with our full XOA appliance at work. 🙂

                          1 Reply Last reply Reply Quote 0
                          • A Offline
                            Andrew Top contributor @florent
                            last edited by

                            @florent The job is just Continuous Replication to another local host. These were normal hourly delta transfers.

                            1 Reply Last reply Reply Quote 0
                            • Tristis OrisT Offline
                              Tristis Oris Top contributor
                              last edited by

                              Same. Delta, 2 threads, 2 runing, but jobs not cleared.
                              b15d31c5-b0ad-407f-a1bc-b615510a9acf-image.png

                              1 Reply Last reply Reply Quote 0
                              • Tristis OrisT Offline
                                Tristis Oris Top contributor
                                last edited by

                                Continuous Replication failed with Error: HANDLE_INVALID(VDI, OpaqueRef:db811593-f18e-7d15-ea8a-465bf7a94917)

                                1 Reply Last reply Reply Quote 0
                                • AtaxyaNetworkA AtaxyaNetwork referenced this topic
                                • M Offline
                                  manilx @florent
                                  last edited by

                                  @florent https://xcp-ng.org/forum/topic/10857/suddenly-backup-ends-but-tasks-remain-in-task-list/4

                                  Rolled back and will stay there until this is fixed. Gave me heart attack....

                                  1 Reply Last reply Reply Quote 0
                                  • florentF Offline
                                    florent Vates 🪐 XO Team
                                    last edited by

                                    PR for unclosd task should reach master today
                                    https://github.com/vatesfr/xen-orchestra/pull/8590

                                    @Tristis-Oris vould you share ( by direct message if you prefer ) the rapport of the failed replication ?

                                    fbeauchamp opened this pull request in vatesfr/xen-orchestra

                                    closed fix(@xen-orchestra/xapi): really stop xapi task #8590

                                    Tristis OrisT A M 4 Replies Last reply Reply Quote 1
                                    • Tristis OrisT Offline
                                      Tristis Oris Top contributor @florent
                                      last edited by

                                      @florent https://pastebin.com/vhLXZ94F

                                      florentF 1 Reply Last reply Reply Quote 1
                                      • florentF Offline
                                        florent Vates 🪐 XO Team @Tristis Oris
                                        last edited by florent

                                        @Tristis-Oris thanks, but it is marked as a private pastebin

                                        Tristis OrisT 1 Reply Last reply Reply Quote 0
                                        • Tristis OrisT Offline
                                          Tristis Oris Top contributor @florent
                                          last edited by Tristis Oris

                                          @florent weird.. it say Pending Moderation. log is too huge to post here.

                                          check pm. it should work.

                                          1 Reply Last reply Reply Quote 0
                                          • A Offline
                                            Andrew Top contributor @florent
                                            last edited by

                                            @florent On a quick CR test, fix_nbd_progress works correctly for me.

                                            1 Reply Last reply Reply Quote 2
                                            • First post
                                              Last post