XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    XO Community edition backups dont work as of build 6b263

    Scheduled Pinned Locked Moved Backup
    64 Posts 17 Posters 2.1k Views 15 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M Offline
      manilx @archw
      last edited by

      @archw I can confirm this. My backup start with the first 2 VM's being backed up but then stall.

      Reverted back.

      1 Reply Last reply Reply Quote 0
      • M manilx referenced this topic
      • olivierlambertO Online
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        Hi,

        Thanks for the report, I'm making sure it's known internally. Ping @lsouai-vates

        U 1 Reply Last reply Reply Quote 1
        • U Offline
          uwood @olivierlambert
          last edited by

          Same here, all backups fail with 6b263

          1 Reply Last reply Reply Quote 2
          • W Offline
            wf
            last edited by

            I am currently experiencing this issue since updating to the latest version.

            How do I roll back to a previous commit? So that I can at least try to get a backup tonight.

            Thanks

            DanpD 1 Reply Last reply Reply Quote 0
            • DanpD Offline
              Danp Pro Support Team @wf
              last edited by

              @wf said in XO Community edition backups dont work as of build 6b263:

              How do I roll back to a previous commit?

              git checkout <target commit>

              Then rebuild with yarn; yarn build

              W D 2 Replies Last reply Reply Quote 1
              • A Offline
                aseba
                last edited by aseba

                Hi,

                Having the same issue, took me a while to figure out that it was a bug as the last backup got interrupted during a power failure and I thought the issues was to do with that! I reverted to a snapshot pre xoa update and it seems to be working now.

                1 Reply Last reply Reply Quote 0
                • W Offline
                  wf @Danp
                  last edited by

                  @Danp

                  You’re a star!
                  Backups now working again using commit 19412

                  Thanks

                  1 Reply Last reply Reply Quote 0
                  • florentF Offline
                    florent Vates 🪐 XO Team
                    last edited by florent

                    @archw said in XO Community edition backups dont work as of build 6b263:

                    The last argument to .catch() must be a function, got [object Object]

                    thanks for the reports
                    we are testing the fix ( https://github.com/vatesfr/xen-orchestra/pull/8739 )

                    This may be bigger than a simple typo, this code last changes was 2 years ago
                    We reworked the timeout/retry mechanic of the unlink method as that doesn't perform as well as expected on some object storage backend, expecting new clues on how to improve the situation.
                    And you reports (24h after the merges) pointed us to a possible solution : We were deleting up to 10^depth files in parallel instead of 2^depth.

                    fbeauchamp opened this pull request in vatesfr/xen-orchestra

                    closed fix(fs): fix 'The last argument to .catch() must be a function, got […object Object]' #8739

                    U 1 Reply Last reply Reply Quote 0
                    • U Offline
                      uwood @florent
                      last edited by

                      @florent commit 035f5 still seems not to work. Meta Data Backup lasts a few seconds but now it is starting for 2 minutes without doing anything.

                      florentF 1 Reply Last reply Reply Quote 0
                      • florentF Offline
                        florent Vates 🪐 XO Team @uwood
                        last edited by

                        @uwood a metadata backup shouldn't trigger any timeout
                        I am retesting it

                        U 1 Reply Last reply Reply Quote 0
                        • U Offline
                          uwood @florent
                          last edited by

                          @florent meta data backups make the same problems as normal backups. with commit 85868 the problem still exists.

                          U 1 Reply Last reply Reply Quote 0
                          • A acebmxer referenced this topic
                          • U Offline
                            uwood @uwood
                            last edited by uwood

                            commit 040ae Meta Data Backup fails now instantly.

                            7974a4f9-10b9-41b4-a3ea-941cc95272ca-image.png

                            florentF 1 Reply Last reply Reply Quote 0
                            • florentF Offline
                              florent Vates 🪐 XO Team @uwood
                              last edited by

                              @uwood the fix regarding the "catch" error is still in review, will probably be merged in a few hours

                              the second fix regarding the stuck stream ( so pool metadata, full backup and disaster recovery) is merged . This one was effectively added in friday's PR

                              florentF 1 Reply Last reply Reply Quote 0
                              • florentF Offline
                                florent Vates 🪐 XO Team @florent
                                last edited by

                                second fix is merged
                                Can you retest master, latest commit ?

                                A U 2 Replies Last reply Reply Quote 1
                                • A Offline
                                  aseba @florent
                                  last edited by

                                  @florent Just updated, and the pool metadata and XO config backup seems to be working. Running the main back up right now and seems to be running fine.

                                  K 1 Reply Last reply Reply Quote 0
                                  • U Offline
                                    uwood @florent
                                    last edited by

                                    @florent commit 1a7b5 seems to work now. meta backup has run succesfully and other backup has run ok too.

                                    1 Reply Last reply Reply Quote 2
                                    • K Offline
                                      katapaltes @aseba
                                      last edited by katapaltes

                                      I've updated to the latest master as well (1a7b5) and my metadata/config backups completed successfully, as did my smaller test backup. However, only 16 of 19 VMs in my main backup job completed. I am re-running the main backup now and will report back if the error recurs.

                                      Update: The job is still running, but here is the error from the three VMs that failed previously: "Error: invalid HTTP header in response body"

                                      A florentF 2 Replies Last reply Reply Quote 1
                                      • A Offline
                                        aseba @katapaltes
                                        last edited by

                                        @katapaltes I did have that HTTP error before, but everything is running successfully now. I'm getting " cleanVm: incorrect backup size in metadata" on all the VMs, but not sure if that's related - it was happening before so not sure if it's related to my power faliure.

                                        K 1 Reply Last reply Reply Quote 0
                                        • K Offline
                                          katapaltes @aseba
                                          last edited by katapaltes

                                          Yes, you will always see those "cleanVm: incorrect backup size in metadata" warnings, and Vates has said that it's OK to ignore them. You won't see them if you "Store backup as multiple data blocks instead of a whole VHD file," but your storage will need to support the required 500-1000 files per backed up GB (and of course you'll need to evaluate whether you wish to use multiple data blocks instead of VHD files in the first place).

                                          I re-ran my backups and the three VMs that failed backup previously have now succeeded.

                                          1 Reply Last reply Reply Quote 2
                                          • marcoiM Offline
                                            marcoi
                                            last edited by

                                            posted in the other thread as well but Xen Orchestra, commit 1a7b5 backups are working again. I tested configure and vm backups. They are being backup to NFS share.

                                            1 Reply Last reply Reply Quote 2
                                            • First post
                                              Last post