XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Broken backup logs

    Scheduled Pinned Locked Moved Xen Orchestra
    bugsplanned
    18 Posts 5 Posters 1.8k Views 6 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Online
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      Pinging @julien-f

      1 Reply Last reply Reply Quote 0
      • julien-fJ Offline
        julien-f Vates 🪐 Co-Founder XO Team @Andrew
        last edited by

        @Andrew You can delete the last 100 backup logs with the following command:

        xo-server-logs --delete namespace=jobs
        

        For more info: xo-server-logs --help

        A S 2 Replies Last reply Reply Quote 1
        • A Offline
          Andrew Top contributor @julien-f
          last edited by Andrew

          @julien-f Where do I find xo-server-logs ?

          I can run xo-cli log.get namespace=jobs and I do get data, so it's there but the XO app seems to have problems with it but I don't see an error in the logs.

          julien-fJ 1 Reply Last reply Reply Quote 0
          • julien-fJ Offline
            julien-f Vates 🪐 Co-Founder XO Team @Andrew
            last edited by

            @Andrew xo-server/dist/logs-cli.mjs

            I can run xo-cli log.get namespace=jobs and I do get data, so it's there but the XO app seems to have problems with it but I don't see an error in the logs.

            The logs are there but there may be malformed which breaks the UI.

            A 2 Replies Last reply Reply Quote 0
            • A Offline
              Andrew Top contributor @julien-f
              last edited by

              @julien-f I just had to delete all of them...

              1 Reply Last reply Reply Quote 0
              • A Offline
                Andrew Top contributor @julien-f
                last edited by

                @julien-f It happened again... It ran the normal S3 delta backup at night and in the morning the backup logs are broken in the GUI.

                julien-fJ 1 Reply Last reply Reply Quote 0
                • julien-fJ Offline
                  julien-f Vates 🪐 Co-Founder XO Team @Andrew
                  last edited by

                  @Andrew Please use xo-server-logs --json --limit 1000 namespace=jobs | gzip > logs.json.gz and send me the file. Hopefully I will be able to see what breaks the UI.

                  Also, please check your browser console and past me the error.

                  1 Reply Last reply Reply Quote 0
                  • S Offline
                    sasha @julien-f
                    last edited by

                    @julien-f said in Broken backup logs:

                    @Andrew You can delete the last 100 backup logs with the following command:

                    xo-server-logs --delete namespace=jobs
                    

                    For more info: xo-server-logs --help

                    Logs are not deleted with this command for some reason without errors. May be I can remove it from filesystem?

                    julien-fJ S 2 Replies Last reply Reply Quote 0
                    • julien-fJ Offline
                      julien-f Vates 🪐 Co-Founder XO Team @sasha
                      last edited by

                      @sasha This command only removes the last 100 log entries, if you want to remove more, check the --limit flag.

                      S 1 Reply Last reply Reply Quote 0
                      • S Offline
                        sasha @sasha
                        last edited by

                        @sasha said in Broken backup logs:

                        @julien-f said in Broken backup logs:

                        @Andrew You can delete the last 100 backup logs with the following command:

                        xo-server-logs --delete namespace=jobs
                        

                        For more info: xo-server-logs --help

                        Logs are not deleted with this command for some reason without errors. May be I can remove it from filesystem?

                        Tried that too:

                        root@xoa-local:~# /opt/xen-orchestra/packages/xo-server/dist/logs-cli.mjs namespace=jobs| wc -l
                        1170
                        
                        root@xoa-local:~# /opt/xen-orchestra/packages/xo-server/dist/logs-cli.mjs namespace=jobs --delete --1000
                        root@xoa-local:~# /opt/xen-orchestra/packages/xo-server/dist/logs-cli.mjs namespace=jobs| wc -l
                        1170
                        

                        No luck.. 🙂

                        A 1 Reply Last reply Reply Quote 0
                        • A Offline
                          Andrew Top contributor @sasha
                          last edited by

                          @sasha
                          logs-cli.mjs --delete --limit=10000 namespace=jobs

                          After deleting my logs it worked, then the problem happened again. I deleted the logs again, now I'm not having the log problem...

                          1 Reply Last reply Reply Quote 0
                          • S Offline
                            sasha @julien-f
                            last edited by

                            @julien-f said in Broken backup logs:

                            @sasha This command only removes the last 100 log entries, if you want to remove more, check the --limit flag.

                            Ok, after some iteration now jobs log is empty. Thank you!

                            julien-fJ 1 Reply Last reply Reply Quote 0
                            • julien-fJ Offline
                              julien-f Vates 🪐 Co-Founder XO Team @sasha
                              last edited by

                              In case it happens again, please let me know what error message you have in your browser's console, it will help us understand the root cause.

                              U 1 Reply Last reply Reply Quote 1
                              • U Offline
                                usbalbin @julien-f
                                last edited by

                                @julien-f same error. Running Xo from sources(have not checked the version yet)

                                Uncaught TypeError: Cannot read properties of undefined (reading 'size')
                                    at restore-metadata.js:142:50
                                    at Array.forEach (<anonymous>)
                                    at restore-metadata.js:134:26
                                    at Array.forEach (<anonymous>)
                                    at restore-metadata.js:130:29
                                    at Array.forEach (<anonymous>)
                                    at itemRenderer (restore-metadata.js:127:15)
                                    at index.js:681:11
                                    at t.exports (_arrayMap.js:16:1)
                                    at t.exports (map.js:49:1)
                                (anonymous) @ restore-metadata.js:142
                                (anonymous) @ restore-metadata.js:134
                                (anonymous) @ restore-metadata.js:130
                                itemRenderer @ restore-metadata.js:127
                                (anonymous) @ index.js:681
                                t.exports @ _arrayMap.js:16
                                t.exports @ map.js:49
                                (anonymous) @ index.js:674
                                t.exports @ _arrayMap.js:16
                                t.exports @ map.js:49
                                render @ index.js:901
                                r @ index.js:22
                                _renderValidatedComponentWithoutOwnerOrContext @ ReactCompositeComponent.js:796
                                _renderValidatedComponent @ ReactCompositeComponent.js:819
                                _updateRenderedComponent @ ReactCompositeComponent.js:743
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                updateChildren @ ReactChildReconciler.js:107
                                _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                _updateChildren @ ReactMultiChild.js:308
                                updateChildren @ ReactMultiChild.js:295
                                _updateDOMChildren @ ReactDOMComponent.js:944
                                updateComponent @ ReactDOMComponent.js:758
                                receiveComponent @ ReactDOMComponent.js:720
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                updateChildren @ ReactChildReconciler.js:107
                                _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                _updateChildren @ ReactMultiChild.js:308
                                updateChildren @ ReactMultiChild.js:295
                                _updateDOMChildren @ ReactDOMComponent.js:944
                                updateComponent @ ReactDOMComponent.js:758
                                receiveComponent @ ReactDOMComponent.js:720
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                performUpdateIfNecessary @ ReactCompositeComponent.js:558
                                performUpdateIfNecessary @ ReactReconciler.js:154
                                performUpdateIfNecessary @ react_devtools_backend.js:15327
                                object.<computed> @ react_devtools_backend.js:15088
                                _ @ ReactUpdates.js:148
                                perform @ Transaction.js:141
                                perform @ Transaction.js:141
                                perform @ ReactUpdates.js:87
                                w @ ReactUpdates.js:170
                                closeAll @ Transaction.js:207
                                perform @ Transaction.js:154
                                batchedUpdates @ ReactDefaultBatchingStrategy.js:60
                                e @ ReactUpdates.js:198
                                i @ ReactUpdateQueue.js:22
                                enqueueSetState @ ReactUpdateQueue.js:216
                                s.setState @ ReactBaseClasses.js:62
                                u.onStateChange @ connectAdvanced.js:224
                                notify @ Subscription.js:27
                                t.notifyNestedSubs @ Subscription.js:66
                                u.onStateChange @ connectAdvanced.js:221
                                notify @ Subscription.js:27
                                t.notifyNestedSubs @ Subscription.js:66
                                u.onStateChange @ connectAdvanced.js:221
                                notify @ Subscription.js:27
                                t.notifyNestedSubs @ Subscription.js:66
                                u.onStateChange @ connectAdvanced.js:221
                                y @ redux.js:304
                                (anonymous) @ index.js:27
                                (anonymous) @ index.js:123
                                v @ debounce.js:95
                                y @ debounce.js:105
                                M @ debounce.js:172
                                (anonymous) @ index.js:153
                                f @ events.js:106
                                i.emit @ events.js:184
                                (anonymous) @ index.js:61
                                (anonymous) @ index.js:41
                                n._handle @ index.js:40
                                (anonymous) @ index.js:161
                                c @ runtime.js:63
                                (anonymous) @ runtime.js:294
                                (anonymous) @ runtime.js:119
                                n @ asyncToGenerator.js:3
                                s @ asyncToGenerator.js:25
                                (anonymous) @ asyncToGenerator.js:32
                                (anonymous) @ asyncToGenerator.js:21
                                (anonymous) @ index.js:182
                                f.write @ index.js:290
                                (anonymous) @ index.js:69
                                f @ events.js:106
                                i.emit @ events.js:184
                                (anonymous) @ websocket-client.js:177
                                setTimeout (async)
                                r.default @ notification.js:5
                                r @ index.js:24
                                _renderValidatedComponentWithoutOwnerOrContext @ ReactCompositeComponent.js:796
                                _renderValidatedComponent @ ReactCompositeComponent.js:819
                                _updateRenderedComponent @ ReactCompositeComponent.js:743
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                updateChildren @ ReactChildReconciler.js:107
                                _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                _updateChildren @ ReactMultiChild.js:308
                                updateChildren @ ReactMultiChild.js:295
                                _updateDOMChildren @ ReactDOMComponent.js:944
                                updateComponent @ ReactDOMComponent.js:758
                                receiveComponent @ ReactDOMComponent.js:720
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                updateChildren @ ReactChildReconciler.js:107
                                _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                _updateChildren @ ReactMultiChild.js:308
                                updateChildren @ ReactMultiChild.js:295
                                _updateDOMChildren @ ReactDOMComponent.js:944
                                updateComponent @ ReactDOMComponent.js:758
                                receiveComponent @ ReactDOMComponent.js:720
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                receiveComponent @ ReactCompositeComponent.js:544
                                receiveComponent @ ReactReconciler.js:122
                                receiveComponent @ react_devtools_backend.js:15365
                                object.<computed> @ react_devtools_backend.js:15088
                                _updateRenderedComponent @ ReactCompositeComponent.js:751
                                _performComponentUpdate @ ReactCompositeComponent.js:721
                                updateComponent @ ReactCompositeComponent.js:642
                                performUpdateIfNecessary @ ReactCompositeComponent.js:558
                                performUpdateIfNecessary @ ReactReconciler.js:154
                                performUpdateIfNecessary @ react_devtools_backend.js:15327
                                object.<computed> @ react_devtools_backend.js:15088
                                _ @ ReactUpdates.js:148
                                perform @ Transaction.js:141
                                perform @ Transaction.js:141
                                perform @ ReactUpdates.js:87
                                w @ ReactUpdates.js:170
                                closeAll @ Transaction.js:207
                                perform @ Transaction.js:154
                                batchedUpdates @ ReactDefaultBatchingStrategy.js:60
                                e @ ReactUpdates.js:198
                                i @ ReactUpdateQueue.js:22
                                enqueueSetState @ ReactUpdateQueue.js:216
                                s.setState @ ReactBaseClasses.js:62
                                u.onStateChange @ connectAdvanced.js:224
                                notify @ Subscription.js:27
                                t.notifyNestedSubs @ Subscription.js:66
                                u.onStateChange @ connectAdvanced.js:221
                                notify @ Subscription.js:27
                                t.notifyNestedSubs @ Subscription.js:66
                                u.onStateChange @ connectAdvanced.js:221
                                notify @ Subscription.js:27
                                t.notifyNestedSubs @ Subscription.js:66
                                u.onStateChange @ connectAdvanced.js:221
                                y @ redux.js:304
                                (anonymous) @ index.js:27
                                (anonymous) @ index.js:123
                                v @ debounce.js:95
                                y @ debounce.js:105
                                M @ debounce.js:172
                                (anonymous) @ index.js:153
                                f @ events.js:106
                                i.emit @ events.js:184
                                (anonymous) @ index.js:61
                                (anonymous) @ index.js:41
                                n._handle @ index.js:40
                                (anonymous) @ index.js:161
                                c @ runtime.js:63
                                (anonymous) @ runtime.js:294
                                (anonymous) @ runtime.js:119
                                n @ asyncToGenerator.js:3
                                s @ asyncToGenerator.js:25
                                (anonymous) @ asyncToGenerator.js:32
                                (anonymous) @ asyncToGenerator.js:21
                                (anonymous) @ index.js:182
                                f.write @ index.js:290
                                (anonymous) @ index.js:69
                                f @ events.js:106
                                i.emit @ events.js:184
                                (anonymous) @ websocket-client.js:177
                                Show 264 more frames
                                
                                U 1 Reply Last reply Reply Quote 0
                                • U Offline
                                  usbalbin @usbalbin
                                  last edited by

                                  @usbalbin with last commit being

                                  commit ad5691dcb24c554945b7e32e91bc6cdc64a8c65d (HEAD -> master, origin/master, origin/HEAD)
                                  Author: Julien Fontanet <julien.fontanet@isonoe.net>
                                  Date:   Fri May 27 12:52:19 2022 +0200
                                  
                                      feat(self-signed): improve compat with OpenSSL 3
                                      
                                      `-key -` appears to no longer be supported, generating the key in the same step works better.
                                      
                                      It's still compatible with OpenSSL 1.
                                  
                                  julien-fJ 1 Reply Last reply Reply Quote 0
                                  • julien-fJ Offline
                                    julien-f Vates 🪐 Co-Founder XO Team @usbalbin
                                    last edited by

                                    Should be fixed, please test and keep us posted 🙂

                                    https://github.com/vatesfr/xen-orchestra/commit/05a96ffc146e58aed5eef4bd7cf2cfaa1e19ed24

                                    0 fbeauchamp committed to vatesfr/xen-orchestra
                                    fix(xo-web):  handle missing result of broken merge tasks in backup logs (#6275)
                                    A 1 Reply Last reply Reply Quote 0
                                    • A Offline
                                      Andrew Top contributor @julien-f
                                      last edited by

                                      @julien-f Thanks. I'll post an update if I hit the problem again.

                                      1 Reply Last reply Reply Quote 0
                                      • A Ascar referenced this topic on
                                      • First post
                                        Last post