XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Broken backup logs

    Scheduled Pinned Locked Moved Xen Orchestra
    bugsplanned
    18 Posts 5 Posters 1.8k Views 6 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A Offline
      Andrew Top contributor
      last edited by marcungeschikts

      My backup logs suddenly broke... under the logs all I get is:

      an error has occurred
      

      I don't think this is a coding error as my other XOs work. I'm on XO source (or XOCE) current master.

      I looked at the XO linux server logs and I don't see an error, or it's not obvious.
      When should I look?
      Is there a way to reset/clear/delete the backup logs (a needed option anyway)?

      julien-fJ 1 Reply Last reply Reply Quote 0
      • olivierlambertO Online
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        Pinging @julien-f

        1 Reply Last reply Reply Quote 0
        • julien-fJ Offline
          julien-f Vates 🪐 Co-Founder XO Team @Andrew
          last edited by

          @Andrew You can delete the last 100 backup logs with the following command:

          xo-server-logs --delete namespace=jobs
          

          For more info: xo-server-logs --help

          A S 2 Replies Last reply Reply Quote 1
          • A Offline
            Andrew Top contributor @julien-f
            last edited by Andrew

            @julien-f Where do I find xo-server-logs ?

            I can run xo-cli log.get namespace=jobs and I do get data, so it's there but the XO app seems to have problems with it but I don't see an error in the logs.

            julien-fJ 1 Reply Last reply Reply Quote 0
            • julien-fJ Offline
              julien-f Vates 🪐 Co-Founder XO Team @Andrew
              last edited by

              @Andrew xo-server/dist/logs-cli.mjs

              I can run xo-cli log.get namespace=jobs and I do get data, so it's there but the XO app seems to have problems with it but I don't see an error in the logs.

              The logs are there but there may be malformed which breaks the UI.

              A 2 Replies Last reply Reply Quote 0
              • A Offline
                Andrew Top contributor @julien-f
                last edited by

                @julien-f I just had to delete all of them...

                1 Reply Last reply Reply Quote 0
                • A Offline
                  Andrew Top contributor @julien-f
                  last edited by

                  @julien-f It happened again... It ran the normal S3 delta backup at night and in the morning the backup logs are broken in the GUI.

                  julien-fJ 1 Reply Last reply Reply Quote 0
                  • julien-fJ Offline
                    julien-f Vates 🪐 Co-Founder XO Team @Andrew
                    last edited by

                    @Andrew Please use xo-server-logs --json --limit 1000 namespace=jobs | gzip > logs.json.gz and send me the file. Hopefully I will be able to see what breaks the UI.

                    Also, please check your browser console and past me the error.

                    1 Reply Last reply Reply Quote 0
                    • S Offline
                      sasha @julien-f
                      last edited by

                      @julien-f said in Broken backup logs:

                      @Andrew You can delete the last 100 backup logs with the following command:

                      xo-server-logs --delete namespace=jobs
                      

                      For more info: xo-server-logs --help

                      Logs are not deleted with this command for some reason without errors. May be I can remove it from filesystem?

                      julien-fJ S 2 Replies Last reply Reply Quote 0
                      • julien-fJ Offline
                        julien-f Vates 🪐 Co-Founder XO Team @sasha
                        last edited by

                        @sasha This command only removes the last 100 log entries, if you want to remove more, check the --limit flag.

                        S 1 Reply Last reply Reply Quote 0
                        • S Offline
                          sasha @sasha
                          last edited by

                          @sasha said in Broken backup logs:

                          @julien-f said in Broken backup logs:

                          @Andrew You can delete the last 100 backup logs with the following command:

                          xo-server-logs --delete namespace=jobs
                          

                          For more info: xo-server-logs --help

                          Logs are not deleted with this command for some reason without errors. May be I can remove it from filesystem?

                          Tried that too:

                          root@xoa-local:~# /opt/xen-orchestra/packages/xo-server/dist/logs-cli.mjs namespace=jobs| wc -l
                          1170
                          
                          root@xoa-local:~# /opt/xen-orchestra/packages/xo-server/dist/logs-cli.mjs namespace=jobs --delete --1000
                          root@xoa-local:~# /opt/xen-orchestra/packages/xo-server/dist/logs-cli.mjs namespace=jobs| wc -l
                          1170
                          

                          No luck.. 🙂

                          A 1 Reply Last reply Reply Quote 0
                          • A Offline
                            Andrew Top contributor @sasha
                            last edited by

                            @sasha
                            logs-cli.mjs --delete --limit=10000 namespace=jobs

                            After deleting my logs it worked, then the problem happened again. I deleted the logs again, now I'm not having the log problem...

                            1 Reply Last reply Reply Quote 0
                            • S Offline
                              sasha @julien-f
                              last edited by

                              @julien-f said in Broken backup logs:

                              @sasha This command only removes the last 100 log entries, if you want to remove more, check the --limit flag.

                              Ok, after some iteration now jobs log is empty. Thank you!

                              julien-fJ 1 Reply Last reply Reply Quote 0
                              • julien-fJ Offline
                                julien-f Vates 🪐 Co-Founder XO Team @sasha
                                last edited by

                                In case it happens again, please let me know what error message you have in your browser's console, it will help us understand the root cause.

                                U 1 Reply Last reply Reply Quote 1
                                • U Offline
                                  usbalbin @julien-f
                                  last edited by

                                  @julien-f same error. Running Xo from sources(have not checked the version yet)

                                  Uncaught TypeError: Cannot read properties of undefined (reading 'size')
                                      at restore-metadata.js:142:50
                                      at Array.forEach (<anonymous>)
                                      at restore-metadata.js:134:26
                                      at Array.forEach (<anonymous>)
                                      at restore-metadata.js:130:29
                                      at Array.forEach (<anonymous>)
                                      at itemRenderer (restore-metadata.js:127:15)
                                      at index.js:681:11
                                      at t.exports (_arrayMap.js:16:1)
                                      at t.exports (map.js:49:1)
                                  (anonymous) @ restore-metadata.js:142
                                  (anonymous) @ restore-metadata.js:134
                                  (anonymous) @ restore-metadata.js:130
                                  itemRenderer @ restore-metadata.js:127
                                  (anonymous) @ index.js:681
                                  t.exports @ _arrayMap.js:16
                                  t.exports @ map.js:49
                                  (anonymous) @ index.js:674
                                  t.exports @ _arrayMap.js:16
                                  t.exports @ map.js:49
                                  render @ index.js:901
                                  r @ index.js:22
                                  _renderValidatedComponentWithoutOwnerOrContext @ ReactCompositeComponent.js:796
                                  _renderValidatedComponent @ ReactCompositeComponent.js:819
                                  _updateRenderedComponent @ ReactCompositeComponent.js:743
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  updateChildren @ ReactChildReconciler.js:107
                                  _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                  _updateChildren @ ReactMultiChild.js:308
                                  updateChildren @ ReactMultiChild.js:295
                                  _updateDOMChildren @ ReactDOMComponent.js:944
                                  updateComponent @ ReactDOMComponent.js:758
                                  receiveComponent @ ReactDOMComponent.js:720
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  updateChildren @ ReactChildReconciler.js:107
                                  _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                  _updateChildren @ ReactMultiChild.js:308
                                  updateChildren @ ReactMultiChild.js:295
                                  _updateDOMChildren @ ReactDOMComponent.js:944
                                  updateComponent @ ReactDOMComponent.js:758
                                  receiveComponent @ ReactDOMComponent.js:720
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  performUpdateIfNecessary @ ReactCompositeComponent.js:558
                                  performUpdateIfNecessary @ ReactReconciler.js:154
                                  performUpdateIfNecessary @ react_devtools_backend.js:15327
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _ @ ReactUpdates.js:148
                                  perform @ Transaction.js:141
                                  perform @ Transaction.js:141
                                  perform @ ReactUpdates.js:87
                                  w @ ReactUpdates.js:170
                                  closeAll @ Transaction.js:207
                                  perform @ Transaction.js:154
                                  batchedUpdates @ ReactDefaultBatchingStrategy.js:60
                                  e @ ReactUpdates.js:198
                                  i @ ReactUpdateQueue.js:22
                                  enqueueSetState @ ReactUpdateQueue.js:216
                                  s.setState @ ReactBaseClasses.js:62
                                  u.onStateChange @ connectAdvanced.js:224
                                  notify @ Subscription.js:27
                                  t.notifyNestedSubs @ Subscription.js:66
                                  u.onStateChange @ connectAdvanced.js:221
                                  notify @ Subscription.js:27
                                  t.notifyNestedSubs @ Subscription.js:66
                                  u.onStateChange @ connectAdvanced.js:221
                                  notify @ Subscription.js:27
                                  t.notifyNestedSubs @ Subscription.js:66
                                  u.onStateChange @ connectAdvanced.js:221
                                  y @ redux.js:304
                                  (anonymous) @ index.js:27
                                  (anonymous) @ index.js:123
                                  v @ debounce.js:95
                                  y @ debounce.js:105
                                  M @ debounce.js:172
                                  (anonymous) @ index.js:153
                                  f @ events.js:106
                                  i.emit @ events.js:184
                                  (anonymous) @ index.js:61
                                  (anonymous) @ index.js:41
                                  n._handle @ index.js:40
                                  (anonymous) @ index.js:161
                                  c @ runtime.js:63
                                  (anonymous) @ runtime.js:294
                                  (anonymous) @ runtime.js:119
                                  n @ asyncToGenerator.js:3
                                  s @ asyncToGenerator.js:25
                                  (anonymous) @ asyncToGenerator.js:32
                                  (anonymous) @ asyncToGenerator.js:21
                                  (anonymous) @ index.js:182
                                  f.write @ index.js:290
                                  (anonymous) @ index.js:69
                                  f @ events.js:106
                                  i.emit @ events.js:184
                                  (anonymous) @ websocket-client.js:177
                                  setTimeout (async)
                                  r.default @ notification.js:5
                                  r @ index.js:24
                                  _renderValidatedComponentWithoutOwnerOrContext @ ReactCompositeComponent.js:796
                                  _renderValidatedComponent @ ReactCompositeComponent.js:819
                                  _updateRenderedComponent @ ReactCompositeComponent.js:743
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  updateChildren @ ReactChildReconciler.js:107
                                  _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                  _updateChildren @ ReactMultiChild.js:308
                                  updateChildren @ ReactMultiChild.js:295
                                  _updateDOMChildren @ ReactDOMComponent.js:944
                                  updateComponent @ ReactDOMComponent.js:758
                                  receiveComponent @ ReactDOMComponent.js:720
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  updateChildren @ ReactChildReconciler.js:107
                                  _reconcilerUpdateChildren @ ReactMultiChild.js:209
                                  _updateChildren @ ReactMultiChild.js:308
                                  updateChildren @ ReactMultiChild.js:295
                                  _updateDOMChildren @ ReactDOMComponent.js:944
                                  updateComponent @ ReactDOMComponent.js:758
                                  receiveComponent @ ReactDOMComponent.js:720
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  receiveComponent @ ReactCompositeComponent.js:544
                                  receiveComponent @ ReactReconciler.js:122
                                  receiveComponent @ react_devtools_backend.js:15365
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _updateRenderedComponent @ ReactCompositeComponent.js:751
                                  _performComponentUpdate @ ReactCompositeComponent.js:721
                                  updateComponent @ ReactCompositeComponent.js:642
                                  performUpdateIfNecessary @ ReactCompositeComponent.js:558
                                  performUpdateIfNecessary @ ReactReconciler.js:154
                                  performUpdateIfNecessary @ react_devtools_backend.js:15327
                                  object.<computed> @ react_devtools_backend.js:15088
                                  _ @ ReactUpdates.js:148
                                  perform @ Transaction.js:141
                                  perform @ Transaction.js:141
                                  perform @ ReactUpdates.js:87
                                  w @ ReactUpdates.js:170
                                  closeAll @ Transaction.js:207
                                  perform @ Transaction.js:154
                                  batchedUpdates @ ReactDefaultBatchingStrategy.js:60
                                  e @ ReactUpdates.js:198
                                  i @ ReactUpdateQueue.js:22
                                  enqueueSetState @ ReactUpdateQueue.js:216
                                  s.setState @ ReactBaseClasses.js:62
                                  u.onStateChange @ connectAdvanced.js:224
                                  notify @ Subscription.js:27
                                  t.notifyNestedSubs @ Subscription.js:66
                                  u.onStateChange @ connectAdvanced.js:221
                                  notify @ Subscription.js:27
                                  t.notifyNestedSubs @ Subscription.js:66
                                  u.onStateChange @ connectAdvanced.js:221
                                  notify @ Subscription.js:27
                                  t.notifyNestedSubs @ Subscription.js:66
                                  u.onStateChange @ connectAdvanced.js:221
                                  y @ redux.js:304
                                  (anonymous) @ index.js:27
                                  (anonymous) @ index.js:123
                                  v @ debounce.js:95
                                  y @ debounce.js:105
                                  M @ debounce.js:172
                                  (anonymous) @ index.js:153
                                  f @ events.js:106
                                  i.emit @ events.js:184
                                  (anonymous) @ index.js:61
                                  (anonymous) @ index.js:41
                                  n._handle @ index.js:40
                                  (anonymous) @ index.js:161
                                  c @ runtime.js:63
                                  (anonymous) @ runtime.js:294
                                  (anonymous) @ runtime.js:119
                                  n @ asyncToGenerator.js:3
                                  s @ asyncToGenerator.js:25
                                  (anonymous) @ asyncToGenerator.js:32
                                  (anonymous) @ asyncToGenerator.js:21
                                  (anonymous) @ index.js:182
                                  f.write @ index.js:290
                                  (anonymous) @ index.js:69
                                  f @ events.js:106
                                  i.emit @ events.js:184
                                  (anonymous) @ websocket-client.js:177
                                  Show 264 more frames
                                  
                                  U 1 Reply Last reply Reply Quote 0
                                  • U Offline
                                    usbalbin @usbalbin
                                    last edited by

                                    @usbalbin with last commit being

                                    commit ad5691dcb24c554945b7e32e91bc6cdc64a8c65d (HEAD -> master, origin/master, origin/HEAD)
                                    Author: Julien Fontanet <julien.fontanet@isonoe.net>
                                    Date:   Fri May 27 12:52:19 2022 +0200
                                    
                                        feat(self-signed): improve compat with OpenSSL 3
                                        
                                        `-key -` appears to no longer be supported, generating the key in the same step works better.
                                        
                                        It's still compatible with OpenSSL 1.
                                    
                                    julien-fJ 1 Reply Last reply Reply Quote 0
                                    • julien-fJ Offline
                                      julien-f Vates 🪐 Co-Founder XO Team @usbalbin
                                      last edited by

                                      Should be fixed, please test and keep us posted 🙂

                                      https://github.com/vatesfr/xen-orchestra/commit/05a96ffc146e58aed5eef4bd7cf2cfaa1e19ed24

                                      0 fbeauchamp committed to vatesfr/xen-orchestra
                                      fix(xo-web):  handle missing result of broken merge tasks in backup logs (#6275)
                                      A 1 Reply Last reply Reply Quote 0
                                      • A Offline
                                        Andrew Top contributor @julien-f
                                        last edited by

                                        @julien-f Thanks. I'll post an update if I hit the problem again.

                                        1 Reply Last reply Reply Quote 0
                                        • A Ascar referenced this topic on
                                        • First post
                                          Last post