XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Endless Xapi#getResource /rrd_updates in tasks list

    Scheduled Pinned Locked Moved XCP-ng
    85 Posts 10 Posters 29.6k Views 10 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • 1 Offline
      14wkinnersley @olivierlambert
      last edited by

      @olivierlambert Correct, toolstack has been restarted on the master. I have not tried any reboots yet of my hosts in the cluster, or of XO.

      1 Reply Last reply Reply Quote 0
      • 1 Offline
        14wkinnersley
        last edited by 14wkinnersley

        Just wanted to provide some additional details/screenshots to help in anyway possible.

        My configuration has the master host at 192.168.1.4
        I have 3 hosts in the cluster.
        XO is on a Ubuntu VM at 192.168.1.15
        Firewall at my router is allowing all traffic in that same VLAN.
        Seems to gain 1-2 hanging logs every 1-4 minutes. I can ping the hosts from XO VM using either IP or DNS name.

        Task List:
        Screenshot 2024-03-27 081251.png

        Host - Master:
        Screenshot 2024-03-27 081306.png

        Commit:
        Screenshot 2024-03-27 081333.png

        1 Reply Last reply Reply Quote 0
        • olivierlambertO Offline
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by

          Can you try to destroy your XO folder, re-pull, rebuid to be sure there's no leftovers?

          1 2 Replies Last reply Reply Quote 0
          • 1 Offline
            14wkinnersley @olivierlambert
            last edited by

            @olivierlambert Will try it now and report back

            1 Reply Last reply Reply Quote 0
            • 1 Offline
              14wkinnersley @olivierlambert
              last edited by

              @olivierlambert
              No luck. Destroyed xo folder, rebooted, rebuilt xo from sources, restarted toolstack. Still having the logs building.

              1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by

                Okay thanks, we'll try to see if we can reproduce it here.

                MathieuM 1 Reply Last reply Reply Quote 1
                • MathieuM Offline
                  Mathieu @olivierlambert
                  last edited by

                  @olivierlambert
                  I can also confirm that the issue is still there on my host with XO updated to master with latest commit a548a.

                  1 Reply Last reply Reply Quote 0
                  • U Offline
                    uwood
                    last edited by

                    It is gone with a548a after I've restarted XO and toolstack.

                    1 Reply Last reply Reply Quote 0
                    • olivierlambertO Offline
                      olivierlambert Vates 🪐 Co-Founder CEO
                      last edited by

                      That's confusing. @Mathieu do you confirm?

                      MathieuM U 2 Replies Last reply Reply Quote 0
                      • MathieuM Offline
                        Mathieu @olivierlambert
                        last edited by

                        @olivierlambert
                        Yes, confusing, indeed 😄
                        I just now restarted XO and the toolstack one more time to be sure. Yesterday, it was OK at the beginning but the issue reappeared after a few hours.
                        I'll let you know ASAP.

                        1 Reply Last reply Reply Quote 1
                        • olivierlambertO Offline
                          olivierlambert Vates 🪐 Co-Founder CEO
                          last edited by

                          Thanks!

                          1 Reply Last reply Reply Quote 0
                          • U Offline
                            uwood @olivierlambert
                            last edited by

                            @olivierlambert now, about 10 hours after restart of XO and Toolstack I have two task too.

                            49a02320-a8b3-4953-b3f1-c0b1d7ce27d0-image.png

                            1 Reply Last reply Reply Quote 0
                            • olivierlambertO Offline
                              olivierlambert Vates 🪐 Co-Founder CEO
                              last edited by

                              Thanks, might be useful for @julien-f

                              MathieuM 1 Reply Last reply Reply Quote 0
                              • MathieuM Offline
                                Mathieu @olivierlambert
                                last edited by

                                @olivierlambert
                                Same on my host, the first stuck task appeared 5 hours after toolstack and XO reboot.

                                1 Reply Last reply Reply Quote 0
                                • U Offline
                                  uwood
                                  last edited by

                                  8b7e1 still got the tasks

                                  U 2 Replies Last reply Reply Quote 0
                                  • U Offline
                                    uwood @uwood
                                    last edited by

                                    c5767591-21cb-49cb-bb92-f5d14d9a090f-image.png

                                    1 Reply Last reply Reply Quote 0
                                    • U Offline
                                      uwood @uwood
                                      last edited by

                                      @uwood 0794a still some tasks

                                      1 Reply Last reply Reply Quote 0
                                      • olivierlambertO Offline
                                        olivierlambert Vates 🪐 Co-Founder CEO
                                        last edited by

                                        That's tricky, @julien-f couldn't reproduce it in our lab. So we'll need more details on your setup guys.

                                        1 1 Reply Last reply Reply Quote 0
                                        • 1 Offline
                                          14wkinnersley @olivierlambert
                                          last edited by

                                          @olivierlambert
                                          I have one pool, and three Nodes in my pool.
                                          Node 1 – Dell R420, 2x 10gb NICs (Master) – 192.168.1.4
                                          Node 2 – Dell R620, 2x 10gb NICs – 192.168.1.7
                                          Node 3 – Dell R420, 2x 10gb NICs – 192.168.1.3
                                          XO VM – Ubuntu 22.04.4 LTS – 192.168.1.15

                                          Each Node has a Bond of NIC 2 + 3. (Node 2 with the R620 has the mac addresses re-assigned to work correctly)

                                          Above each node, network wise, is 2x switches (2x Unifi USW-Agg) and I use the Unifi Dream Machine Pro as my router. I am able to ping the other Nodes from each Node.

                                          Local DNS utilizes Technitium DNS (Primary & Secondary), as a recursive DNS.

                                          My SR’s are two iSCSI datastores that run on a separate server running TrueNAS Scale on a Dell R320.

                                          Within my pools, I run about 25x virtual machines. I run nightly backups for ~5 VM’s, and weekly backup’s for all VM’s. Backups have a remote NFS storage location hosted on a separate server. I have 3 VM’s that run on separate network vlans than the rest, and those networks are setup under the pool, and upstream on the router.

                                          Plugins, I have the following enabled
                                          • Backup-reports
                                          • Load-balancer (performance mode)
                                          • Perf-alert
                                          • Transport-email
                                          • Usage-report

                                          From my testing, this was introduced with commit 6c16055 - Mar 15. I have since rolled back to c6451cf and have stayed on this commit for the past several days.

                                          1 Reply Last reply Reply Quote 0
                                          • olivierlambertO Offline
                                            olivierlambert Vates 🪐 Co-Founder CEO
                                            last edited by

                                            Thanks for the details @14wkinnersley !

                                            MathieuM 1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post