XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    VM's going really slow after 3 - 4 weeks

    Scheduled Pinned Locked Moved Solved Compute
    36 Posts 9 Posters 5.1k Views 7 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B Offline
      Berrick @mjtbrady
      last edited by

      @mjtbrady

      We ran xentop after you suggested it but dont believe it shows anything?

      XentopAfterReboot.jpg

      Just recently we had notification of another lot of patch's which have been applied.

      So now we wait!

      1 Reply Last reply Reply Quote 0
      • DanpD Offline
        Danp Pro Support Team
        last edited by

        This doesn't look normal to me --
        05f778de-d7f5-40ac-a489-388327c8aff4-image.png

        Can you tell us more about this VM?

        GheppyG 1 Reply Last reply Reply Quote 0
        • GheppyG Offline
          Gheppy @Danp
          last edited by

          @Danp
          I have the same strange values on my server to
          7b9159c9-30e6-40e6-b982-54a5aab158cf-image.png

          DanpD 1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            100% = 1 vCPU full.

            GheppyG 1 Reply Last reply Reply Quote 0
            • GheppyG Offline
              Gheppy
              last edited by

              this is from one server with one VM
              6687a557-58b5-447a-8cd1-cd564c3387e8-image.png

              1 Reply Last reply Reply Quote 0
              • GheppyG Offline
                Gheppy @olivierlambert
                last edited by

                @olivierlambert
                so this means that in the last case I have 6 vCPU at 100% loade

                1 Reply Last reply Reply Quote 0
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  How many vCPUs you have assigned to this VM?

                  GheppyG 1 Reply Last reply Reply Quote 0
                  • GheppyG Offline
                    Gheppy @olivierlambert
                    last edited by

                    @olivierlambert
                    Server has 24 core and the VM 20

                    1 Reply Last reply Reply Quote 0
                    • olivierlambertO Offline
                      olivierlambert Vates 🪐 Co-Founder CEO
                      last edited by

                      So (roughly and IIRC), you are using 6,23 vCPUs at 100%.

                      1 Reply Last reply Reply Quote 0
                      • DanpD Offline
                        Danp Pro Support Team @Gheppy
                        last edited by

                        @Gheppy I was surprised to see a graylog VM using so much CPU, but maybe it's normal. 🤷

                        B 1 Reply Last reply Reply Quote 0
                        • GheppyG Offline
                          Gheppy
                          last edited by

                          Yes, it is a VM with a heavily used database.
                          At the moment I am trying to convince them to buy an XO license for this server.
                          I work for a public service and I have no say when it comes to money.

                          1 Reply Last reply Reply Quote 0
                          • B Offline
                            Berrick @Danp
                            last edited by Berrick

                            @Danp said in VM's going really slow after 3 - 4 weeks:

                            @Gheppy I was surprised to see a graylog VM using so much CPU, but maybe it's normal. 🤷

                            Not sure if Gheppy DB is graylog. Mine was and when I searched for an answer as to why the strange CPU utilization came up with the same answer Oliver supplied.

                            I would like to point out, as I didn't earlier, that the graylog cpu utilization in the xentop image I up loaded has been fixed so CPU util is much much less now.

                            However, the CPU utilization of that vm was also at the high levels after a server reboot so dont think its the answer to why all vm's slowly slow down

                            1 Reply Last reply Reply Quote 0
                            • olivierlambertO Offline
                              olivierlambert Vates 🪐 Co-Founder CEO
                              last edited by

                              What's the hardware behind it by the way?

                              1 Reply Last reply Reply Quote 0
                              • GheppyG Offline
                                Gheppy
                                last edited by Gheppy

                                My server is HP DL380 G9, CPU 2 x E5-2620 v3 @ 2.40GHz with 4xSSD and 16xHDD 2.5" and 128Gb RAM.
                                System ( XCP-ng and OS ) is on 4 x SSD RAID 10, DB is on 14 x HDD RAID 10.

                                B 1 Reply Last reply Reply Quote 0
                                • B Offline
                                  Berrick @Gheppy
                                  last edited by

                                  @Gheppy What is free disk space like on this VM?

                                  This is what caused the CPU's in our graylog server to go nuts. It had almost run out of free disk space. The only thing I have done was to increase free disk space by clearing out some of the older logs.

                                  72b922e6-3c6a-457e-984a-271e5ff95961-image.png

                                  B 1 Reply Last reply Reply Quote 0
                                  • GheppyG Offline
                                    Gheppy
                                    last edited by Gheppy

                                    There is free space, on real disks I have:

                                    • 4 x 400Gb SSD = 800Gb RAID 10, on which I have XCP-ng and the rest of the disk is with the first disk of the VM where is the operating system, which has 350 Gb allocated in which I have 2 partitions with 150 Gb SO and 200 Gb SQL log (for some speed). The occupied space being for SO 65Gb and for SQL log of 120Gb.

                                    • 14 x 1200Gb = 8.4Tb RAID 10, on which I have the rest of the database divided on 3 virtual disks of 2Tb with soft RAID in the OS ( which is windows ),the configuration is like this because of the XCP-ng limit of 2Tb per vdisk. The database currently has 3.7 Tb.

                                    tjkreidlT 1 Reply Last reply Reply Quote 0
                                    • tjkreidlT Offline
                                      tjkreidl Ambassador @Gheppy
                                      last edited by

                                      @Gheppy If you run top, how is the dom0 CPU load and how is the swap space? If dom0 is saturated it may need more memory allocated to it.

                                      GheppyG 1 Reply Last reply Reply Quote 0
                                      • GheppyG Offline
                                        Gheppy
                                        last edited by Gheppy

                                        This is a top img, swap it seems to be ok but memory is 103 Mb free of 7.4Gb.
                                        I will increase the memory for Xen. Thank you
                                        a4628398-2b29-4965-ae22-76500a7c151c-image.png

                                        1 Reply Last reply Reply Quote 0
                                        • GheppyG Offline
                                          Gheppy @tjkreidl
                                          last edited by

                                          @tjkreidl
                                          I increased the RAM for Xen to 10Gb and it is much better, maximum 156% on CPU on xentop.
                                          Thank you

                                          tjkreidlT 1 Reply Last reply Reply Quote 0
                                          • tjkreidlT Offline
                                            tjkreidl Ambassador @Gheppy
                                            last edited by

                                            @Gheppy You have to give dom0 enough CPU power for various reaasons: 1) to be able to not be bogged down, itself, 2) to allow VMs to be able to interact with dom0 reasonably fast, 3) to provide enough resources to deal with storage and network I/O. Showing essentially no swap space in use is good!

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post