VM's going really slow after 3 - 4 weeks
-
Thanks for the replies.
@olivierlambert I have looked at the logs but as mentioned I can seen nothing which to me indicates an issue. But to my peers; I could be talking rubbish.
As all VM's appear to suffer and rebooting the physical server corrects the "issue" short term, am thinking what is common to all, hence Dom0.
As testament to xneserver/xcp it has pretty much just worked and until now, any issue's that have occurred I have been able to find the answer. So haven't really learnt a whole lot regards trouble shooting.
@Anonabhar No, I dont believe so. See below
# cat /proc/swaps Filename Type Size Used Priority /dev/sda6 partition 1048572 0 -2 # grep Swap /proc/meminfo SwapCached: 0 kB SwapTotal: 1048572 kB SwapFree: 1048572 kB -
Have you tried using xentop to see what th VMs are doing?
-
We ran xentop after you suggested it but dont believe it shows anything?
Just recently we had notification of another lot of patch's which have been applied.
So now we wait!
-
This doesn't look normal to me --
Can you tell us more about this VM?
-
@Danp
I have the same strange values on my server to
-
100% = 1 vCPU full.
-
this is from one server with one VM
-
@olivierlambert
so this means that in the last case I have 6 vCPU at 100% loade -
How many vCPUs you have assigned to this VM?
-
@olivierlambert
Server has 24 core and the VM 20 -
So (roughly and IIRC), you are using 6,23 vCPUs at 100%.
-
@Gheppy I was surprised to see a graylog VM using so much CPU, but maybe it's normal.
-
Yes, it is a VM with a heavily used database.
At the moment I am trying to convince them to buy an XO license for this server.
I work for a public service and I have no say when it comes to money. -
@Danp said in VM's going really slow after 3 - 4 weeks:
@Gheppy I was surprised to see a graylog VM using so much CPU, but maybe it's normal.
Not sure if Gheppy DB is graylog. Mine was and when I searched for an answer as to why the strange CPU utilization came up with the same answer Oliver supplied.
I would like to point out, as I didn't earlier, that the graylog cpu utilization in the xentop image I up loaded has been fixed so CPU util is much much less now.
However, the CPU utilization of that vm was also at the high levels after a server reboot so dont think its the answer to why all vm's slowly slow down
-
What's the hardware behind it by the way?
-
My server is HP DL380 G9, CPU 2 x E5-2620 v3 @ 2.40GHz with 4xSSD and 16xHDD 2.5" and 128Gb RAM.
System ( XCP-ng and OS ) is on 4 x SSD RAID 10, DB is on 14 x HDD RAID 10. -
@Gheppy What is free disk space like on this VM?
This is what caused the CPU's in our graylog server to go nuts. It had almost run out of free disk space. The only thing I have done was to increase free disk space by clearing out some of the older logs.
-
There is free space, on real disks I have:
-
4 x 400Gb SSD = 800Gb RAID 10, on which I have XCP-ng and the rest of the disk is with the first disk of the VM where is the operating system, which has 350 Gb allocated in which I have 2 partitions with 150 Gb SO and 200 Gb SQL log (for some speed). The occupied space being for SO 65Gb and for SQL log of 120Gb.
-
14 x 1200Gb = 8.4Tb RAID 10, on which I have the rest of the database divided on 3 virtual disks of 2Tb with soft RAID in the OS ( which is windows ),the configuration is like this because of the XCP-ng limit of 2Tb per vdisk. The database currently has 3.7 Tb.
-
-
@Gheppy If you run top, how is the dom0 CPU load and how is the swap space? If dom0 is saturated it may need more memory allocated to it.
-
This is a top img, swap it seems to be ok but memory is 103 Mb free of 7.4Gb.
I will increase the memory for Xen. Thank you
