XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Monitoring disk usage of thin provisioned disks

    Scheduled Pinned Locked Moved Xen Orchestra
    15 Posts 5 Posters 3.7k Views 2 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Online
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      It's a bit more complicated than that. Eg a snapshot won't consume space per se, it's the base copy which will use some space.

      So the question is: what do you really want to know? active vdi usage for a disk, total chain space of the snapshot and all its parents? only one parent?

      1 Reply Last reply Reply Quote 0
      • SchmalzTechS Offline
        SchmalzTech
        last edited by

        I was kind of thinking about that as far as snapshots are concerned. I don't know how to calculate it, but ultimately I would want to know how much disk space would be freed if I deleted a particular snapshot. I understand that could be difficult (impossible?) to determine.

        I think the seeing snapshot disk usage is less important than seeing the total SR disk usage of the VM. Typically the first thing I would do when trying to free up disk space would be to just remove unnecessary snapshots first, not really worrying about exactly what size they are.

        So in my opinion, the most important thing to see would be the current actual disk usage on the SR for the VM's disks, which I think would be adding up the base vhd size plus the size of all snapshots in the chain and showing that total on the SR disks tab and/or the VM disks tab.

        1 Reply Last reply Reply Quote 0
        • olivierlambertO Online
          olivierlambert Vates 🪐 Co-Founder CEO
          last edited by olivierlambert

          Let me explain a bit more. A snapshot is just a pointer toward the read only base copy. It's only few KiB big.

          However, if you remove it, the active disk (current VM blocks written since the snapshot) will be merged inside the base copy, and the result will be the new active disk.

          So removing the snapshot, is the end, **asking to merge the active disk inside the base copy. How to guess the result of this? Impossible to predict before the actual coalesce (computing the coalesce will need the resources of doing the actual coalesce).

          SchmalzTechS 1 Reply Last reply Reply Quote 0
          • SchmalzTechS Offline
            SchmalzTech @olivierlambert
            last edited by

            What you said so well was my basic understanding, so to use your terminology, adding the active disk plus others in the chain if there are more snapshots, plus the base copy would be what I would think of as current disk usage.

            I suspected that to calculate the snapshot size, the coalesce would have to be computed, so that sounds like too much of a strain on the system to implement. I think simply adding up the total size of the chain from the active disk back to the base image and putting that somewhere would be most helpful with the least impact on the systems performance.

            1 Reply Last reply Reply Quote 0
            • olivierlambertO Online
              olivierlambert Vates 🪐 Co-Founder CEO
              last edited by olivierlambert

              Current disk usage for an active disk is:

              • active disk space used
              • base copy disk space used

              Obviously, if you have a bigger chain (more than 1 parent) you need to compute the space of the whole chain until the parent (but does it make sense? because most of the space is due to addition of the chain, also a chain can be a tree, with multiple active disks if you converted snapshots to active disks)

              SchmalzTechS 1 Reply Last reply Reply Quote 0
              • SchmalzTechS Offline
                SchmalzTech @olivierlambert
                last edited by

                Oh boy, this can be complicated. I think I opened up a can of worms! 🤦 😁 I'm really not sure what is most useful until I can see it in action. Another example of where I would use this is to determine if migrating the VM to another SR is possible because of disk space constraints on the target. Again in this case, I would first probably get rid of any snapshots before moving, so really the size of whatever would be moved, possibly including metadata for the VM itself, though that amount is trivial compared to base and active disks.

                1 Reply Last reply Reply Quote 0
                • olivierlambertO Online
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  When you use storage migrate, I think only one (or two?) snapshot max can be sent on destination. In a thin pro scenario, it shouldn't be a problem.

                  1 Reply Last reply Reply Quote 0
                  • akurzawaA Offline
                    akurzawa
                    last edited by

                    From my point of View you need only to monitor free space to stay out of torubles. You check free space in dashboard. Also let's call it good admin never overcoomits available resources. That's you task to know how much disk space you can allocate in the vms.

                    25424d57-55f9-4abe-9fbd-97c5b7f94580-image.png

                    1 Reply Last reply Reply Quote 0
                    • RhandyxR Offline
                      Rhandyx @SchmalzTech
                      last edited by

                      @schmalztech said in Monitoring disk usage of thin provisioned disks:

                      @olivierlambert Yes, I understand this would only be useful for thin provisioned SR. In the past on other hypervisors I had to deal with disk space issues on an SR which was overprovisioned, and it is helpful to quickly determine which VMs are bloating their storage usage to be able to make a decision to delete snapshots or move a VM to a different storage or host. My thought was to see it on the disks listing in the SR in order to see an overview of how that particular SR is being utilized.

                      I made an example of how it could look based on a screenshot from XO:
                      Disk Usage on SR example.png

                      I think it would also be helpful to list the actual disk usage on the disks and snapshots pages for each individual VM. I think the total of base vhd and snapshots on the disks tab, and each individual snapshot size on the snapshots page. Here is how that could look:
                      VM disk usage.png
                      snapshot disk usage.png

                      How you enable that field SR DISK USAGE my xenorchestra not have it.
                      Im using xenorchestra comunnity edition

                      1 Reply Last reply Reply Quote 0
                      • olivierlambertO Online
                        olivierlambert Vates 🪐 Co-Founder CEO
                        last edited by

                        It's because it's a fake, edited to show how we would like to have it 🙂

                        If you need that, please open an issue in XO bugtracker, only after checking there isn't an existing same request 🙂

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post