XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Memory reporting incorrect values

    Scheduled Pinned Locked Moved Solved Compute
    24 Posts 6 Posters 805 Views 5 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • yannY Offline
      yann Vates 🪐 XCP-ng Team @TeddyAstie
      last edited by

      @fred974 the tools should be reporting the value from MemAvailable, so buffer/cache should not be considered as in-use. What do you see (reported by the agent) in xenstore ?

      From within the guest:

      # xenstore ls data
      meminfo_free = "324060"
      meminfo_total = "973736"
      os_distro = "Debian"
      os_name = "Debian 11"
      os_uname = "5.10.0-21-amd64"
      updated = "1"
      

      The meminfo_free should match what you see in /proc/meminfo.

      F 2 Replies Last reply Reply Quote 0
      • F Offline
        fred974 @yann
        last edited by

        @yann said in Memory reporting incorrect values:

        xenstore ls data

        Here is what I see:
        cat /proc/meminfo

        MemTotal:        8123972 kB
        MemFree:          428388 kB
        MemAvailable:    5419696 kB
        Buffers:          411604 kB
        Cached:          4771524 kB
        SwapCached:          328 kB
        Active:          3060024 kB
        Inactive:        3339116 kB
        Active(anon):     736300 kB
        Inactive(anon):  1374628 kB
        Active(file):    2323724 kB
        Inactive(file):  1964488 kB
        Unevictable:       27620 kB
        Mlocked:           27620 kB
        SwapTotal:       4194300 kB
        SwapFree:        4191228 kB
        Dirty:               284 kB
        Writeback:             0 kB
        AnonPages:       1243360 kB
        Mapped:           919268 kB
        Shmem:            885852 kB
        KReclaimable:     997192 kB
        Slab:            1155308 kB
        SReclaimable:     997192 kB
        SUnreclaim:       158116 kB
        KernelStack:        4432 kB
        PageTables:        13128 kB
        NFS_Unstable:          0 kB
        Bounce:                0 kB
        WritebackTmp:          0 kB
        CommitLimit:     8256284 kB
        Committed_AS:    5854320 kB
        VmallocTotal:   34359738367 kB
        VmallocUsed:       18656 kB
        VmallocChunk:          0 kB
        Percpu:             4192 kB
        HardwareCorrupted:     0 kB
        AnonHugePages:         0 kB
        ShmemHugePages:        0 kB
        ShmemPmdMapped:        0 kB
        FileHugePages:         0 kB
        FilePmdMapped:         0 kB
        HugePages_Total:       0
        HugePages_Free:        0
        HugePages_Rsvd:        0
        HugePages_Surp:        0
        Hugepagesize:       2048 kB
        Hugetlb:               0 kB
        DirectMap4k:      307200 kB
        DirectMap2M:     8077312 kB
        DirectMap1G:     1048576 kB
        

        xenstore ls data

        meminfo_free = "422892"
        meminfo_total = "8123972"
        os_distro = "ubuntu"
        os_majorver = "22"
        os_minorver = "04"
        os_name = "Ubuntu 22.04.5 LTS"
        os_uname = "5.15.0-128-generic"
        updated = "Mon Jan  6 11:52:45 2025"
        volumes = ""
         0 = ""
          extents = ""
           0 = "xvda"
          filesystem = "ext4"
          free = "142059319296"
          mount_points = ""
           0 = "/"
          name = "/dev/xvda1(072768fc-9db5-4fa4-a6a1-c98afdd82d32)"
          size = "171682283008"
         1 = ""
          extents = ""
           0 = "xvda"
          free = "4138934272"
          name = "/dev/xvda14"
          size = "4194304"
         2 = ""
          extents = ""
           0 = "xvda"
          filesystem = "vfat"
          free = "103057408"
          mount_points = ""
           0 = "/boot/efi"
          name = "/dev/xvda15(D9A6-D2AA)"
          size = "111149056"
         3 = ""
          extents = ""
           0 = "xvdb"
          free = "4138934272"
          name = "/dev/xvdb1(355A-4FC2)"
          size = "10486272"
        

        htop
        8a9bc09d-32f7-4add-bc0f-de342d120523-image.png

        XOA
        7930350b-6c50-4089-a67a-aed6e3187d94-image.png

        XO Community
        027a0264-69bc-4d58-8622-46abbe9455ad-image.png

        F 1 Reply Last reply Reply Quote 0
        • F Offline
          fred974 @fred974
          last edited by

          It would be great to have a bit for details on the memory so we can monitor the system better.

          1 Reply Last reply Reply Quote 0
          • F Offline
            fred974 @yann
            last edited by

            @yann said in Memory reporting incorrect values:

            @fred974 the tools should be reporting the value from MemAvailable, so buffer/cache should not be considered as in-use.

            Doesn't seem to be the case

            yannY 1 Reply Last reply Reply Quote 0
            • yannY Offline
              yann Vates 🪐 XCP-ng Team @fred974
              last edited by

              @fred974 right, it is reporting MemFree here.

              What does xenstore ls attr/PVAddons show for this VM? And which kernel version is it using?

              Old xe-guest-utilities before v7.30 indeed reported MemFree, which XenServer then improved in v8.4 to still report something for kernels older than 3.14 which did not have MemAvailable yet, but Ubuntu 22.04 ships a decently-recent kernel, so I suspect it would be rather due to an old xe-guest-utilities.

              F 1 Reply Last reply Reply Quote 0
              • F Offline
                fred974 @yann
                last edited by

                @yann said in Memory reporting incorrect values:

                What does xenstore ls attr/PVAddons show for this VM? And which kernel version is it using?

                BuildVersion = "0"
                Installed = "1"
                MajorVersion = "6"
                MicroVersion = "80"
                MinorVersion = "6"
                

                hostnamectl status

                   Static hostname: WEB1-OLS-QHUK
                Transient hostname: web1-ols-qh-uk
                         Icon name: computer-vm
                           Chassis: vm
                        Machine ID: 3b1da9b8e5cf4ecda845219bxxx
                           Boot ID: 19308dbfd7d347c699985e82xxx
                    Virtualization: xen
                  Operating System: Ubuntu 22.04.5 LTS              
                            Kernel: Linux 5.15.0-128-generic
                      Architecture: x86-64
                   Hardware Vendor: Xen
                    Hardware Model: HVM domU
                
                yannY 1 Reply Last reply Reply Quote 0
                • yannY Offline
                  yann Vates 🪐 XCP-ng Team @fred974
                  last edited by

                  @fred974 v6.80.6 is definitely very old, and did report MemFree, we ship v7.30 with XCP-ng 8.2. You will likely want to update it, from the "XCP-ng tools" SR.

                  F 1 Reply Last reply Reply Quote 0
                  • F Offline
                    fred974 @yann
                    last edited by

                    @yann said in Memory reporting incorrect values:

                    @fred974 v6.80.6 is definitely very old, and did report MemFree, we ship v7.30 with XCP-ng 8.2. You will likely want to update it, from the "XCP-ng tools" SR.

                    Probably because I installed xe-guest-utilities from ububtu repo.. I tried to update from the CD and got the following error:
                    bash /mnt/Linux/install.sh

                    Detected `Ubuntu 22.04.5 LTS' (ubuntu version 22).
                    
                    The following changes will be made to this Virtual Machine:
                      * update arp_notify sysctl.
                      * packages to be installed/upgraded:
                        - xe-guest-utilities_7.30.0-12_amd64.deb
                    
                    Continue? [y/n] y
                    
                    (Reading database ... 136958 files and directories currently installed.)
                    Preparing to unpack .../xe-guest-utilities_7.30.0-12_amd64.deb ...
                    Unpacking xe-guest-utilities (7.30.0-12) over (7.20.2-0ubuntu1~22.04.2) ...
                    dpkg: error processing archive /mnt/Linux/xe-guest-utilities_7.30.0-12_amd64.deb (--install):
                     trying to overwrite '/usr/bin/xenstore', which is also in package xenstore-utils 4.16.0-1~ubuntu2.1
                    dpkg-deb: error: paste subprocess was killed by signal (Broken pipe)
                    Errors were encountered while processing:
                     /mnt/Linux/xe-guest-utilities_7.30.0-12_amd64.deb
                    

                    Could anyone advice of how to fix this issue? I tried apt remove xe-guest-utilities and got the same error

                    yannY 1 Reply Last reply Reply Quote 0
                    • yannY Offline
                      yann Vates 🪐 XCP-ng Team @fred974
                      last edited by

                      @fred974 there is an undeclared conflict between the xe-guest-utilities in the ISO and xenstore-utils, you can install the former after removing the latter (but yes, it is a problem, the Go implementation of xenstore tools should not be in this package).

                      F 1 Reply Last reply Reply Quote 0
                      • F Offline
                        fred974 @yann
                        last edited by

                        @yann I removed the tools using apt remove xe-guest-utilities and tried to install from the cd and had the same error
                        apt remove xe-guest-utilities

                        Reading package lists... Done
                        Building dependency tree... Done
                        Reading state information... Done
                        The following packages were automatically installed and are no longer required:
                          dbconfig-common dbconfig-mysql icc-profiles-free libaprutil1-dbd-sqlite3 libaprutil1-ldap libjs-bootstrap4 libjs-codemirror libjs-jquery-mousewheel libjs-jquery-timepicker libjs-jquery-ui libjs-popper.js libjs-sizzle liblua5.3-0 libmcrypt4 node-jquery php-common php-google-recaptcha php-mariadb-mysql-kbs
                          php-nikic-fast-route php-phpmyadmin-motranslator php-phpmyadmin-shapefile php-phpseclib php-psr-cache php-psr-container php-psr-log php-symfony-cache php-symfony-cache-contracts php-symfony-dependency-injection php-symfony-deprecation-contracts php-symfony-expression-language php-symfony-polyfill-php80
                          php-symfony-polyfill-php81 php-symfony-service-contracts php-symfony-var-exporter php-tcpdf ssl-cert
                        Use 'apt autoremove' to remove them.
                        The following packages will be REMOVED:
                          xe-guest-utilities
                        0 upgraded, 0 newly installed, 1 to remove and 16 not upgraded.
                        After this operation, 1889 kB disk space will be freed.
                        N: Ignoring file 'mariadb.list.old_1' in directory '/etc/apt/sources.list.d/' as it has an invalid filename extension
                        Do you want to continue? [Y/n] y
                        (Reading database ... 136958 files and directories currently installed.)
                        Removing xe-guest-utilities (7.20.2-0ubuntu1~22.04.2) ...
                        needrestart is being skipped since dpkg has failed
                        root@WEB1-OLS-QHUK:/home/fetheve/Linux# apt autoremove
                        Reading package lists... Done
                        Building dependency tree... Done
                        Reading state information... Done
                        The following packages will be REMOVED:
                          dbconfig-common dbconfig-mysql icc-profiles-free libaprutil1-dbd-sqlite3 libaprutil1-ldap libjs-bootstrap4 libjs-codemirror libjs-jquery-mousewheel libjs-jquery-timepicker libjs-jquery-ui libjs-popper.js libjs-sizzle liblua5.3-0 libmcrypt4 node-jquery php-common php-google-recaptcha php-mariadb-mysql-kbs
                          php-nikic-fast-route php-phpmyadmin-motranslator php-phpmyadmin-shapefile php-phpseclib php-psr-cache php-psr-container php-psr-log php-symfony-cache php-symfony-cache-contracts php-symfony-dependency-injection php-symfony-deprecation-contracts php-symfony-expression-language php-symfony-polyfill-php80
                          php-symfony-polyfill-php81 php-symfony-service-contracts php-symfony-var-exporter php-tcpdf ssl-cert
                        0 upgraded, 0 newly installed, 36 to remove and 15 not upgraded.
                        After this operation, 42.0 MB disk space will be freed.
                        N: Ignoring file 'mariadb.list.old_1' in directory '/etc/apt/sources.list.d/' as it has an invalid filename extension
                        Do you want to continue? [Y/n] y
                        (Reading database ... 136950 files and directories currently installed.)
                        Removing dbconfig-mysql (2.0.21) ...
                        Removing dbconfig-common (2.0.21) ...
                        Removing php-tcpdf (6.4.4+dfsg1-1) ...
                        Removing icc-profiles-free (2.0.1+dfsg-1.1) ...
                        Removing libaprutil1-dbd-sqlite3:amd64 (1.6.1-5ubuntu4.22.04.2) ...
                        Removing libaprutil1-ldap:amd64 (1.6.1-5ubuntu4.22.04.2) ...
                        Removing libjs-bootstrap4 (4.6.0+dfsg1-4) ...
                        Removing libjs-codemirror (5.65.0+~cs5.83.9-1) ...
                        Removing libjs-jquery-mousewheel (1:3.1.13-5) ...
                        Removing libjs-jquery-timepicker (1.6.3-1) ...
                        Removing libjs-jquery-ui (1.13.1+dfsg-1) ...
                        Removing libjs-popper.js (1.16.1+ds-5) ...
                        Removing libjs-sizzle (2.3.6+ds+~2.3.3-1) ...
                        Removing liblua5.3-0:amd64 (5.3.6-1build1) ...
                        Removing libmcrypt4 (2.5.8-7) ...
                        Removing node-jquery (3.6.0+dfsg+~3.5.13-1) ...
                        Removing php-phpmyadmin-motranslator (5.2.0-1build1) ...
                        Removing php-symfony-expression-language (5.4.4+dfsg-1ubuntu8) ...
                        Removing php-symfony-cache (5.4.4+dfsg-1ubuntu8) ...
                        Removing php-symfony-var-exporter (5.4.4+dfsg-1ubuntu8) ...
                        Removing php-symfony-dependency-injection (5.4.4+dfsg-1ubuntu8) ...
                        Removing php-symfony-service-contracts (2.4.0-1ubuntu2) ...
                        Removing php-google-recaptcha (1.2.4-3) ...
                        Removing php-mariadb-mysql-kbs (1.2.12-1) ...
                        Removing php-nikic-fast-route (1.3.0-3) ...
                        Removing php-phpmyadmin-shapefile (2.1-5) ...
                        Removing php-phpseclib (2.0.36-1) ...
                        Removing php-symfony-cache-contracts (2.4.0-1ubuntu2) ...
                        Removing php-psr-cache (3.0.0-1) ...
                        Removing php-psr-container (2.0.2-1) ...
                        Removing php-psr-log (3.0.0-1) ...
                        Removing php-symfony-deprecation-contracts (2.4.0-1ubuntu2) ...
                        Removing php-symfony-polyfill-php80 (1.24.0-1ubuntu2) ...
                        Removing php-symfony-polyfill-php81 (1.24.0-1ubuntu2) ...
                        Removing ssl-cert (1.1.2) ...
                        Removing php-common (2:92ubuntu1) ...
                        Warning: Stopping phpsessionclean.service, but it can still be activated by:
                          phpsessionclean.timer
                        Processing triggers for man-db (2.10.2-1) ...
                        Processing triggers for libc-bin (2.35-0ubuntu3.8) ...
                        Scanning processes...                                                                                                                                                                                                                                                                                                       
                        Scanning linux images...                                                                                                                                                                                                                                                                                                    
                        
                        Running kernel seems to be up-to-date.
                        
                        No services need to be restarted.
                        
                        No containers need to be restarted.
                        
                        No user sessions are running outdated binaries.
                        
                        No VM guests are running outdated hypervisor (qemu) binaries on this host.
                        

                        bash /mnt/Linux/install.sh

                        Detected `Ubuntu 22.04.5 LTS' (ubuntu version 22).
                        
                        The following changes will be made to this Virtual Machine:
                          * update arp_notify sysctl.
                          * packages to be installed/upgraded:
                            - xe-guest-utilities_7.30.0-12_amd64.deb
                        
                        Continue? [y/n] y
                        
                        Selecting previously unselected package xe-guest-utilities.
                        (Reading database ... 134088 files and directories currently installed.)
                        Preparing to unpack .../xe-guest-utilities_7.30.0-12_amd64.deb ...
                        Unpacking xe-guest-utilities (7.30.0-12) ...
                        dpkg: error processing archive /mnt/Linux/xe-guest-utilities_7.30.0-12_amd64.deb (--install):
                         trying to overwrite '/usr/bin/xenstore', which is also in package xenstore-utils 4.16.0-1~ubuntu2.1
                        dpkg-deb: error: paste subprocess was killed by signal (Broken pipe)
                        Errors were encountered while processing:
                         /mnt/Linux/xe-guest-utilities_7.30.0-12_amd64.deb
                        

                        How can I fix this?

                        F 1 Reply Last reply Reply Quote 0
                        • F Offline
                          fred974 @fred974
                          last edited by

                          @fred974 said in Memory reporting incorrect values:

                          xenstore-utils

                          apt remove xenstore-utils fix the installation issue.

                          F 1 Reply Last reply Reply Quote 0
                          • F Offline
                            fred974 @fred974
                            last edited by

                            Its seem to be reporting correctly now. Thank you all for your help.
                            a99c1f9b-5741-4d59-aa54-35a3e8dce75f-image.png

                            85e83354-5e14-4771-a499-a251ee00ae9e-image.png

                            1 Reply Last reply Reply Quote 2
                            • olivierlambertO olivierlambert marked this topic as a question on
                            • olivierlambertO olivierlambert has marked this topic as solved on
                            • olivierlambertO Offline
                              olivierlambert Vates 🪐 Co-Founder CEO
                              last edited by

                              Great news 🙂

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post