XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    xcp-ng CPU low performance issue

    Scheduled Pinned Locked Moved Compute
    14 Posts 7 Posters 5.9k Views 2 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • enes.selcukE Offline
      enes.selcuk
      last edited by

      @Danp said in xcp-ng CPU low performance issue:

      How are you testing? Also, might help if you told us the results.

      [19:10 xcp-ng-lmtguftk ~]# sudo xenpm get-cpufreq-para
      cpu id : 0
      affected_cpus : 0
      cpuinfo frequency : max [2101000] min [800000] cur [2101000]
      scaling_driver : acpi-cpufreq
      scaling_avail_gov : userspace performance powersave ondemand
      current_governor : performance
      scaling_avail_freq : *2101000 2100000 2000000 1900000 1800000 1700000 1600000 150 0000 1400000 1300000 1200000 1100000 1000000 900000 800000
      scaling frequency : max [2101000] min [800000] cur [2101000]
      turbo mode : enabled

      max 2.10 ghz but The processor can go up to 3.2 GHz under normal conditions.

      xenpm start & sleep 5; killall -s SIGINT xenpm

      The maximum speed of the task manager on windows is 2.10ghz.

      T 1 Reply Last reply Reply Quote 0
      • T Offline
        tuxen Top contributor @enes.selcuk
        last edited by

        @enes-selcuk

        What's the output of:

        # xenpm start 1 | grep -i "avg freq"
        
        1 Reply Last reply Reply Quote 0
        • enes.selcukE Offline
          enes.selcuk
          last edited by

          @tuxen said in xcp-ng CPU low performance issue:

          xenpm start 1 | grep -i "avg freq"

          [06:13 xcp-ng-lmtguftk ~]# xenpm start 1 | grep -i "avg freq"
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz
          Avg freq 64 KHz

          1 Reply Last reply Reply Quote 0
          • enes.selcukE Offline
            enes.selcuk
            last edited by enes.selcuk

            ll performance settings in the server bios settings are as follows.

            System Profile Current Value Pending Value
            CPU Power Management System DBPM (DAPC)
            Memory Frequency Maximum Performance
            Turbo Boost Enabled
            C1E Enabled
            C States Enabled
            Write Data CRC Disabled
            Memory Patrol Scrub Standard
            Memory Refresh Rate 1x
            Uncore Frequency Dynamic
            Energy Efficient Policy Balanced Performance
            Number of Turbo Boost Enabled Cores for Processor 1 All
            Number of Turbo Boost Enabled Cores for Processor 2 All
            Monitor/Mwait Enabled
            Workload Profile Not Available
            CPU Interconnect Bus Link Power Management Enabled
            PCI ASPM L1 Link Power Management Enabled

            CPU Power Management Some options include = Performans Per Watt (OS ), Performans Per Watt (DAPC ), Performance, Workstation Performans, Custom
            Workload Profile Some options include = HPC Profile =,Low Latency Optimized Prodile, Virtualization Optimized Performans Profile, Virtualization Optimized Performans Per Watt Profile, Database Optimized Performans Profile, Database Optimized Performans Per Watt Profile, SDS Optimized Performans Profile and SDS Optimized Performans Per Watt Profile
            I have tried the above options one by one but the result has not changed.

            1 Reply Last reply Reply Quote 0
            • T Offline
              tuxen Top contributor
              last edited by

              The incorrect clock results mean that Xen isn't in charge of frequency scaling management. Set the CPU Power Management to Performance Per Watt (OS) and run the previous xenpm, this time with a watch for real-time:

              # watch 'xenpm start 1 | grep -i "avg freq"'
              

              Start a VM boot storm (or a stress test inside one or more VMs) in order to generate some CPU load.

              T 1 Reply Last reply Reply Quote 1
              • T Offline
                tuxen Top contributor @tuxen
                last edited by

                @enes-selcuk

                This is one of our production servers with the CPU Power Management config I posted earlier. It's a Dell R730 - Xeon E5-2630v3 @ 2.40 Ghz. As you can see, some cores are boosting to 3.0-3.1GHz. The maximum for this CPU model is 3.2 GHz:

                  Avg freq	2737140	KHz
                  Avg freq	2737140	KHz
                  Avg freq	2689120	KHz
                  Avg freq	2665110	KHz
                  Avg freq	2737140	KHz
                  Avg freq	3097290	KHz
                  Avg freq	3073280	KHz
                  Avg freq	2713130	KHz
                  Avg freq	2665110	KHz
                  Avg freq	2641100	KHz
                  Avg freq	2761150	KHz
                  Avg freq	2665110	KHz
                  Avg freq	2689120	KHz
                  Avg freq	2617090	KHz
                  Avg freq	2881200	KHz
                  Avg freq	2785160	KHz
                  Avg freq	2641100	KHz
                  Avg freq	2713130	KHz
                  Avg freq	2689120	KHz
                  Avg freq	2689120	KHz
                  Avg freq	2689120	KHz
                  Avg freq	2785160	KHz
                  Avg freq	2833180	KHz
                  Avg freq	2761150	KHz
                  Avg freq	2761150	KHz
                  Avg freq	2905210	KHz
                  Avg freq	2713130	KHz
                  Avg freq	3025260	KHz
                  Avg freq	2761150	KHz
                  Avg freq	2713130	KHz
                  Avg freq	2833180	KHz
                  Avg freq	2617090	KHz
                
                
                1 Reply Last reply Reply Quote 0
                • enes.selcukE Offline
                  enes.selcuk
                  last edited by

                  @tuxen said in xcp-ng CPU low performance issue:

                  Start a VM boot storm (or a stress test inside one or more VMs) in order to generate some CPU load.

                  Thank you very much for your information. I tried and saw the following results in real time.Every 2,0s: xenpm start 1 | grep -i "avg freq" Thu Nov 28 13:27:00 2019

                  Avg freq 2521200 KHz
                  Avg freq 2689280 KHz
                  Avg freq 2836350 KHz
                  Avg freq 2689280 KHz
                  Avg freq 2731300 KHz
                  Avg freq 2689280 KHz
                  Avg freq 2773320 KHz
                  Avg freq 2752310 KHz
                  Avg freq 2689280 KHz
                  Avg freq 2689280 KHz
                  Avg freq 2710290 KHz
                  Avg freq 2710290 KHz
                  Avg freq 2689280 KHz
                  Avg freq 2710290 KHz

                  1 Reply Last reply Reply Quote 0
                  • ruskofdR Offline
                    ruskofd
                    last edited by

                    Try to disable C-States, it could also improve a lot of operations, including storage.

                    enes.selcukE 1 Reply Last reply Reply Quote 1
                    • enes.selcukE Offline
                      enes.selcuk @ruskofd
                      last edited by

                      @ruskofd I turned off the C1E and C States features. Problem is solved. But SSD performance is very low compared to windows machine.

                      F S 2 Replies Last reply Reply Quote 0
                      • F Offline
                        fibrewire @enes.selcuk
                        last edited by

                        bumping this as it is relevant for my datacenter. Don't want to forget it!

                        1 Reply Last reply Reply Quote 0
                        • olivierlambertO Offline
                          olivierlambert Vates 🪐 Co-Founder CEO
                          last edited by

                          Feel free to submit a PR in our official doc, we might have a place for "Best practice" or something like that 🙂

                          1 Reply Last reply Reply Quote 0
                          • H high-voltages referenced this topic on
                          • S Offline
                            stevewest15 @enes.selcuk
                            last edited by

                            @enes-selcuk Did you find a setting that works best w/ Dell servers?

                            I have a Dell R640's which I'll be using for LAMP/LEMP vm servers and was wondering what are the best settings to use in Dell Bios and if there are any changes I need to make on the xcp-ng host?

                            Dual Intel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz
                            Level 2 Cache 16x1 MB
                            Level 3 Cache 22 MB
                            Number of Cores 16

                            Dell Bios Setting:
                            System Profile: Performance Per Watt (OS)
                            CPU Power Management: OS DBPM
                            Memory Frequency: Maximum Performance
                            Turbo Boost: Enabled
                            C1E: Enabled
                            C States: Enabled
                            Write Data CRC: Disabled
                            Memory Patrol Scrub: Standard
                            Memory Refresh Rate: 1x
                            Uncore Frequency : Dynamic
                            Energy Efficient Policy: Balanced Performance
                            Number of Turbo Boost Enabled Cores for Processor 1: All
                            Number of Turbo Boost Enabled Cores for Processor 2: All
                            Monitor/Mwait: Enabled
                            Workload Profile: Not Available
                            CPU Interconnect Bus Link Power Management: Enabled
                            PCI ASPM L1 Link Power Management: Enabled

                            Thank you!

                            SW

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post