XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login
    1. Home
    2. petr.bena
    3. Best
    P
    Offline
    • Profile
    • Following 0
    • Followers 0
    • Topics 4
    • Posts 37
    • Groups 0

    Posts

    Recent Best Controversial
    • RE: CEPHFS - why not CEPH RBD as SR?

      Hello, just a follow-up I figured out probable fix for performance issues (the locking issue seems to have disappeared on its own I suspect it happened only due to upgrade process as pool contained mix of 8.0 and 8.2 hosts)

      It was caused by very slow (several second) executions of basic LVM commands - pvs / lvs etc took many seconds. When started with debug options it seems it took excessive amount of time scanning iSCSI volumes in /dev/mapper as well as the individual LVs that were also presented in /dev/mapper as if they were PVs - it actually subsequently ignored them but still those were (in my case) hundreds of LVs and each had to be open to check metadata and size.

      After modifying /etc/lvm/master/lvm.conf by adding this:

      # /dev/sd.* is there to avoid scanning RAW disks that are used via UDEV for storage backend
      filter = [ "r|/dev/sd.*|", "r|/dev/mapper/.*|" ]
      

      Performance of LVM commands improved from ~5 seconds to less than 0.1 second and issue with slow startup / shutdown / snapshot of VMs (sometimes they took almost 10 minutes) was resolved.

      Of course this filter needs to be adjusted based on specific needs of the given situation. In my case both /dev/sd* as well as /dev/mapper devices are NEVER used by LVM backed SRs, so it was safe to ignore them for me. (all my LVM SRs are from /dev/rbd/)

      posted in Development
      P
      petr.bena
    • RE: XcpNG - Xen kernel crash (FATAL TRAP: vector = 2 (nmi))

      Hello, no, since I changed this, server is rock solid:

      20:59:01 up 136 days, 22:40, 1 user, load average: 0.45, 0.31, 0.36

      posted in Compute
      P
      petr.bena
    • RE: XcpNG - Xen kernel crash (FATAL TRAP: vector = 2 (nmi))

      @fbifido yes, I have 3 CEPH nodes running in separate VM's that have direct passthrough to underlying physical disks. CEPH volume is connected as RBD that forms shared block device on XCP-ng servers. On that shared block device I use LVM.

      It's all described here: https://github.com/xcp-ng/xcp/wiki/Ceph-on-XCP-ng-7.5-or-later#lvm-on-rbd

      posted in Compute
      P
      petr.bena