XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Ceph (qemu-dp) in XCP-ng 7.6

    Scheduled Pinned Locked Moved Development
    12 Posts 5 Posters 2.2k Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B Offline
      bc-23
      last edited by

      Thanks for the update. Then I will go with a LVMoRBDSR as a workaround at the moment. Maybe I find some time to build a development environment and do some tests with the smapiv3-changes branch.

      1 Reply Last reply Reply Quote 0
      • olivierlambertO Offline
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        XS 8.0 (well, Citrix Hypervisor 8.0) release is imminent, and with it, a new SMAPIv3 code. As soon it's out, we'll test/bench it, and if perfs are OK, we'll probably start to roll more drivers for it. So Ceph integration will be clearly something doable.

        1 Reply Last reply Reply Quote 0
        • B Offline
          bc-23
          last edited by

          I'm looking forward for the SMAPIv3 integration. I already took a look on the concept and I really like the separation of volume and datapath plugin. I think this will make a lot of things easier in the future.

          1 Reply Last reply Reply Quote 1
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            You are right, this is clearly the future. It's still incomplete but we have hope to get something really great at the medium/long run.

            1 Reply Last reply Reply Quote 0
            • E Offline
              Emmenemoi
              last edited by

              Any update on this? Did you test with the non-patched qemu-dp package?
              With xcp-ng 8 everything should be ok for rbd support: kernel version, etc.

              R 1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by

                I don't know if anyone in the community is actively working on this. On our side, we are still working on SMAPIv3.

                Feel free to contribute 🙂

                1 Reply Last reply Reply Quote 0
                • R Offline
                  r1 XCP-ng Team @Emmenemoi
                  last edited by

                  @Emmenemoi Are you looking for RBDSR plugin or want to use Ceph any possible way?

                  1 Reply Last reply Reply Quote 0
                  • E Offline
                    Emmenemoi
                    last edited by

                    RBD any possible way. I'll try with qemu-rbd directly which might work with upstream and latest kernels... But didn't try yet

                    1 Reply Last reply Reply Quote 0
                    • R Offline
                      r1 XCP-ng Team
                      last edited by r1

                      You can map the RBD using standard commands rbd map .. and then create a SR on it using type=lvm shared=true and using device from /dev/rbd/...

                      Since the kernel is 4.19, most of ceph rbd features are supported. And, by using LVM backend, you would retain XCP functionality.

                      However, you will loose native snapshots or other rbd based image manipulation features due to absence of focussed RBDSR plugin.

                      Edit: I don't know if such SR can be created from XO but you can surely create it using CLI xe sr-create command.

                      1 Reply Last reply Reply Quote 0
                      • E Offline
                        Emmenemoi
                        last edited by Emmenemoi

                        I did contribute on the RBDSR plugin (v1). Creating a LVMoRBD would be easy. The other good point using LVM over RBD is the native fsfreeze when doing snaps and co which is not the case with rbd snaps. VM has to be paused (which issues fsfreeze) before rbd snaps.

                        But LVMoRBD would put all VM on 1 single RBD. Difficult to maintain regarding dev size.

                        Best would be qemu-rbd. I did use it like 10 years ago over native xen and it did work fine (ensures fsfreeze etc).
                        There were a tech preview using libvirt with xenserver. Didn't test if it works on upstream version 8.

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post