Ceph (qemu-dp) in XCP-ng 7.6

  • Thanks for the update. Then I will go with a LVMoRBDSR as a workaround at the moment. Maybe I find some time to build a development environment and do some tests with the smapiv3-changes branch.

  • XCP-ng Team

    XS 8.0 (well, Citrix Hypervisor 8.0) release is imminent, and with it, a new SMAPIv3 code. As soon it's out, we'll test/bench it, and if perfs are OK, we'll probably start to roll more drivers for it. So Ceph integration will be clearly something doable.

  • I'm looking forward for the SMAPIv3 integration. I already took a look on the concept and I really like the separation of volume and datapath plugin. I think this will make a lot of things easier in the future.

  • XCP-ng Team

    You are right, this is clearly the future. It's still incomplete but we have hope to get something really great at the medium/long run.

  • Any update on this? Did you test with the non-patched qemu-dp package?
    With xcp-ng 8 everything should be ok for rbd support: kernel version, etc.

  • XCP-ng Team

    I don't know if anyone in the community is actively working on this. On our side, we are still working on SMAPIv3.

    Feel free to contribute 🙂

  • XCP-ng Team

    @Emmenemoi Are you looking for RBDSR plugin or want to use Ceph any possible way?

  • RBD any possible way. I'll try with qemu-rbd directly which might work with upstream and latest kernels... But didn't try yet

  • XCP-ng Team

    You can map the RBD using standard commands rbd map .. and then create a SR on it using type=lvm shared=true and using device from /dev/rbd/...

    Since the kernel is 4.19, most of ceph rbd features are supported. And, by using LVM backend, you would retain XCP functionality.

    However, you will loose native snapshots or other rbd based image manipulation features due to absence of focussed RBDSR plugin.

    Edit: I don't know if such SR can be created from XO but you can surely create it using CLI xe sr-create command.

  • I did contribute on the RBDSR plugin (v1). Creating a LVMoRBD would be easy. The other good point using LVM over RBD is the native fsfreeze when doing snaps and co which is not the case with rbd snaps. VM has to be paused (which issues fsfreeze) before rbd snaps.

    But LVMoRBD would put all VM on 1 single RBD. Difficult to maintain regarding dev size.

    Best would be qemu-rbd. I did use it like 10 years ago over native xen and it did work fine (ensures fsfreeze etc).
    There were a tech preview using libvirt with xenserver. Didn't test if it works on upstream version 8.

Log in to reply

XCP-ng Pro Support

XCP-ng Pro Support