How to kubernetes on xcp-ng (csi?)
-
@shinuza oh, yeah. they've deprecated it in the last couple of months. thanks for the heads up
-
I should mention I use static IP for my VMs and I don't deploy using the hub recipes because my home setup is all Community bits and 8.3 XCP, updated regularly.
I use kubespray. I'm at kubernetes 1.27.7So I can't provide any help with cloud init or hub/recipes.
The working setup I have is built on CentOS7 ( need to replace ) VMs. I tried deploying on RockyOS 9.3 and spun my wheels for too long on issues there so I'm going to try 8.9.
I just updated my XO-CE bits and see some nice new features in the UI that will be helpful with all the PCI passthru I want to do. I was putting add/remove instructions in the VM notes and tags on the VMs just to remind me of what they show below. Its like they read my mind.
I need to learn KubeVirt.
Its christmas in may.
-
@Theoi-Meteoroi check out https://talos.dev
-
@xyhhx Why thanks! I'll take a look at it. I've done coreos and flatcar for work but find immutable OS no fun at home. I'm used to doing all the admin already and most of my VMs live long enough to be classed as "pets".
-
@Theoi-Meteoroi lol i've been seeing that analogy more and more lately. to each their own!
i think that's worth doing when the vms aren't being used as kubernetes nodes, but for kubernetes i'd prefer the vms be strictly for kubernetes
talos is purpose-built for this, too, so you get lots of great features, and you can be confident they're secure, and minimal. their support chat is very responsive too, if you're on matrix
ok i'm done shilling talos now
-
@xyhhx As I look further, it does seem to check a lot of boxes if I was building out a prod instance. I have enough exposure to dev-sec that I see the value. I feel like I sound like Linus and his comments about Debian but learning new ecosystems takes time and energy and sometimes is just distraction from building something. I kinda wore myself out learning all the details and quirks of DRBD and Linstor recently so I'll read some of the docs and hope the toolchain doesn't chase me away. Any product or project that genuinely and openly has a community like we have here would usually have my attention, just on those terms.
-
@Theoi-Meteoroi if you do check it out don't be shy to ping me either here or on matrix (
@xyhhx:matrix.org) and i'll be happy to try to help -
So all of you have connected the storage directly to the vms?
I'm trying to do it on iscsi and nfs storage. -
@mohammadm i think for nfs you should handle that from the kubernetes side. i.e. use an nfs-provisioner or the built-in nfs storageclass
-
Hi all,
not sure if anyone is still following this this thread, but just in case...
Over the last few months I’ve been working on a CSI driver for Kubernetes that integrates with Xen Orchestra. I’ve been running it in my own setup for a couple of weeks now and it seems to be working well.
I originally built it for my own needs, but I’ve since cleaned it up and added documentation so others can try it out. If you do, I’d love to hear your feedback, issues, or feature requests.
Here is the link:
github.com/m4rCsi/csi-xen-orchestra-driverFeatures
- Dynamic provisioning (create disks on demand via PVCs)
- Migration of disks between storage repositories (meant for local SRs)
- Static provisioning (use an existing VDI by UUID)
- Offline volume expansion
- Topology aware (pool, and optionally host) (with the help of xenorchestra-cloud-controller-manager)
