Talos K8s Cluster with XOSTOR

tmnguyen

Hi All,

I'm evaluating XOSTOR and looks good so far.
In the documentation, it said maximum 7 machines is supported.
I want to bootstrap a K8s cluster based on Talos Linux. And since Talos Linux supports Linstor (XOSTOR), the plan is to connect Talos K8s cluster to Linstor controllers that are running on XCP-NG.
Will the limit of 7 max machines apply in this case? And is it a supported setup for production?

Thank you in advance for any advice.

olivierlambert

I think we've seen this question previously @Team-DevOps ?

nathanael-h

Hello @tmnguyen

About the XOSTOR limit, I read the devs saying it is like this as of now.
About using Linstor created by and for XOSTOR with another apps, in your case a Talos Kubernetes cluster, I think it should work, but all the volumes not created by XOSTOR would be unmanaged neither by XOSTOR nor by XO. So imagine, one admin would check in XO that a XOSTOR SR is not used anymore in the XO web ui, and would remove it. But would not think that it was also used for PV/PVC Kubernetes. There is this kind of risk. And as of now we do not support this.

By the way, we are going to start this month to write a CSI driver for Kubernetes for Xen Orchestra. This means from within a Kubernetes cluster you will create PVs/PVCs that would be backed by VM disks, aka VDIs

Subscribe to this topic if you want to be notified for the updates on this https://xcp-ng.org/forum/topic/10301/devops-megathread-what-you-need-and-how-we-can-help

tmnguyen

@nathanael-h Thanks for the feedback.