<![CDATA[Kuberenets cluster recipe not happy]]>Hy Guys,

just having a look at the new kubernetes cluster creation (was about to start trying microk8s when I found this good stuff).

I have run the creation, got the master and three workers running, got the green finished popup (after a long time) and can log into the master and nodes happily, however,

kubectl get nodes (on the master) gives me
The connection to the server localhost:8080 was refused - did you specify the right host or port?

Not sure where to go from here to be honest.

Peter.

]]>https://xcp-ng.org/forum/topic/4142/kuberenets-cluster-recipe-not-happyRSS for NodeWed, 22 Apr 2026 12:07:22 GMTWed, 27 Jan 2021 06:20:29 GMT60<![CDATA[Reply to Kuberenets cluster recipe not happy on Sat, 27 Feb 2021 21:03:24 GMT]]>Thanks for the feedback @mathiashedberg !

]]>https://xcp-ng.org/forum/post/37131https://xcp-ng.org/forum/post/37131Sat, 27 Feb 2021 21:03:24 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Sat, 27 Feb 2021 20:10:54 GMT]]>@benjireis Looks like version 5.56.0 runs as expected! No issues so far!

]]>https://xcp-ng.org/forum/post/37129https://xcp-ng.org/forum/post/37129Sat, 27 Feb 2021 20:10:54 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Fri, 19 Feb 2021 10:12:06 GMT]]>@mathiashedberg good to know.

So you can wait for the fix or remove the xo:resource:xva:id from the other_configs of the snapshots or remove the snapshots

]]>https://xcp-ng.org/forum/post/36778https://xcp-ng.org/forum/post/36778Fri, 19 Feb 2021 10:12:06 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Fri, 19 Feb 2021 10:08:12 GMT]]>@benjireis
So you are correct on all those points. Here are the relevant params from the snapshot that was being used:

is-a-template ( RW): true
is-a-snapshot ( RO): true
other-config (MRW): auto_poweron: false; xo:resource:xva:id: a677aa91-f5d5-46ec-bd53-956b73fc7871; xo:resource:namespace: Debian10; xo:resource:xva:version: 1.0.0; import_task: OpaqueRef:71bd99c2-11c3-4306-a5b9-7fe6e86f551b; mac_seed: 02166646-6e3b-de07-1b11-872d538d3f01; base_template_name: Debian Stretch 9.0; install-methods: cdrom,nfs,http,ftp; linux_template: true
]]>https://xcp-ng.org/forum/post/36777https://xcp-ng.org/forum/post/36777Fri, 19 Feb 2021 10:08:12 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Fri, 19 Feb 2021 09:43:31 GMT]]>Okay so a fix is coming soon, i'll update here once released. 🙂

]]>https://xcp-ng.org/forum/post/36776https://xcp-ng.org/forum/post/36776Fri, 19 Feb 2021 09:43:31 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Fri, 19 Feb 2021 08:27:14 GMT]]>Double check what do you have when we install a template from XO Hub. If is-a-snapshot is at false, then yes, add this condition. We should use the installed template, not anything else.

]]>https://xcp-ng.org/forum/post/36775https://xcp-ng.org/forum/post/36775Fri, 19 Feb 2021 08:27:14 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Fri, 19 Feb 2021 08:19:40 GMT]]>@olivierlambert should I also check that is-a-snapshot is false?

]]>https://xcp-ng.org/forum/post/36774https://xcp-ng.org/forum/post/36774Fri, 19 Feb 2021 08:19:40 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Fri, 19 Feb 2021 08:12:38 GMT]]>That's an interesting thing. I think it might be a potential bug because of XenCenter snapshot algorithm that handle is-template differently than XO.

]]>https://xcp-ng.org/forum/post/36773https://xcp-ng.org/forum/post/36773Fri, 19 Feb 2021 08:12:38 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Fri, 19 Feb 2021 08:11:23 GMT]]>@mathiashedberg the snaphots might be indeed the problem.

When looking for the template, the recipe looks for a VM with xo:resource:xva:id=<template uuid> in its other-config, a snapshot of the template VM would probably have this field se and it should not.

Can you check if it's the case? and if the is-template field is true.

]]>https://xcp-ng.org/forum/post/36771https://xcp-ng.org/forum/post/36771Fri, 19 Feb 2021 08:11:23 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:38:07 GMT]]>@olivierlambert
The snapshot functionality is still quite tempting to use, as I have not had any issues with it before now. I'll admit I'm not too up to date on what features are recommended or not when it comes to XCP-NG.

@DustinB I think its great that we have such useful software that is free and open source. If my comment came off as negative I apologize, that was not my intention.

Moving forward I would assume that removing all my snapshots would remedy the issue. However I'm not too sure on how keen I am on doing that right at this moment with my current setup, maybe on a different test lab.

]]>https://xcp-ng.org/forum/post/36701https://xcp-ng.org/forum/post/36701Wed, 17 Feb 2021 18:38:07 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:25:56 GMT]]>@mathiashedberg said in Kuberenets cluster recipe not happy:

@olivierlambert For a homelab setup this is currently the only "free" solution to snapshotting that i know of (other than file system based like ZFS).

Going from "free" to 77USD a month is quite a jump imo.

Xen Orchestra is free and open source. You can follow the build from source instructions or use a script like the one posted to my github

]]>https://xcp-ng.org/forum/post/36695https://xcp-ng.org/forum/post/36695Wed, 17 Feb 2021 18:25:56 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:25:25 GMT]]>It's a bit off topic but:

  1. Remember, snapshot is not backup
  2. You can use XO from the sources to have all XO source code without feature restrictions (but XO hub/recipe is XOA because it's a service connected on xen-orchestra.com where we host the machines).

Anyway, let's try to find the original problem 🙂

]]>https://xcp-ng.org/forum/post/36694https://xcp-ng.org/forum/post/36694Wed, 17 Feb 2021 18:25:25 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:23:05 GMT]]>@olivierlambert For a homelab setup this is currently the only "free" solution to snapshotting that i know of (other than file system based like ZFS).

Going from "free" to 77USD a month is quite a jump imo.

]]>https://xcp-ng.org/forum/post/36693https://xcp-ng.org/forum/post/36693Wed, 17 Feb 2021 18:23:05 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:18:20 GMT]]>Please do NOT use XCP-ng Center "snapshot schedule" feature please 😞

]]>https://xcp-ng.org/forum/post/36692https://xcp-ng.org/forum/post/36692Wed, 17 Feb 2021 18:18:20 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:17:50 GMT]]>@olivierlambert Yes i removed it from the Hub > Templates view. It should be noted that i take regular backups of the VMs created with this debian 10 template, so i think it is using them

Backups are done with the XCP-NG center: 'Pool' > 'VM Snapshot Schedule' setting

]]>https://xcp-ng.org/forum/post/36691https://xcp-ng.org/forum/post/36691Wed, 17 Feb 2021 18:17:50 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:13:25 GMT]]>In XO, you can search it in Templates view and remove it 🙂

]]>https://xcp-ng.org/forum/post/36690https://xcp-ng.org/forum/post/36690Wed, 17 Feb 2021 18:13:25 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:13:12 GMT]]>Our recipe is based on Debian available in XO Hub template.

]]>https://xcp-ng.org/forum/post/36689https://xcp-ng.org/forum/post/36689Wed, 17 Feb 2021 18:13:12 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:13:11 GMT]]>@olivierlambert Ill remove them using the windows client

]]>https://xcp-ng.org/forum/post/36688https://xcp-ng.org/forum/post/36688Wed, 17 Feb 2021 18:13:11 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:12:40 GMT]]>So this new VM for k8s seems to be based on an existing VM, which itself is based on the Debian 10 template (when it was created a long time ago)

]]>https://xcp-ng.org/forum/post/36687https://xcp-ng.org/forum/post/36687Wed, 17 Feb 2021 18:12:40 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:12:02 GMT]]>Are you sure you removed the templates?

]]>https://xcp-ng.org/forum/post/36686https://xcp-ng.org/forum/post/36686Wed, 17 Feb 2021 18:12:02 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Wed, 17 Feb 2021 18:11:23 GMT]]>@olivierlambert

So after some more testing it seems the template mapping is wrong again. My k8s VMs started with 500MB, and when i looked at the bash history, i saw that yet again, the k8s VMs were based on an existing VM running on the system. The ram was set to 500MB because thats what the base VM ram settings were. This is the same issue as earlier on.

]]>https://xcp-ng.org/forum/post/36685https://xcp-ng.org/forum/post/36685Wed, 17 Feb 2021 18:11:23 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Tue, 16 Feb 2021 21:55:46 GMT]]>You can create a Debian 10 VM using a Debian 9 template, it doesn't matter (both are HVM guests, same config).

The current VM was probably made while Debian 10 template wasn't there yet.

]]>https://xcp-ng.org/forum/post/36650https://xcp-ng.org/forum/post/36650Tue, 16 Feb 2021 21:55:46 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Tue, 16 Feb 2021 21:54:09 GMT]]>@olivierlambert Ahh... it is 10 on the inside. 9 on the wrapper 🙂

]]>https://xcp-ng.org/forum/post/36649https://xcp-ng.org/forum/post/36649Tue, 16 Feb 2021 21:54:09 GMT<![CDATA[Reply to Kuberenets cluster recipe not happy on Tue, 16 Feb 2021 21:49:51 GMT]]>Can you provide a screenshot?

Also, double checking inside the VM that's debian 9 with a cat /etc/issue. Because the original template doesn't mean anything.

]]>https://xcp-ng.org/forum/post/36648https://xcp-ng.org/forum/post/36648Tue, 16 Feb 2021 21:49:51 GMT