K8s recipe - ticket lodged already

[tking-f5]

This is simply to share updates on the forum once we find a solution.

We attempted to deploy a K8s recipe on XOA 5.98.1.
1 control and 1 worker.
Static IPs.
SSH key.

{
  "message": "no object with UUID or opaque ref: undefined",
  "name": "Error",
  "stack": "Error: no object with UUID or opaque ref: undefined
    at Xapi.apply (file:///usr/local/lib/node_modules/xo-server/node_modules/xen-api/index.mjs:757:11)
    at Xapi.getObject (file:///usr/local/lib/node_modules/xo-server/src/xapi/index.mjs:98:26)
    at Xapi.apply (file:///usr/local/lib/node_modules/xo-server/src/xapi/mixins/vm.mjs:63:27)
    at Xapi.createVm (/usr/local/lib/node_modules/xo-server/node_modules/golike-defer/src/index.js:85:19)
    at Xoa.createCluster (/usr/local/lib/node_modules/xo-server-xoa/src/recipes/kubernetes-cluster.js:395:35)
    at Task.runInside (/usr/local/lib/node_modules/xo-server/node_modules/@vates/task/index.js:169:22)
    at Task.run (/usr/local/lib/node_modules/xo-server/node_modules/@vates/task/index.js:153:20)
    at Api.#callApiMethod (file:///usr/local/lib/node_modules/xo-server/src/xo-mixins/api.mjs:389:20)"
}

I'll update here once we find a solution with the folks at Vates.

[olivierlambert]

Do you have the same issue on latest?

[tking-f5]

@olivierlambert said in K8s recipe - ticket lodged already:

Do you have the same issue on latest?

I haven't tried the Latest channel since the cluster is considered production. How risky would it be?

[olivierlambert]

It's rather stable, you can just go to it and rollback after testing anyway

[tking-f5]

@olivierlambert 'Latest' got us past that error. Now it stopped with just the Control Plane VM and the recipe's task still Pending.

[nathanael-h]

@tking-f5 Could you share the version of kubernetes you tried to install, and the raw logs of the task pending?

[tking-f5]

@nathanael-h - this includes the K8s version:

{
  "id": "0m296bs8j",
  "properties": {
    "method": "xoa.recipe.createKubernetesCluster",
    "params": {
      "clusterName": "seanp-evaluation-cluster",
      "controlPlaneIpAddress": "10.146.30.7/26",
      "controlPlanePoolSize": 1,
      "gatewayIpAddress": "10.146.30.62",
      "k8sVersion": "1.31.1",
      "nameservers": [
        "192.168.180.15"
      ],
      "nbNodes": 1,
      "network": "0311868b-99a6-8959-8a1f-8ed2e6a0acd1",
      "sr": "4c4a1c4a-20a9-c0a0-c395-70a645bbfc7c",
      "sshKey": "<<<redacted>>>",
      "workerNodeIpAddresses": [
        "10.146.30.8/26"
      ]
    },
    "name": "API call: xoa.recipe.createKubernetesCluster",
    "userId": "004e5612-89cd-4e23-890a-83d36b6c8cee",
    "type": "api.call"
  },
  "start": 1728919997875,
  "status": "pending",
  "updatedAt": 1728919997875
}

[tking-f5]

It appears this works on 'Latest' / 5.99.1. We're now going to look at the cluster to see how the cluster is designed via the recipe. Thanks!