Migrate VM with a private network to another host.

pnunn

I have what is currently a two machine setup. One machine has all the VM's on it currently and I have recently added another host to the pool. I now want to move the VM's to this host so that I can restart the first host to patch it.

Now, the host seems to have all of the private networks on it (no pif involved with these netorks) when I look at it in XE however, when I try and move a machine (in this case a simple one with only one private network on it) I get an error.

vm.migrate
{
  "vm": "7884cb7b-da2f-2614-e3d6-13e81509154b",
  "targetHost": "0eb70464-d6c1-452a-947a-97d79f5678f8"
}
{
  "code": "VM_REQUIRES_NETWORK",
  "params": [
    "OpaqueRef:41f9b169-4fe4-4754-b6c6-cf36ad7e25c0",
    "OpaqueRef:f0f2b013-9eb9-4f20-ad10-58edcbf2a5cc"
  ],
  "task": {
    "uuid": "289a29cf-43eb-3123-d91e-74c809e247aa",
    "name_label": "Async.VM.migrate_send",
    "name_description": "",
    "allowed_operations": [],
    "current_operations": {},
    "created": "20190613T11:09:26Z",
    "finished": "20190613T11:09:26Z",
    "status": "failure",
    "resident_on": "OpaqueRef:a80d8f14-f277-4a04-94df-166b7775824f",
    "progress": 1,
    "type": "<none/>",
    "result": "",
    "error_info": [
      "VM_REQUIRES_NETWORK",
      "OpaqueRef:41f9b169-4fe4-4754-b6c6-cf36ad7e25c0",
      "OpaqueRef:f0f2b013-9eb9-4f20-ad10-58edcbf2a5cc"
    ],
    "other_config": {},
    "subtask_of": "OpaqueRef:NULL",
    "subtasks": [],
    "backtrace": "(((process\"xapi @ xcp-oldyella\")(filename lib/debug.ml)(line 240))((process\"xapi @ xcp-oldyella\")(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process\"xapi @ xcp-oldyella\")(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 35))((process\"xapi @ xcp-oldyella\")(filename ocaml/xapi/message_forwarding.ml)(line 1715))((process\"xapi @ xcp-oldyella\")(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process\"xapi @ xcp-oldyella\")(filename ocaml/xapi/rbac.ml)(line 236))((process\"xapi @ xcp-oldyella\")(filename ocaml/xapi/server_helpers.ml)(line 83)))"
  },
  "message": "VM_REQUIRES_NETWORK(OpaqueRef:41f9b169-4fe4-4754-b6c6-cf36ad7e25c0, OpaqueRef:f0f2b013-9eb9-4f20-ad10-58edcbf2a5cc)",
  "name": "XapiError",
  "stack": "XapiError: VM_REQUIRES_NETWORK(OpaqueRef:41f9b169-4fe4-4754-b6c6-cf36ad7e25c0, OpaqueRef:f0f2b013-9eb9-4f20-ad10-58edcbf2a5cc)
    at Function.wrap (/root/xen-orchestra/packages/xen-api/src/_XapiError.js:16:11)
    at _default (/root/xen-orchestra/packages/xen-api/src/_getTaskResult.js:11:28)
    at Xapi._addRecordToCache (/root/xen-orchestra/packages/xen-api/src/index.js:795:37)
    at events.forEach.event (/root/xen-orchestra/packages/xen-api/src/index.js:816:13)
    at Array.forEach (<anonymous>)
    at Xapi._processEvents (/root/xen-orchestra/packages/xen-api/src/index.js:806:11)
    at /root/xen-orchestra/packages/xen-api/src/index.js:960:13
    at Generator.next (<anonymous>)
    at asyncGeneratorStep (/root/xen-orchestra/packages/xen-api/dist/index.js:58:103)
    at _next (/root/xen-orchestra/packages/xen-api/dist/index.js:60:194)
    at tryCatcher (/root/xen-orchestra/node_modules/bluebird/js/release/util.js:16:23)
    at Promise._settlePromiseFromHandler (/root/xen-orchestra/node_modules/bluebird/js/release/promise.js:512:31)
    at Promise._settlePromise (/root/xen-orchestra/node_modules/bluebird/js/release/promise.js:569:18)
    at Promise._settlePromise0 (/root/xen-orchestra/node_modules/bluebird/js/release/promise.js:614:10)
    at Promise._settlePromises (/root/xen-orchestra/node_modules/bluebird/js/release/promise.js:694:18)
    at _drainQueueStep (/root/xen-orchestra/node_modules/bluebird/js/release/async.js:138:12)
    at _drainQueue (/root/xen-orchestra/node_modules/bluebird/js/release/async.js:131:9)
    at Async._drainQueues (/root/xen-orchestra/node_modules/bluebird/js/release/async.js:147:5)
    at Immediate.Async.drainQueues (/root/xen-orchestra/node_modules/bluebird/js/release/async.js:17:14)
    at runCallback (timers.js:810:20)
    at tryOnImmediate (timers.js:768:5)
    at processImmediate [as _immediateCallback] (timers.js:745:5)"
} 

I'm guessing this is because the private networks are not infact pool wide (had a similar problem with VMWare) but I'm not sure how I add this network to the new host.

Any clues?
Ta
Peter.

olivierlambert

You can't have a shared private network by default (in other words: private network are "per host" only).

Good news: we'll have this feature implemented via a Xen Orchestra plugin (in beta) at the end of the month!

This will rely on Open vSwtich and GRE tunnels.

olivierlambert

Until then: remove the VIF, migrate and recreate it when the VM is on the other host

pnunn

@olivierlambert Thanks Oliver,

Problem is, can't migrate a machine that is off, and can't run without the network.. hmmm.. Guess I can clone and delete, but that's a bit ugly.

On VMWare you can atleast install the network on multiple hosts even though its only seeing machines on that host..

I eagerly await the fix in the mean time.

P.

olivierlambert

It's more than a fix, it's a new feature, requiring to talk to Open vSwitch to create a star topology with GRE tunnels. Months of developments. Not just a fix

pnunn

Does sound interesting. Were supposed to be going live any day now.. so our timing is off by the looks.

Seems I managed to mangle one of the test vm's trying to move hosts (deleted the network, tried to migrate it, re-create the network and now I can't even stop the machine).

The other ones in the set I just stopped and re-started and they popped across to the other host with the network intact by the looks.

Thing is, how do I force it to start on the second host? Seems to have done it by magic (guess because it had more resources) but I can't seem to find any way to say "start here".

What's going to be involved in upgrading to the new version? Is that going to be an easy process

P.

olivierlambert

Advanced tab of the VM view, "Start on…" button.

Cross server private network will be a Xen Orchestra plugin for our next release.