Well, it seems like it works if I create a snapshot and create a new VM from the snapshot on the new server.

Should be workable for my need.