XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    VMware migration tool: we need your feedback!

    Scheduled Pinned Locked Moved Migrate to XCP-ng
    318 Posts 37 Posters 174.3k Views 30 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • planedropP Offline
      planedrop Top contributor @olivierlambert
      last edited by

      @olivierlambert I agree, would be good to hear from more people. We only run a handful of VMs on VMware so I may not be the best person to give detailed feedback.

      1 Reply Last reply Reply Quote 0
      • chrispro-21C Offline
        chrispro-21 @brezlord
        last edited by

        @brezlord said in VMware migration tool: we need your feedback!:

        TypeError

        I got something similar on the latest build of XO.
        System: ESXi 6.7.0 Update 3 (Build 15160138)

        vm.importFromEsxi
        {
          "host": "10.20.0.105",
          "network": "1816a2e5-562a-4559-531d-6b59f8ec1a5c",
          "password": "* obfuscated *",
          "sr": "eb23cb22-5b8c-9641-b801-c86397e05520",
          "sslVerify": false,
          "stopSource": true,
          "thin": false,
          "user": "root",
          "vm": "9"
        }
        {
          "message": "Cannot read properties of undefined (reading 'stream')",
          "name": "TypeError",
          "stack": "TypeError: Cannot read properties of undefined (reading 'stream')
            at file:///home/node/xen-orchestra/packages/xo-server/src/xo-mixins/migrate-vm.mjs:272:30
            at Task.runInside (/home/node/xen-orchestra/@vates/task/index.js:158:22)
            at Task.run (/home/node/xen-orchestra/@vates/task/index.js:137:20)"
        }
        
        florentF 1 Reply Last reply Reply Quote 0
        • florentF Offline
          florent Vates 🪐 XO Team @chrispro-21
          last edited by

          @chrispro-21 we're not able to import VM with snapshots from esxi 6.5+ , for now

          At least the next release will be able to ignore them or give a meaningfull error, if we have not finished the implementation of sesparse reading ( the disk snapshot format for esxi 6.5+)

          A 1 Reply Last reply Reply Quote 0
          • A Offline
            alexredston @florent
            last edited by olivierlambert

            Hi @florent I'm getting the same on ESXi 6.7 - have tried migrating the disk storage within VMWare first to see if it updated. Looking forwards to testing this new feature as soon as disk format sorted - in the mean time will look for a workaround.

            vm.importFromEsxi
            {
              "host": "172.29.49.11",
              "network": "b4d861c9-a735-b21c-6f58-655911cf8fb2",
              "password": "* obfuscated *",
              "sr": "1216d3f2-a60d-e68b-ea93-0b1b594a53cb",
              "sslVerify": true,
              "stopSource": false,
              "thin": false,
              "user": "administrator@blue.local",
              "vm": "vm-4292"
            }
            {
              "message": "sesparse Vmdk reading is not functionnal yet gbr-stf-blue-dc/gbr-stf-blue-dc-000001-sesparse.vmdk",
              "name": "Error",
              "stack": "Error: sesparse Vmdk reading is not functionnal yet gbr-stf-blue-dc/gbr-stf-blue-dc-000001-sesparse.vmdk
                at openDeltaVmdkasVhd (file:///opt/xo/xo-builds/xen-orchestra-202303171405/@xen-orchestra/vmware-explorer/openDeltaVmdkAsVhd.mjs:7:11)
                at file:///opt/xo/xo-builds/xen-orchestra-202303171405/packages/xo-server/src/xo-mixins/migrate-vm.mjs:267:27
                at Task.runInside (/opt/xo/xo-builds/xen-orchestra-202303171405/@vates/task/index.js:158:22)
                at Task.run (/opt/xo/xo-builds/xen-orchestra-202303171405/@vates/task/index.js:137:20)"
            }
            
            1 Reply Last reply Reply Quote 0
            • olivierlambertO Offline
              olivierlambert Vates 🪐 Co-Founder CEO
              last edited by

              @alexredston you can workaround it by stopping the VM and that will work 🙂

              A 1 Reply Last reply Reply Quote 0
              • A Offline
                alexredston @olivierlambert
                last edited by

                @olivierlambert Thanks - already underway.

                3 hours elapsed, 3 hours to go 80GB thick provisioned primary domain controller, unfortunately it was on a slow network card 1G, averaging about 42 MB per second during the transfer. Will try the next one on 10G and will see what the speed is like.

                RAID 1 on old server to RAID10 ADM triple mirrored and striped.

                R 1 Reply Last reply Reply Quote 0
                • olivierlambertO Offline
                  olivierlambert Vates 🪐 Co-Founder CEO
                  last edited by

                  Select thin on the XO V2V tool, that might be faster in the end. Patience is key 🙂

                  A 1 Reply Last reply Reply Quote 0
                  • R Offline
                    rochemike @alexredston
                    last edited by

                    @alexredston I don't know what "old server" means to you, but 42MB/se could be ~320Mbps which would be about the maximum on a SCSI bus. If I'm right and it's Ultra2 SCSI, there's little that you'll be able to speed up by increasing available network bandwidth.

                    https://en.wikipedia.org/wiki/Parallel_SCSI#:~:text=At 10 MHz with a,rate of 640 MB%2Fs.

                    Mike

                    A 1 Reply Last reply Reply Quote 0
                    • A Offline
                      alexredston @rochemike
                      last edited by

                      @rochemike SSD - so should go a little faster.

                      A 1 Reply Last reply Reply Quote 0
                      • A Offline
                        alexredston @olivierlambert
                        last edited by

                        @olivierlambert Trying another VM now - Linux this time, on ESXi it is 500GB thin provisioned with about 100GB in use - transfer died at around 20 hours + on thick, seemed to get nowhere on thin, but I'm not sure where to get error message to see what happened - just going to try again now after bringing XO up to date with master. Will try thin.

                        1 Reply Last reply Reply Quote 0
                        • A Offline
                          alexredston @alexredston
                          last edited by

                          @rochemike it did get there in the end - one down 28 to go

                          1 Reply Last reply Reply Quote 0
                          • olivierlambertO Offline
                            olivierlambert Vates 🪐 Co-Founder CEO
                            last edited by

                            \o/

                            Next release will have multi-VM import 🙂

                            florentF 1 Reply Last reply Reply Quote 0
                            • florentF Offline
                              florent Vates 🪐 XO Team @olivierlambert
                              last edited by

                              @olivierlambert yes
                              and the multi import will runVM two by two

                              1 Reply Last reply Reply Quote 1
                              • S Offline
                                stmboyd
                                last edited by

                                Hello,

                                I am not even able to connect. When I enter the credentials for my host and hit connect, I get an error when XO tries to iterate over the data:

                                esxi.listVms
                                {
                                  "host": "10.64.54.4",
                                  "user": "root",
                                  "password": "* obfuscated *",
                                  "sslVerify": false
                                }
                                {
                                  "message": "Cannot read properties of undefined (reading 'perDatastoreUsage')",
                                  "name": "TypeError",
                                  "stack": "TypeError: Cannot read properties of undefined (reading 'perDatastoreUsage')
                                    at file:///opt/xo/xo-builds/xen-orchestra-202303302257/@xen-orchestra/vmware-explorer/esxi.mjs:211:55
                                    at Array.map (<anonymous>)
                                    at Esxi.getAllVmMetadata (file:///opt/xo/xo-builds/xen-orchestra-202303302257/@xen-orchestra/vmware-explorer/esxi.mjs:209:31)
                                    at Api.#callApiMethod (file:///opt/xo/xo-builds/xen-orchestra-202303302257/packages/xo-server/src/xo-mixins/api.mjs:401:20)"
                                }
                                

                                Using XO from sources a41037833c960078d8509fd95e01aa0bb5a3670e
                                ESXi 6.5.0

                                Regardless of what the issue ends up being, is there maybe a better way of handling the flow? As in, when I click connect, can there be a landing page that says "connected", and allows for partial loading of info? Might be helpful, and will certainly be a better user experience.

                                1 Reply Last reply Reply Quote 0
                                • olivierlambertO Offline
                                  olivierlambert Vates 🪐 Co-Founder CEO
                                  last edited by

                                  1. Either try on latest commit on master or XOA with latest to see if it's better
                                  2. I don't understand the other part of your comment, if the error is during the connection, there's little more we can do
                                  S 1 Reply Last reply Reply Quote 0
                                  • S Offline
                                    stmboyd @olivierlambert
                                    last edited by

                                    @olivierlambert

                                    1. Did you even look at the commit I posted? When I ran this, it was 2 commits behind latest master. Was the commit of you updating a document supposed to make things better? How about the commit to Lite, was that really going to fix anything?

                                    2. Please at least make some effort here, I posted a trace for a reason.

                                    The failing line is this: https://github.com/vatesfr/xen-orchestra/blob/master/%40xen-orchestra/vmware-explorer/esxi.mjs#L211
                                    For some reason, this property is not available on storage.
                                    That code is called from here: https://github.com/vatesfr/xen-orchestra/blob/1942e55f763bd3d74c7cbc3dc1fc4c0ec070414c/packages/xo-server/src/xo-mixins/migrate-vm.mjs#L164

                                    Look at that function for a second, and then re-read what I said in the earlier comment. Why does this function try and do two things? I'm saying it may be a good idea to split this into 2 parts. First, only connect, and then display a page in XO that shows the connection is live, and then after that query the data. This would make things a bit nicer.

                                    More importantly, there needs to be some way for me to help figure out why the data that comes in is not in the format XO is expecting. That way we could solve a problem.

                                    In the future, please don't make several blog posts and a huge thread asking for "feedback" and then tell me "there's little more we can do" when you have done nothing, it doesn't really feel encouraging.

                                    florentF 1 Reply Last reply Reply Quote -2
                                    • olivierlambertO Offline
                                      olivierlambert Vates 🪐 Co-Founder CEO
                                      last edited by olivierlambert

                                      1. As per the documentation, it's asked to be sure you are on the latest commit on master. It solved countless of reports because people (in general) aren't following this simple rule. Since you are not more special than anyone else (there's dozen of new messages per day, I can't check each situation in details as we all offer assistance on our free time here), you should follow it. This is how it works here, and it's not personal, believe me 🙂
                                      2. "Make some effort": this is a community forum and not a paid assistance here. You should adapt your attitude if you want help, because this is really not helping to be rude or ask for help while nobody owe you anything. Being polite is a far more rewarding strategy to have help from others!

                                      Finally, we are fully open source, so you have also the opportunity to bring your knowledge and modify the code, even providing it via a pull request we'll be happy to read/comment and merge. https://xen-orchestra.com/docs/contributing.html for details.

                                      We'll be happy to assist as soon you understand what this place is: a community forum where people assist on their free time and because they want to assist people. Not because they have to. We (I think I can talk for a large part of the community) do not accept people coming and asking for results. You can criticize and report bugs, as long it's constructive and following our doc. If you want a guarantee of efforts or results, you can have pro support with a service you pay for 🙂

                                      I hope it's more clear, happy to assist you when it's understood 🙂

                                      1 Reply Last reply Reply Quote 0
                                      • florentF Offline
                                        florent Vates 🪐 XO Team @stmboyd
                                        last edited by florent

                                        @stmboyd Hi

                                        I wrote most of the code for v2v migration. Please note that

                                        • there is a huge number of things happening in this error, and this error is probably caused earlier during the api call to the ESXI, which is probably linked to a configuration on your part that we should try to handle, or at least identify. And we'll try, but it will take times, to identify it
                                          The real question, is why the storage is missing the soap api call should return it and the code should format it correctly . And that is why we ask for constructive feedback, making different productes talk together reliably is hard.

                                        • If the call to the api fail , the connect won't return anything usefull. If it succeed, we won't have much more to show ( maybe a "password/login seems ok ?) That will add one step for everybody , with , in my advice, little additionnal value, but I am not ready to die on this hill if there are other people advocating for it

                                        As @olivierlambert said, as soon as we are working in the same direction to solves this, we'll do our possible.

                                        1 Reply Last reply Reply Quote 0
                                        • pedroalvesbatistaP Offline
                                          pedroalvesbatista
                                          last edited by

                                          No tested yet, as soon some hosts are fine after our PXE enrollments, will test this out.
                                          Any scripts in the house to accelerate a little bit the process ?

                                          florentF 1 Reply Last reply Reply Quote 0
                                          • florentF Offline
                                            florent Vates 🪐 XO Team @pedroalvesbatista
                                            last edited by

                                            @pedroalvesbatista For now we're working on reliability and ease of use, performance won't be easy to improve. The main clue I have, would be to mount the dtastore of the esxi in XO, it may be faster than the HTTP API ( which does a surprising good job given the number of query we make )

                                            But if there are ideas, I would be happy to discuss them.

                                            1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post