XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Import OVA silently fails

    Scheduled Pinned Locked Moved Xen Orchestra
    23 Posts 5 Posters 8.5k Views 2 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • olivierlambertO Offline
      olivierlambert Vates 🪐 Co-Founder CEO
      last edited by

      Alternatively, there's an CLI tool to import an OVA

      1 Reply Last reply Reply Quote 0
      • DanpD Offline
        Danp Pro Support Team
        last edited by

        There's a newer version that includes improvements to the OVA import process. You can access it by switching to the latest release channel in XOA.

        1 Reply Last reply Reply Quote 0
        • A Offline
          Andrew C
          last edited by

          OK , i updated to lastest, and it has the same effect. Where do i find CLI documentation for importing?

          1 Reply Last reply Reply Quote 0
          • olivierlambertO Offline
            olivierlambert Vates 🪐 Co-Founder CEO
            last edited by

            https://github.com/vatesfr/xen-orchestra/tree/master/%40xen-orchestra/upload-ova#usage

            1 Reply Last reply Reply Quote 0
            • A Offline
              Andrew C
              last edited by

              Ok the file syslog has alot of errors in it, looks like unhandled promise chains. (.then errors) The file is 3MB, how can i get this file to you?

              Here is a snippet near the area of import:

              Apr  8 01:09:51 xoa xo-server[115382]: 2020-04-08T05:09:51.657Z xo:xapi DEBUG Creating VM Spiceworks-Production
Apr  8 01:09:51 xoa xo-server[115382]: 2020-04-08T05:09:51.728Z xo:xapi DEBUG Creating VDI Hard disk 1 on Local storage
Apr  8 01:09:51 xoa xo-server[115382]: 2020-04-08T05:09:51.729Z xo:xapi DEBUG Creating VIF for VM Spiceworks-Production on network MGMT-LAN
Apr  8 01:09:52 xoa xo-server[115382]: 2020-04-08T05:09:52.538Z xo:xapi DEBUG Creating VBD for VDI Hard disk 1 on VM [Importing...] Spiceworks-Production
Apr  8 01:11:07 xoa kernel: [3494938.746302] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=65109 PROTO=2 
Apr  8 01:11:07 xoa kernel: [3494938.746397] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=65110 PROTO=2 
Apr  8 01:13:17 xoa kernel: [3495068.743182] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=65116 PROTO=2 
Apr  8 01:13:17 xoa kernel: [3495068.743286] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=65117 PROTO=2 
Apr  8 01:15:27 xoa kernel: [3495198.739905] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=65122 PROTO=2 
Apr  8 01:15:27 xoa kernel: [3495198.739971] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=65123 PROTO=2 
Apr  8 01:15:54 xoa kernel: [3495225.770190] node invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0
Apr  8 01:15:54 xoa kernel: [3495225.770191] node cpuset=/ mems_allowed=0
Apr  8 01:15:54 xoa kernel: [3495225.770196] CPU: 1 PID: 115382 Comm: node Not tainted 4.19.0-8-amd64 #1 Debian 4.19.98-1
Apr  8 01:15:54 xoa kernel: [3495225.770196] Hardware name: Xen HVM domU, BIOS 4.11.1-7.8.xcpng8.0 12/12/2019
Apr  8 01:15:54 xoa kernel: [3495225.770197] Call Trace:
Apr  8 01:15:54 xoa kernel: [3495225.770206]  dump_stack+0x66/0x90
Apr  8 01:15:54 xoa kernel: [3495225.770211]  dump_header+0x6b/0x283
Apr  8 01:15:54 xoa kernel: [3495225.770214]  ? do_try_to_free_pages+0x2ec/0x370
Apr  8 01:15:54 xoa kernel: [3495225.770215]  oom_kill_process.cold.30+0xb/0x1cf
Apr  8 01:15:54 xoa kernel: [3495225.770217]  ? oom_badness+0xe9/0x140
Apr  8 01:15:54 xoa kernel: [3495225.770219]  out_of_memory+0x1a5/0x450
Apr  8 01:15:54 xoa kernel: [3495225.770221]  __alloc_pages_slowpath+0xbd8/0xcb0
Apr  8 01:15:54 xoa kernel: [3495225.770223]  __alloc_pages_nodemask+0x28b/0x2b0
Apr  8 01:15:54 xoa kernel: [3495225.770225]  filemap_fault+0x3bd/0x780
Apr  8 01:15:54 xoa kernel: [3495225.770228]  ? alloc_set_pte+0xf2/0x560
Apr  8 01:15:54 xoa kernel: [3495225.770229]  ? filemap_map_pages+0x1ed/0x3a0
Apr  8 01:15:54 xoa kernel: [3495225.770282]  ext4_filemap_fault+0x2c/0x40 [ext4]
Apr  8 01:15:54 xoa kernel: [3495225.770285]  __do_fault+0x36/0x130
Apr  8 01:15:54 xoa kernel: [3495225.770286]  __handle_mm_fault+0xe6c/0x1270
Apr  8 01:15:54 xoa kernel: [3495225.770288]  handle_mm_fault+0xd6/0x200
Apr  8 01:15:54 xoa kernel: [3495225.770291]  __do_page_fault+0x249/0x4f0
Apr  8 01:15:54 xoa kernel: [3495225.770294]  ? page_fault+0x8/0x30
Apr  8 01:15:54 xoa kernel: [3495225.770295]  page_fault+0x1e/0x30
Apr  8 01:15:54 xoa kernel: [3495225.770297] RIP: 0033:0x13a72b9
Apr  8 01:15:54 xoa kernel: [3495225.770303] Code: Bad RIP value.
Apr  8 01:15:54 xoa kernel: [3495225.770304] RSP: 002b:00007ffcf8ff0490 EFLAGS: 00010246
Apr  8 01:15:54 xoa kernel: [3495225.770305] RAX: 0000055c072656b9 RBX: 0000000000c0f1f0 RCX: 00000000030be010
Apr  8 01:15:54 xoa kernel: [3495225.770306] RDX: 000000003ab98c20 RSI: 0000000000000007 RDI: 0000000000000001
Apr  8 01:15:54 xoa kernel: [3495225.770307] RBP: 00007ffcf8ff04a0 R08: 000000000000001f R09: 0000000008bf8810
Apr  8 01:15:54 xoa kernel: [3495225.770307] R10: 0000000000000006 R11: 0000000000000127 R12: 00000f8be5127ad9
Apr  8 01:15:54 xoa kernel: [3495225.770308] R13: 00000000030fc400 R14: 0000000000000008 R15: 00007ffcf8ff04e8
Apr  8 01:15:54 xoa kernel: [3495225.770309] Mem-Info:
Apr  8 01:15:54 xoa kernel: [3495225.770313] active_anon:330003 inactive_anon:114458 isolated_anon:0
Apr  8 01:15:54 xoa kernel: [3495225.770313]  active_file:23 inactive_file:43 isolated_file:0
Apr  8 01:15:54 xoa kernel: [3495225.770313]  unevictable:0 dirty:0 writeback:0 unstable:0
Apr  8 01:15:54 xoa kernel: [3495225.770313]  slab_reclaimable:8284 slab_unreclaimable:12775
Apr  8 01:15:54 xoa kernel: [3495225.770313]  mapped:35 shmem:13 pagetables:2766 bounce:0
Apr  8 01:15:54 xoa kernel: [3495225.770313]  free:13146 free_pcp:413 free_cma:0
Apr  8 01:15:54 xoa kernel: [3495225.770315] Node 0 active_anon:1320012kB inactive_anon:457832kB active_file:92kB inactive_file:172kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:140kB dirty:0kB writeback:0kB shmem:52kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
Apr  8 01:15:54 xoa kernel: [3495225.770316] Node 0 DMA free:8008kB min:360kB low:448kB high:536kB active_anon:2988kB inactive_anon:4688kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:32kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Apr  8 01:15:54 xoa kernel: [3495225.770318] lowmem_reserve[]: 0 1916 1916 1916 1916
Apr  8 01:15:54 xoa kernel: [3495225.770319] Node 0 DMA32 free:44576kB min:44692kB low:55864kB high:67036kB active_anon:1317024kB inactive_anon:453144kB active_file:376kB inactive_file:524kB unevictable:0kB writepending:0kB present:2072576kB managed:1995344kB mlocked:0kB kernel_stack:4624kB pagetables:11032kB bounce:0kB free_pcp:1652kB local_pcp:300kB free_cma:0kB
Apr  8 01:15:54 xoa kernel: [3495225.770322] lowmem_reserve[]: 0 0 0 0 0
Apr  8 01:15:54 xoa kernel: [3495225.770323] Node 0 DMA: 12*4kB (UM) 9*8kB (UM) 5*16kB (UME) 6*32kB (UME) 5*64kB (UE) 5*128kB (UME) 4*256kB (UME) 3*512kB (UE) 0*1024kB 2*2048kB (UM) 0*4096kB = 8008kB
Apr  8 01:15:54 xoa kernel: [3495225.770342] Node 0 DMA32: 308*4kB (UMEH) 188*8kB (UMEH) 187*16kB (UMEH) 238*32kB (UMEH) 91*64kB (UEH) 54*128kB (UEH) 27*256kB (UMEH) 4*512kB (UME) 2*1024kB (UM) 4*2048kB (UM) 0*4096kB = 45280kB
Apr  8 01:15:54 xoa kernel: [3495225.770351] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Apr  8 01:15:54 xoa kernel: [3495225.770352] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Apr  8 01:15:54 xoa kernel: [3495225.770352] 99 total pagecache pages
Apr  8 01:15:54 xoa kernel: [3495225.770353] 31 pages in swap cache
Apr  8 01:15:54 xoa kernel: [3495225.770354] Swap cache stats: add 2889276, delete 2889244, find 929577/1183567
Apr  8 01:15:54 xoa kernel: [3495225.770354] Free swap  = 0kB
Apr  8 01:15:54 xoa kernel: [3495225.770355] Total swap = 2086908kB
Apr  8 01:15:54 xoa kernel: [3495225.770356] 522141 pages RAM
Apr  8 01:15:54 xoa kernel: [3495225.770356] 0 pages HighMem/MovableOnly
Apr  8 01:15:54 xoa kernel: [3495225.770356] 19329 pages reserved
Apr  8 01:15:54 xoa kernel: [3495225.770357] 0 pages hwpoisoned
              1 Reply Last reply Reply Quote 0
              • olivierlambertO Offline
                olivierlambert Vates 🪐 Co-Founder CEO
                last edited by

                This is a RAM issue. Raise your XOA RAM to 4GiB, if it continues, follow: https://xen-orchestra.com/docs/troubleshooting.html#memory

                1 Reply Last reply Reply Quote 0
                • A Offline
                  Andrew C
                  last edited by

                  After making those changes, it got further, but still halted at about 10%. (I upped to 8GB RAM)

                  Apr  8 16:38:22 xoa xo-server[467]: 2020-04-08T20:38:22.411Z xo:xapi DEBUG Creating VM Spiceworks-Production
Apr  8 16:38:22 xoa xo-server[467]: 2020-04-08T20:38:22.482Z xo:xapi DEBUG Creating VDI Hard disk 1 on Local storage
Apr  8 16:38:22 xoa xo-server[467]: 2020-04-08T20:38:22.483Z xo:xapi DEBUG Creating VIF for VM Spiceworks-Production on network MGMT-LAN
Apr  8 16:38:23 xoa xo-server[467]: 2020-04-08T20:38:23.294Z xo:xapi DEBUG Creating VBD for VDI Hard disk 1 on VM [Importing...] Spiceworks-Production
Apr  8 16:38:27 xoa kernel: [   66.534931] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=2660 PROTO=2 
Apr  8 16:40:37 xoa kernel: [  196.531337] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=2665 PROTO=2 
Apr  8 16:42:47 xoa kernel: [  326.527746] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:00:18:0a:86:53:c4:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=36 TOS=0x00 PREC=0xC0 TTL=1 ID=2671 PROTO=2 
Apr  8 16:44:16 xoa xoa-updater[472]: 2020-04-08T20:44:14.045Z xoa-updater WARN onMessage Error: Command failed: xenstore-read vm
Apr  8 16:44:16 xoa xoa-updater[472]: fatal error: runtime: out of memory
Apr  8 16:44:16 xoa xoa-updater[472]: runtime stack:
Apr  8 16:44:16 xoa xoa-updater[472]: runtime.throw(0x8108647, 0x16)

                  Here is my xo-server.service

                  ExecStart=/usr/local/bin/node --max-old-space-size=7680 /usr/local/bin/xo-server

                  Anything else we can try?

                  1 Reply Last reply Reply Quote 0
                  • olivierlambertO Offline
                    olivierlambert Vates 🪐 Co-Founder CEO
                    last edited by

                    So there's a leak when you import 😕 How big is the OVA?

                    Can you try with the OVA CLI?

                    1 Reply Last reply Reply Quote 0
                    • A Offline
                      Andrew C
                      last edited by

                      The VM is 138GB. I read those instructions, what i am failing to understand is where and how I point it to my local disk? Do you have an example of using a file in C:\Export (on a windows box)?

                      The example the OVA appears to be local to XOA?

                      Please advise,
                      Thank you

                      1 Reply Last reply Reply Quote 0
                      • A Offline
                        Andrew C
                        last edited by

                        I have tried to use a SR that is used for ISO:

                        xo-upload-ova --upload Spiceworks-Production.ova 1fee8757-644e-2bce-beb0-9f85380a5842 --override 'nameLabel=test' descriptionLabel='Spiceworks' memory=json:671088640 disks.vmdisk1.descriptionLabel='disk description' disks.vmdisk1.capacity=json:1342177280

                        The issue of course is, how do i get the settings for disk size and memory. When i try to:

                         xo-upload-ova --inspect Spiceworks-Production.ova 1fee8757-644e-2bce-beb0-9f85380a5842

                        It doesn't know where that file is, does it have to be on a Local SR to XOA?

                        1 Reply Last reply Reply Quote 0
                        • olivierlambertO Offline
                          olivierlambert Vates 🪐 Co-Founder CEO
                          last edited by

                          Ping @nraynaud who did that

                          1 Reply Last reply Reply Quote 0
                          • nraynaudN Offline
                            nraynaud XCP-ng Team
                            last edited by

                            I am looking into it on my side. I might come back with questions.

                            1 Reply Last reply Reply Quote 0
                            • A Offline
                              Andrew C
                              last edited by

                              OK no problem, i look forward to hearing from you. 😊

                              A 1 Reply Last reply Reply Quote 0
                              • A Offline
                                Andrew C @Andrew C
                                last edited by Andrew C

                                @nraynaud Any update?

                                1 Reply Last reply Reply Quote 0
                                • nraynaudN Offline
                                  nraynaud XCP-ng Team
                                  last edited by

                                  I'm still on it, I think I found an unrelated bug whose effect would be to upload a VM without any disk.

                                  1 Reply Last reply Reply Quote 0
                                  • nraynaudN Offline
                                    nraynaud XCP-ng Team
                                    last edited by

                                    I think I got the bug, there is some cleanup and QA to be done before releasing a fix.

                                    B 1 Reply Last reply Reply Quote 1
                                    • B Offline
                                      bnerickson @nraynaud
                                      last edited by

                                      @nraynaud Thanks for working on this. Is the fix pushed to the latest stream or still in QA?

                                      1 Reply Last reply Reply Quote 0
                                      • olivierlambertO Offline
                                        olivierlambert Vates 🪐 Co-Founder CEO
                                        last edited by

                                        It will be released very soon 🙂 (for this month release)

                                        B 1 Reply Last reply Reply Quote 0
                                        • B Offline
                                          bnerickson @olivierlambert
                                          last edited by

                                          @olivierlambert Thanks!

                                          1 Reply Last reply Reply Quote 0
                                          • ITJamieI ITJamie referenced this topic on

                                          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                                          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                                          With your input, this post could be even better 💗

                                          Register Login
                                          • First post
                                            Last post