Cannot export OVAs
-
@olivierlambert it happens on more than more, i think i've only had 1 successfully export, all my VMs have just 1 disk and 1 network, some are windows and some are linux. I'm happy to provide/submit anything that helps you guys out.
-
If you can find any common thing about the failing VM, that might be useful. The challenge for us is to be able to reproduce the issue so we can find what's causing the problem
-
@olivierlambert the only thing i'm really noticing outwardly is that the only VM's that will export have much smaller drive sizes than the rest. The 3 that will export have 20GB or less drive size, the others are as you see, larger, but not really big. XO-proxy is built on the same ubuntu server build as my plex VM so its not just a windows vs linux thing.
-
That's already a clue
-
@olivierlambert Do you need at least as much free space on the SR (in particular, if the VM running) as there is storage space for this to work?
-
@tjkreidl FWIW my SR is low utilization
-
We need to try internally on "larger" VMs if we can reproduce the issue
-
@sluflyer06 Ah,
definitelyprobably not the issue! -
Tomorrow @Darkbeldin could you try to export a VM with a disk bigger than 25GiB in OVA? (on XOA latest). Thanks!
-
@olivierlambert Trying it now I keep you updated
-
I tried an export on Edge (vs chrome), it got to 475MB before it failed, which is further than it gets in chrome...doesn't seem very helpful though.
-
@sluflyer06 Any details in any of the logs?
-
@tjkreidl if you can do me a favor and paste the path to the various logs to look at, i'm happy to, just not sure the right places to make sure i catch
i just tried firefox as well, exports at about 1.4MB/s for about 440MB and then beings to slowly slow down until it hits 0 and then fails
-
@sluflyer06 Storage I/O logs should go to /var/log/SMlog if I recall correctly.
-
@tjkreidl After around 1 hour I'm still exporting on my side
-
@tjkreidl not seeing anything, it looks like the same text repeated more or less through the log over the hours i manually scrolled through and tried some searches.
I searched for W(w)arn, W)warning, (E)error
-
@tjkreidl http vs https? How are you exporting with http? The URL I get is https, i tried manually changing that to http but that didn't work
I also tried from a W10 VM and Ubuntu desktop VM, same results.
-
Dec 8 09:43:34 xen-730xd xapi: [error||1163154 HTTP 10.10.10.40->:::80|[XO] Exporting content of VDI KASM Disk R:1716c671a4c2|vhd_tool_wrapper] vhd-tool failed, returning VDI_IO_ERROR Dec 8 09:43:34 xen-730xd xapi: [error||1163154 HTTP 10.10.10.40->:::80|[XO] Exporting content of VDI KASM Disk R:1716c671a4c2|vhd_tool_wrapper] vhd-tool output: vhd-tool: internal error, uncaught exception:\x0A Unix.Unix_error(Unix.ECONNRESET, "write", "")\x0A \x0A Dec 8 09:43:35 xen-730xd xapi: [debug||1163154 HTTP 10.10.10.40->:::80|[XO] Exporting content of VDI KASM Disk R:1716c671a4c2|taskhelper] the status of R:1716c671a4c2 is failure; cannot set it to `failure Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] [XO] Exporting content of VDI KASM Disk R:1716c671a4c2 failed with exception Server_error(VDI_IO_ERROR, [ Device I/O errors ]) Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] Raised Server_error(VDI_IO_ERROR, [ Device I/O errors ]) Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 1/13 xapi Raised at file ocaml/xapi/vhd_tool_wrapper.ml, line 77 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 2/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 3/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 4/13 xapi Called from file ocaml/xapi/export_raw_vdi.ml, line 50 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 5/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 6/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 7/13 xapi Called from file ocaml/xapi/export_raw_vdi.ml, line 90 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 8/13 xapi Called from file ocaml/xapi/export_raw_vdi.ml, line 116 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 9/13 xapi Called from file ocaml/xapi/server_helpers.ml, line 101 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 10/13 xapi Called from file ocaml/xapi/server_helpers.ml, line 122 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 11/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 12/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 13/13 xapi Called from file lib/backtrace.ml, line 177 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] Dec 8 09:43:35 xen-730xd xapi: [debug||1164861 /var/lib/xcp/xapi||dummytaskhelper] task dispatch:session.logout D:29e6026e7e06 created by task D:d1b3995b0263 Dec 8 09:43:35 xen-730xd xapi: [ info||1164861 /var/lib/xcp/xapi|session.logout D:7523bcca94fa|xapi_session] Session.destroy trackid=c968b6dc084a017a6452cb2381301d9d Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] VDI.export_raw_vdi D:d1b3995b0263 failed with exception Server_error(VDI_IO_ERROR, [ Device I/O errors ]) Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] Raised Server_error(VDI_IO_ERROR, [ Device I/O errors ]) Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 1/13 xapi Raised at file lib/debug.ml, line 227 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 2/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 3/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 4/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 5/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 6/13 xapi Called from file ocaml/xapi/xapi_http.ml, line 201 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 7/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 8/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] VDI.export_raw_vdi D:14ad56338491 failed with exception Server_error(VDI_IO_ERROR, [ Device I/O errors ]) Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] Raised Server_error(VDI_IO_ERROR, [ Device I/O errors ]) Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] 1/1 xapi Raised at file (Thread 1163154 has no backtrace table. Was with_backtraces called?, line 0 Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||backtrace] Dec 8 09:43:35 xen-730xd xapi: [error||1163154 :::80||xapi_http] Unhandled Api_errors.Server_error(VDI_IO_ERROR, [ Device I/O errors ]) Dec 8 09:43:35 xen-730xd xapi: [debug||515 ||xenops] Event on VM bb987a49-84c2-40f5-b979-bd1c84d733c6; resident_here = true Dec 8 09:43:35 xen-730xd xapi: [debug||515 ||dummytaskhelper] task timeboxed_rpc D:fb413298ca81 created by task D:8f9e0052bcc3 Dec 8 09:43:35 xen-730xd xapi: [debug||1164862 /var/lib/xcp/xapi||dummytaskhelper] task dispatch:event.from D:9e1155c8ead5 created by task D:8f9e0052bcc3 Dec 8 09:43:39 xen-730xd xapi: [debug||1164863 HTTP 10.10.10.40->:::80|session.login_with_password D:f8a89f148638|xapi_session] Success: local auth, user root from HTTP request from Internet with User-Agent: unknown Dec 8 09:43:39 xen-730xd xapi: [ info||1164863 HTTP 10.10.10.40->:::80|session.login_with_password D:f8a89f148638|xapi_session] Session.create trackid=ee78e2f6b58e76414d999de124ea2a35 pool=false uname=root originator= is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49 Dec 8 09:43:39 xen-730xd xapi: [debug||1164864 /var/lib/xcp/xapi||dummytaskhelper] task dispatch:pool.get_all D:cd6ae8df6525 created by task D:f8a89f148638 Dec 8 09:43:39 xen-730xd xapi: [debug||1164868 :::80||api_effect] pool.add_to_other_config Dec 8 09:43:39 xen-730xd xapi: [error||1164868 HTTP 10.10.10.40->:::80|pool.add_to_other_config D:096f5b4f5c05|sql] Duplicate key in set or map: table pool; field other_config; ref OpaqueRef:95f6dc30-a79e-44c0-8aaa-bbde3a47f2f4; key xo:clientInfo:a1fa4c05-e866-50dd-1254-c1edfe2615ec Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] pool.add_to_other_config D:096f5b4f5c05 failed with exception Db_exn.Duplicate_key("pool", "other_config", "OpaqueRef:95f6dc30-a79e-44c0-8aaa-bbde3a47f2f4", "xo:clientInfo:a1fa4c05-e866-50dd-1254-c1edfe2615ec") Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] Raised Db_exn.Duplicate_key("pool", "other_config", "OpaqueRef:95f6dc30-a79e-44c0-8aaa-bbde3a47f2f4", "xo:clientInfo:a1fa4c05-e866-50dd-1254-c1edfe2615ec") Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 1/8 xapi Raised at file ocaml/database/db_cache_impl.ml, line 316 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 2/8 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 3/8 xapi Called from file ocaml/xapi/rbac.ml, line 233 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 4/8 xapi Called from file ocaml/xapi/server_helpers.ml, line 101 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 5/8 xapi Called from file ocaml/xapi/server_helpers.ml, line 122 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 6/8 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 7/8 xapi Called from file map.ml, line 135 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace] 8/8 xapi Called from file src/sexp_conv.ml, line 156 Dec 8 09:43:39 xen-730xd xapi: [error||1164868 :::80||backtrace]
-
Hmm might be unrelated to XO.
Can you export the VM in XVA?
-
Apparently the download failed on my side I think recreating the file after download.
I will retry tomorrow.