<![CDATA[Keep getting "HTTP connection has timed out" on my Delta Backup]]>Some info before I explain in detail:

  • The external Server is a Synology Diskstation which I use with SMB
  • The Xen Orchestra version I have installed is from sources with the newest commit
  • I gave the Xen Orchestra VM 4GB of RAM and 30GB of Storage
  • I have had this issue for many months and tried many things (switching to NFS, manually mounting and using mount as local in Xen Orchestra, reinstalling Xen Orchestra completely and again NFS and manual mount)

9a6b0cd9-827f-47e3-a196-e5eaf927d4b1-image.png

Above you can see what I mean. I keep getting this error on like half of the VMs when 6 AM arrives and the backup runs. It's not the same VMs every time, it is not the same amount every time, retrying the failed backups sometimes work, but sometimes it doesn't.
My current solution is to retry the failed ones over and over until all of them worked. But that sometimes takes 5 tries or more.

Does anyone have an idea why this could happen? And what exactly does that mean? Is that meaning that the HTTP connection to the Xen API on my Host timed out or something else?

If there is anything i can do to give more info, let me know.

]]>https://xcp-ng.org/forum/topic/5769/keep-getting-http-connection-has-timed-out-on-my-delta-backupRSS for NodeTue, 19 May 2026 22:23:55 GMTThu, 14 Apr 2022 08:30:24 GMT60<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 13:53:48 GMT]]>Hi, you can try this work-around, just create this file /etc/xo-server/config.httpInactivityTimeout.toml:

# Work-around HTTP timeout issue during backups
[xapiOptions]
httpInactivityTimeout = 1800000 # 30 mins
]]>https://xcp-ng.org/forum/post/48370https://xcp-ng.org/forum/post/48370Thu, 14 Apr 2022 13:53:48 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 11 Aug 2022 11:58:40 GMT]]>@olivierlambert Yes, it seems so. The switches are of different brands between RACs and since a year ago the datacenter was divided in 2 companies and we are not sure how they have organized the networks.
Then I had another error but with "rescan all disks" on the host it was solved.
🙂

]]>https://xcp-ng.org/forum/post/51999https://xcp-ng.org/forum/post/51999Thu, 11 Aug 2022 11:58:40 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 11 Aug 2022 11:47:43 GMT]]>Hi,

Thanks for the feedback. So basically your network couldn't handle the traffic?

]]>https://xcp-ng.org/forum/post/51998https://xcp-ng.org/forum/post/51998Thu, 11 Aug 2022 11:47:43 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 11 Aug 2022 11:30:29 GMT]]>@ronivay thank you 🙂
I kept having network problems... many servers were losing connectivity.
After realizing that the backup traffic goes through xoce first, I found the problem as the VMs (RAC1) were going through xoce (RAC2) and then back to RAC1 (Synology).
I created an XOCE clone VM on RAC1 and the backups now run without "HTTP connection has timed out" and no network flapping.

]]>https://xcp-ng.org/forum/post/51987https://xcp-ng.org/forum/post/51987Thu, 11 Aug 2022 11:30:29 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 04 Aug 2022 05:52:21 GMT]]>@vbits looks like you used XenOrchestraInstallerUpdater so i can just reply here.

If you used default user in the scripts config, you can put this timeout override config to /root/.config/xo-server directory and restart xo-server service. If you used other user than root, then same thing but /root -> /users/homedirectory

]]>https://xcp-ng.org/forum/post/51849https://xcp-ng.org/forum/post/51849Thu, 04 Aug 2022 05:52:21 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Tue, 02 Aug 2022 11:36:43 GMT]]>How did you install it? If you did yourself, then go where you cloned the repo 🙂 If you used a 3rd party script, ask the 3rd party provider 🙂

]]>https://xcp-ng.org/forum/post/51758https://xcp-ng.org/forum/post/51758Tue, 02 Aug 2022 11:36:43 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Tue, 02 Aug 2022 10:46:07 GMT]]>@ToasterUwU Hi,

where to create this file?
I have XOCE self compiled and I have several routes with xo-server:

/opt/xo/xo-builds/xen-orchestra-202208011909/packages/xo-server/
/opt/xo/xo-src/xen-orchestra/packages/xo-server/
/var/lib/xo-server
/opt/xo/xo-server (I think here "systemd")

I have 2 very large VMs of 400GB that whenever I try to configure a backup I get "time out" and during the time it tries there is a lot of instability in the network / RAC.
Most of the VMs and physical servers lose connectivity.
With NFS I never could
With SMB it works with truenas being in another RAC but the network problems always appear.
This time I set up a SMB on synology in the same RAC thinking that the problem would be due to the amount of transfer between RACs but even being in the same RAC gives me the same error.

6913897a-92de-4492-a187-76a87e850a27-image.png

]]>https://xcp-ng.org/forum/post/51754https://xcp-ng.org/forum/post/51754Tue, 02 Aug 2022 10:46:07 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 16:46:58 GMT]]>@olivierlambert perfect, I tried it and it works! Thank you very much. Finally I'm free of this issue 😄

]]>https://xcp-ng.org/forum/post/48382https://xcp-ng.org/forum/post/48382Thu, 14 Apr 2022 16:46:58 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 16:41:43 GMT]]>It can be in the xo-server folder

]]>https://xcp-ng.org/forum/post/48381https://xcp-ng.org/forum/post/48381Thu, 14 Apr 2022 16:41:43 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 16:17:22 GMT]]>@julien-f does it have to be /etc/xo-server/ or do you just mean the xo-server folder where all the files for XO are?

]]>https://xcp-ng.org/forum/post/48380https://xcp-ng.org/forum/post/48380Thu, 14 Apr 2022 16:17:22 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 13:53:48 GMT]]>Hi, you can try this work-around, just create this file /etc/xo-server/config.httpInactivityTimeout.toml:

# Work-around HTTP timeout issue during backups
[xapiOptions]
httpInactivityTimeout = 1800000 # 30 mins
]]>https://xcp-ng.org/forum/post/48370https://xcp-ng.org/forum/post/48370Thu, 14 Apr 2022 13:53:48 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 10:02:53 GMT]]>It means that one end isn't answering fast enough probably due to connection timeout (as I said, a flaky connection for example).

I don't remember the config, I think @julien-f did make a change. Let's see if he's around 🙂

]]>https://xcp-ng.org/forum/post/48363https://xcp-ng.org/forum/post/48363Thu, 14 Apr 2022 10:02:53 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 09:59:41 GMT]]>@Forza Damn. Being a broke student with a hobby and interest in IT things sucks.

Thanks anyways, lets hope @olivierlambert knows what to do.

]]>https://xcp-ng.org/forum/post/48362https://xcp-ng.org/forum/post/48362Thu, 14 Apr 2022 09:59:41 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 09:50:41 GMT]]>@ToasterUwU said in Keep getting "HTTP connection has timed out" on my Delta Backup:

@Forza Is there a way I could set the timeout to something higher myself for my installation? Or anything I can do in general to don't have that issue anymore?

I do not know how it was done. We have a support contract so the support team helped through the support tunnel.

]]>https://xcp-ng.org/forum/post/48361https://xcp-ng.org/forum/post/48361Thu, 14 Apr 2022 09:50:41 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 09:49:02 GMT]]>@Forza Is there a way I could set the timeout to something higher myself for my installation? Or anything I can do in general to don't have that issue anymore?

]]>https://xcp-ng.org/forum/post/48360https://xcp-ng.org/forum/post/48360Thu, 14 Apr 2022 09:49:02 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 09:45:59 GMT]]>@olivierlambert

This looks like an error we had. The support team ( @julien-f ) fixed a timeout setting on the XOA instance and it has been working since then.

]]>https://xcp-ng.org/forum/post/48359https://xcp-ng.org/forum/post/48359Thu, 14 Apr 2022 09:45:59 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 09:39:37 GMT]]>@olivierlambert Here is what the error log gives as reason for the error:

Error: HTTP connection has timed out\n at IncomingMessage.emitAbortedError (/opt/xo/xo-builds/xen-orchestra-202204122029/node_modules/http-request-plus/index.js:83:19)\n at Object.onceWrapper (events.js:519:28)\n at IncomingMessage.emit (events.js:400:28)\n at IncomingMessage.patchedEmit [as emit] (/opt/xo/xo-builds/xen-orchestra-202204122029/@xen-orchestra/log/configure.js:120:17)\n at TLSSocket.socketCloseListener (_http_client.js:432:11)\n at TLSSocket.emit (events.js:412:35)\n at TLSSocket.patchedEmit [as emit] (/opt/xo/xo-builds/xen-orchestra-202204122029/@xen-orchestra/log/configure.js:120:17)\n at net.js:686:12\n at TCP.done (_tls_wrap.js:564:7)\n at TCP.callbackTrampoline (internal/async_hooks.js:130:17)

I have no real clue what that means in human language, but that's all the log can offer.

The connection between the Host and the NAS is a switch with LAN. The connection is not unstable, its not slow or anything. I use the same switch and same cables to move files to my PC and I never got any kind of issue.

]]>https://xcp-ng.org/forum/post/48358https://xcp-ng.org/forum/post/48358Thu, 14 Apr 2022 09:39:37 GMT<![CDATA[Reply to Keep getting "HTTP connection has timed out" on my Delta Backup on Thu, 14 Apr 2022 08:57:57 GMT]]>Check the detailed log for the error. It might be due to a flaky connection between some elements in the chain.

]]>https://xcp-ng.org/forum/post/48354https://xcp-ng.org/forum/post/48354Thu, 14 Apr 2022 08:57:57 GMT