<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Delta Backups not working anymore on a single host]]></title><description><![CDATA[<p dir="auto">Hi,</p>
<p dir="auto">i have a really strange behaviour on one of your xcp-ng Hosts.<br />
We have some XCP-ng Pools and 2 identical StandAlone Hosts.</p>
<p dir="auto">We use Delta-Backups (nightly) on a Xen-Orchestra VM from sources.</p>
<p dir="auto">A few weeks ago Delta Backups suddenly stopped working on only one of the two Standalone-Hosts, while Delta Backups keep working without any Problems on all other Hosts/Pools.</p>
<p dir="auto">The two identical Stand-Alone Hosts are:</p>
<ul>
<li>Lenovo SR655</li>
<li>AMD EPYC 7282 16-Core Processor</li>
<li>512GB RAM</li>
<li>Local ext4 SAS-Raid (around 3,5TB used of 17,3TB on a 9-Disk Raid-5)</li>
<li>2x 10Gbit as bond0</li>
</ul>
<p dir="auto">Both StandAlone Hosts are absolutely identical (even Firmware up2date and latest XCP-ng Patchlevel and rebootet in the last days, to try if anything will fix the problem)</p>
<p dir="auto">As the error initially appeared, the backup-logs started saying "stream has ended with not enough data", at the transfer-stage of the delta backups.</p>
<p dir="auto">I then started to clean snapshots and old backups on some VMs.<br />
After that, the first full backup of a that VMs was working fine, but the second then delta backup showed the same error.</p>
<p dir="auto">To dig deeper, i installed a fully new ubuntu 22 VM and installed Xen Orchestra from sources again and connected the 2 Standalone Hosts on that new XOfs-VM with a remote NFS-backup-remote.<br />
Same again. Initial Full-Backup works fine, first Delta fails one that one Host only, while working without problems on the other Host.<br />
But this time with staying in "transfer" forever. This status is staying even for days and the backup Job never finishes, so the job next day fails with "Error: the job (x) is already running".</p>
<p dir="auto">Today i restarted the XOfs-VM and updated to commit "afadc" and tried to reproduce with a new backup job with just one single VM.</p>
<p dir="auto">It seems to be a XCP-ng related thing, cause the other identical Host is working perfect.<br />
On that one Host i have the same thing. Initial Full is working, Delta comes never back and stuck at stage "transfer".</p>
<p dir="auto">When i watch the xe task-list while the backup is running, it seems the export-task is working fine for the delta and there is new data on the nfs-remote. Then at 100% the task dissapears, but the Backup-job stays in transfer and never comes Back.</p>
<p dir="auto">To eliminate all things maybe related to my "from sources" Installation (even the error is only on this one host and all others are working fine), i deployed a XOA-VM, but i cant start a free trial (you already consumed ...) and so i can not test Delta Backup.</p>
<p dir="auto">Do you have any ideas or maybe had a similar issue in the past?</p>
<p dir="auto">Kind regards<br />
Alex</p>
]]></description><link>https://xcp-ng.org/forum/topic/7194/delta-backups-not-working-anymore-on-a-single-host</link><generator>RSS for Node</generator><lastBuildDate>Wed, 15 Apr 2026 19:23:39 GMT</lastBuildDate><atom:link href="https://xcp-ng.org/forum/topic/7194.rss" rel="self" type="application/rss+xml"/><pubDate>Tue, 11 Apr 2023 14:17:59 GMT</pubDate><ttl>60</ttl><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Wed, 24 May 2023 07:18:45 GMT]]></title><description><![CDATA[<p dir="auto">Hi,</p>
<p dir="auto">sorry for the long break. i'll continue here for my colleague AlexD2006.</p>
<p dir="auto">We have now also tried with the current version (deeb3) of Xen-Orchestra, the problem remains the same. But we have now noticed other error messages (also with the old version) that appear during a delta backup ("base VDI is not a vhd; cannot compute differences"):</p>
<pre><code>May 23 16:40:35 xcp-mono02 xapi: [error||7644621 HTTPS 10.32.1.159-&gt;:::80|[XO] Exporting content of VDI test-vm.test 1 R:2e892fda7776|vhd_tool_wrapper] base VDI is not a vhd; cannot compute differences
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] [XO] Exporting content of VDI test-vm.test 1 R:2e892fda7776 failed with exception (Failure "base VDI is not a vhd; cannot compute differences")
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] Raised (Failure "base VDI is not a vhd; cannot compute differences")
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 1/14 xapi Raised at file stdlib.ml, line 29
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 2/14 xapi Called from file ocaml/xapi/vhd_tool_wrapper.ml, line 206
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 3/14 xapi Called from file ocaml/xapi/export_raw_vdi.ml, line 50
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 4/14 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 5/14 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 6/14 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 7/14 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 8/14 xapi Called from file ocaml/xapi/export_raw_vdi.ml, line 90
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 9/14 xapi Called from file ocaml/xapi/export_raw_vdi.ml, line 116
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 10/14 xapi Called from file ocaml/xapi/server_helpers.ml, line 101
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 11/14 xapi Called from file ocaml/xapi/server_helpers.ml, line 122
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 12/14 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 13/14 xapi Called from file string.ml, line 115
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace] 14/14 xapi Called from file src/sexp.ml, line 113
May 23 16:40:37 xcp-mono02 xapi: [error||7644621 :::80||backtrace]
</code></pre>
<p dir="auto">Can anyone say anything about the cause of the problem or any ideas for further analysis?</p>
]]></description><link>https://xcp-ng.org/forum/post/62511</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/62511</guid><dc:creator><![CDATA[fitcfitcfatc]]></dc:creator><pubDate>Wed, 24 May 2023 07:18:45 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Wed, 12 Apr 2023 07:23:18 GMT]]></title><description><![CDATA[<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/forum/user/alexd2006" aria-label="Profile: AlexD2006">@<bdi>AlexD2006</bdi></a> hi , this error means the host was cutting the backup stream. We have a few PR in the pipeline thath will improve (a little) the behaviour and help diagnose the root cause (XO or XCP)</p>
]]></description><link>https://xcp-ng.org/forum/post/61027</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61027</guid><dc:creator><![CDATA[florent]]></dc:creator><pubDate>Wed, 12 Apr 2023 07:23:18 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 16:23:56 GMT]]></title><description><![CDATA[<p dir="auto">crosstestet with XOA</p>
<ul>
<li>same remote-nfs</li>
<li>identical delta backup job</li>
<li>VM on the other identical Host.</li>
</ul>
<p dir="auto">All working fine as expected.</p>
<p dir="auto">So it seems that first Host has some Problems and is not providing any useful data when it comes to exporting the first delta snapshot.</p>
<p dir="auto">Unfortunately i have to change to customer support right now and have to stop my testings for today.<br />
I will keep going tomorrow.</p>
<p dir="auto">Thx for your support so far.</p>
]]></description><link>https://xcp-ng.org/forum/post/61017</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61017</guid><dc:creator><![CDATA[AlexD2006]]></dc:creator><pubDate>Tue, 11 Apr 2023 16:23:56 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 16:11:09 GMT]]></title><description><![CDATA[<p dir="auto">ok, so i tested with XOA.</p>
<p dir="auto">fully new (empty) NFS-Export mounted as remote in XOA.</p>
<ul>
<li>initial full backup in delta backup job successfull.</li>
<li>delta job fails with "Error: Expected values to be strictly equal: 430 !== 1536"</li>
</ul>
<p dir="auto">i will crosstest now with a VM on the working Host.</p>
]]></description><link>https://xcp-ng.org/forum/post/61014</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61014</guid><dc:creator><![CDATA[AlexD2006]]></dc:creator><pubDate>Tue, 11 Apr 2023 16:11:09 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 16:05:59 GMT]]></title><description><![CDATA[<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/forum/user/olivierlambert" aria-label="Profile: olivierlambert">@<bdi>olivierlambert</bdi></a></p>
<p dir="auto">its a 12-Disk Synology-NAS with btrfs.<br />
On that NFS-Storage are multiple folders exported as remotes in my XOfs Installations.<br />
As i said. All other Hosts/XOfs Installations work fine on that NFS-Storage.<br />
Only this one specific XCP-ng Host has these Problems. So i think its not XenOrchestra related. It seems to be a problem with XCP-ng on this specific Host, but the identical second Host does not have this Problem.</p>
]]></description><link>https://xcp-ng.org/forum/post/61013</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61013</guid><dc:creator><![CDATA[AlexD2006]]></dc:creator><pubDate>Tue, 11 Apr 2023 16:05:59 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 16:01:09 GMT]]></title><description><![CDATA[<p dir="auto">What's your filesystem on this NFS machine?</p>
]]></description><link>https://xcp-ng.org/forum/post/61011</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61011</guid><dc:creator><![CDATA[olivierlambert]]></dc:creator><pubDate>Tue, 11 Apr 2023 16:01:09 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 15:57:48 GMT]]></title><description><![CDATA[<p dir="auto">Thx <a class="plugin-mentions-user plugin-mentions-a" href="/forum/user/olivierlambert" aria-label="Profile: olivierlambert">@<bdi>olivierlambert</bdi></a> for extending the trial.</p>
<p dir="auto">I will make new tests with the XOA and tell my findings.</p>
<p dir="auto">Meanwhile i found out why the backup-job is hanging forever on my new XOfs Installation.</p>
<p dir="auto">When i mounted the NFS-remote, i checked the option "Store backup as multiple data".</p>
<p dir="auto">I removed the remote-nfs and reconnected it without that option.<br />
Now the full backup is working as expected and the first delta fails with "Error: stream has ended with not enough data (actual: 430, expected: 512)".</p>
<p dir="auto">So maybe there is a difference in the error handling when this option is active and the exception is not handled correctly.<br />
Just for your Information.</p>
<p dir="auto">I will come back when i tested with XOA.</p>
]]></description><link>https://xcp-ng.org/forum/post/61009</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61009</guid><dc:creator><![CDATA[AlexD2006]]></dc:creator><pubDate>Tue, 11 Apr 2023 15:57:48 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 15:55:05 GMT]]></title><description><![CDATA[<p dir="auto">Done!</p>
]]></description><link>https://xcp-ng.org/forum/post/61008</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61008</guid><dc:creator><![CDATA[olivierlambert]]></dc:creator><pubDate>Tue, 11 Apr 2023 15:55:05 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 14:47:10 GMT]]></title><description><![CDATA[<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/forum/user/olivierlambert" aria-label="Profile: olivierlambert">@<bdi>olivierlambert</bdi></a><br />
Many thanks for your help.<br />
Wrote you a p.m. with my e-mail. <img src="https://xcp-ng.org/forum/assets/plugins/nodebb-plugin-emoji/emoji/android/1f642.png?v=a78c449d9ac" class="not-responsive emoji emoji-android emoji--slightly_smiling_face" style="height:23px;width:auto;vertical-align:middle" title=":)" alt="🙂" /></p>
]]></description><link>https://xcp-ng.org/forum/post/61002</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61002</guid><dc:creator><![CDATA[AlexD2006]]></dc:creator><pubDate>Tue, 11 Apr 2023 14:47:10 GMT</pubDate></item><item><title><![CDATA[Reply to Delta Backups not working anymore on a single host on Tue, 11 Apr 2023 14:43:39 GMT]]></title><description><![CDATA[<p dir="auto">Just let me know your email in private message so I can extend your trial <img src="https://xcp-ng.org/forum/assets/plugins/nodebb-plugin-emoji/emoji/android/1f642.png?v=a78c449d9ac" class="not-responsive emoji emoji-android emoji--slightly_smiling_face" style="height:23px;width:auto;vertical-align:middle" title=":)" alt="🙂" /></p>
]]></description><link>https://xcp-ng.org/forum/post/61001</link><guid isPermaLink="true">https://xcp-ng.org/forum/post/61001</guid><dc:creator><![CDATA[olivierlambert]]></dc:creator><pubDate>Tue, 11 Apr 2023 14:43:39 GMT</pubDate></item></channel></rss>