<![CDATA[NBD now causes excessive backup data size]]>@olivierlambert @florent @julien-f Since the big XO update push (after bee0eb9), backup (Continuous Replication and Delta) using NBD now has huge minimum data sizes (now running on master b0e00).

VMs that are 'off' normally have an update size of a few KBytes. Now (with NBD enabled) the update is 256MBytes for no reason. Turning off NBD returns backups to the normal size.

It may not see like a lot, but it adds up in both storage and transfer time.

]]>https://xcp-ng.org/forum/topic/8117/nbd-now-causes-excessive-backup-data-sizeRSS for NodeSun, 07 Jun 2026 13:39:09 GMTSun, 24 Dec 2023 05:19:30 GMT60<![CDATA[Reply to NBD now causes excessive backup data size on Wed, 27 Dec 2023 00:33:23 GMT]]>@florent I see it has been merged into master. Yes, transfer size seems to be back to before. I have not checked for damage. At worst I can just force a full backup.

]]>https://xcp-ng.org/forum/post/68850https://xcp-ng.org/forum/post/68850Wed, 27 Dec 2023 00:33:23 GMT<![CDATA[Reply to NBD now causes excessive backup data size on Tue, 26 Dec 2023 19:40:54 GMT]]>@Andrew Once more, thanks Andrew for your observation skills.

There was an error when skipping the batmap, which lead to misinterpreting part of the batmap as the BAT, and not reading the end of the BAT here https://github.com/vatesfr/xen-orchestra/commit/fc1357db937ecc458e1b7d780a434c09f5463ccc#diff-cbe0b4ffbcc4f57db4dbbb7b00a7e1f333faf8c098f4137f86c7f8a75be1fee1L50

Can you try this branch, it revert the header table offset computation at the right step
https://github.com/vatesfr/xen-orchestra/pull/7264 ?

I will investigate more tomorrow to see the impacts on the transferred backups, as they may be broken due to not reading the right block addresses.

fbeauchamp opened this pull request in vatesfr/xen-orchestra

closed fix(vhd-lib/createStreamNbd): skip original table offset before overwriting #7264

0 fbeauchamp committed to vatesfr/xen-orchestra 
refactor(nbd-client): remove unused method and default iterator
]]>https://xcp-ng.org/forum/post/68842https://xcp-ng.org/forum/post/68842Tue, 26 Dec 2023 19:40:54 GMT<![CDATA[Reply to NBD now causes excessive backup data size on Tue, 26 Dec 2023 18:32:20 GMT]]>@olivierlambert I can reproduce it . I will look for the cause ( and a fix)

]]>https://xcp-ng.org/forum/post/68839https://xcp-ng.org/forum/post/68839Tue, 26 Dec 2023 18:32:20 GMT<![CDATA[Reply to NBD now causes excessive backup data size on Sun, 24 Dec 2023 08:54:13 GMT]]>Weird 🤔 Maybe @florent knows why.

]]>https://xcp-ng.org/forum/post/68824https://xcp-ng.org/forum/post/68824Sun, 24 Dec 2023 08:54:13 GMT