<![CDATA[Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source)]]>Discarded my start of this post yesterday because I was too far behind with the updates. I yesterday updated to Xen Orchestra, commit c2144 (currently 2 commits behind), and the problem remains.
I have, after the update of XO restarted that machine, also updated and restarted the other (first below) machine.

Replication is transferred to a host with its own local storage on SSD.

d92aac46-b207-4cf5-95ce-47936e05cc5a-image.png

{
  "data": {
    "mode": "delta",
    "reportWhen": "failure"
  },
  "id": "1757507401899",
  "jobId": "0bb53ced-4d52-40a9-8b14-7cd1fa2b30fe",
  "jobName": "Admin Ubuntu 24",
  "message": "backup",
  "scheduleId": "69a05a67-c43b-4d23-b1e8-ada77c70ccc4",
  "start": 1757507401899,
  "status": "success",
  "infos": [
    {
      "data": {
        "vms": [
          "1728e876-5644-2169-6c62-c764bd8b6bdf"
        ]
      },
      "message": "vms"
    }
  ],
  "tasks": [
    {
      "data": {
        "type": "VM",
        "id": "1728e876-5644-2169-6c62-c764bd8b6bdf",
        "name_label": "Admin Ubuntu 24"
      },
      "id": "1757507403766",
      "message": "backup VM",
      "start": 1757507403766,
      "status": "success",
      "tasks": [
        {
          "id": "1757507404364",
          "message": "snapshot",
          "start": 1757507404364,
          "status": "success",
          "end": 1757507406083,
          "result": "79b28f7e-ded1-ed95-4b3b-005f64e69796"
        },
        {
          "data": {
            "id": "9d2121f8-6839-39d4-4e90-850a5b6f1bbb",
            "isFull": false,
            "name_label": "Local h2 SSD new",
            "type": "SR"
          },
          "id": "1757507406083:0",
          "message": "export",
          "start": 1757507406083,
          "status": "success",
          "tasks": [
            {
              "id": "1757507408827",
              "message": "transfer",
              "start": 1757507408827,
              "status": "success",
              "end": 1757512215875,
              "result": {
                "size": 52571406336
              }
            }
          ],
          "end": 1757512216056
        }
      ],
      "warnings": [
        {
          "message": "Backup fell back to a full"
        }
      ],
      "infos": [
        {
          "message": "will delete snapshot data"
        },
        {
          "data": {
            "vdiRef": "OpaqueRef:47180590-40ab-f301-57bf-85c2fbe9b51d"
          },
          "message": "Snapshot data has been deleted"
        }
      ],
      "end": 1757512217031
    }
  ],
  "end": 1757512217032
}

db7401ef-485f-42bc-808f-5c70ed55a931-image.png

{
  "data": {
    "mode": "delta",
    "reportWhen": "failure"
  },
  "id": "1757574000010",
  "jobId": "883e2ee8-00c8-43f8-9ecd-9f9aa7aa01d1",
  "jobName": "Deb12-XO",
  "message": "backup",
  "scheduleId": "19aab592-cd48-431e-a82c-525eba60fcc7",
  "start": 1757574000010,
  "status": "success",
  "infos": [
    {
      "data": {
        "vms": [
          "30829107-2a1b-6b20-a08a-f2c1e612b2ee"
        ]
      },
      "message": "vms"
    }
  ],
  "tasks": [
    {
      "data": {
        "type": "VM",
        "id": "30829107-2a1b-6b20-a08a-f2c1e612b2ee",
        "name_label": "Deb12-XO"
      },
      "id": "1757574001999",
      "message": "backup VM",
      "start": 1757574001999,
      "status": "success",
      "tasks": [
        {
          "id": "1757574002518",
          "message": "snapshot",
          "start": 1757574002518,
          "status": "success",
          "end": 1757574004197,
          "result": "73a6e7d5-fcd6-e65f-ddd8-9dd700596505"
        },
        {
          "data": {
            "id": "9d2121f8-6839-39d4-4e90-850a5b6f1bbb",
            "isFull": false,
            "name_label": "Local h2 SSD new",
            "type": "SR"
          },
          "id": "1757574004197:0",
          "message": "export",
          "start": 1757574004197,
          "status": "success",
          "tasks": [
            {
              "id": "1757574006959",
              "message": "transfer",
              "start": 1757574006959,
              "status": "success",
              "end": 1757576397226,
              "result": {
                "size": 28974252032
              }
            }
          ],
          "end": 1757576397820
        }
      ],
      "warnings": [
        {
          "message": "Backup fell back to a full"
        }
      ],
      "infos": [
        {
          "message": "will delete snapshot data"
        },
        {
          "data": {
            "vdiRef": "OpaqueRef:b0ab2f7c-6606-bc15-cdcc-f7f002f3181a"
          },
          "message": "Snapshot data has been deleted"
        }
      ],
      "end": 1757576398882
    }
  ],
  "end": 1757576398883
}
]]>https://xcp-ng.org/forum/topic/11261/continuous-replication-jobs-creates-full-backups-every-time-since-2025-09-06-xo-from-sourceRSS for NodeFri, 15 May 2026 17:01:09 GMTThu, 11 Sep 2025 11:11:33 GMT60<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Wed, 24 Sep 2025 23:55:08 GMT]]>@florent It seems the Type: delta display during Backup fell back to a full may just be a display issue as it does seem to run a full copy.

]]>https://xcp-ng.org/forum/post/97702https://xcp-ng.org/forum/post/97702Wed, 24 Sep 2025 23:55:08 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Tue, 16 Sep 2025 22:59:51 GMT]]>@peo without deleting, the CBT can fail, but XO can still compute the changed blocks
before previous release, the fallback was hidden if you didn't look at the size

the CBT issue is on the hypervisor storage side .

But at least , the replication issue is fixed, we are back to the good old issues

]]>https://xcp-ng.org/forum/post/97453https://xcp-ng.org/forum/post/97453Tue, 16 Sep 2025 22:59:51 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Tue, 16 Sep 2025 21:46:26 GMT]]>@florent said in Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source):

@Andrew @peo
are you using purge snapshot data ?
In both case, can you try disabling it and disabling CBT on the relevant VMs ?

Yes, I was using CBT + purge snapshots, but that might not have been the reason for the sluggish transfer speeds with the later versions of XO.

I discovered that the SSD on my destination host were going bad, a write of a /dev/null-filled test file (1GB then 5GB) on the device started at expected 450MB/s, but slowed down to less than 10MB/s. Found a bunch of unexpected errors (because the disk was more or less new) in the logs by dmesg.
Doing the replication to another host made it fast even when transferred in full.
CBT+delete = still "Backup fell back to a full" (this was the third since my XO update)
CBT w/o delete = first backup=full transfer (4 min) and garbage collection (a few more minutes), second=delta transfer (a few seconds backup time)

]]>https://xcp-ng.org/forum/post/97451https://xcp-ng.org/forum/post/97451Tue, 16 Sep 2025 21:46:26 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Tue, 16 Sep 2025 14:25:23 GMT]]>@Andrew @peo
are you using purge snapshot data ?
In both case, can you try disabling it and disabling CBT on the relevant VMs ?

]]>https://xcp-ng.org/forum/post/97431https://xcp-ng.org/forum/post/97431Tue, 16 Sep 2025 14:25:23 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Tue, 16 Sep 2025 13:53:28 GMT]]>@florent JOURNALCTL.jpeg

I made the backup again and everything went back to normal. Everything is wonderful! Thank you so much!

]]>https://xcp-ng.org/forum/post/97430https://xcp-ng.org/forum/post/97430Tue, 16 Sep 2025 13:53:28 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Tue, 16 Sep 2025 11:10:44 GMT]]>I'm currently testing the "fixed" version. At the time I ran the replications the first time, I expected and accepted it doing new "first" full backups/transfers, but even this small, singe-disk VM (the one for my XO) is still doing full transfers:
fe04762a-02ed-4b4e-9e14-fcb7be8330d9-image.png

This simple operation previously taking 2-5 minutes now takes 44 minutes:
39bc2c0a-93dc-4627-8901-e24fb5ddf729-image.png

Compared to the previous "normal" backup time:
19407049-8301-4a15-8afd-d6e3f78f36c6-image.png

The same goes for "Admin Ubuntu 24", single but slightly larger disk (50GB) which yesterday took 4 hours (initial "new" "first" backup, so I don't know if it still takes that time)

]]>https://xcp-ng.org/forum/post/97423https://xcp-ng.org/forum/post/97423Tue, 16 Sep 2025 11:10:44 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Tue, 16 Sep 2025 00:04:55 GMT]]>@florent

Sep 15 10:00:01 xo1 xo-server[5582]: 2025-09-15T14:00:01.026Z xo:backups:worker INFO starting backup
Sep 15 10:00:32 xo1 xo-server[5582]: 2025-09-15T14:00:32.794Z xo:xapi:xapi-disks INFO Error in openNbdCBT XapiError: SR_BACKEND_FAILURE_460(, Failed to calculate changed blocks for given VD
Is. [opterr=Source and target VDI are unrelated], )
Sep 15 10:00:32 xo1 xo-server[5582]:     at XapiError.wrap (file:///opt/xo/xo-builds/xen-orchestra-202509150942/packages/xen-api/_XapiError.mjs:16:12)
Sep 15 10:00:32 xo1 xo-server[5582]:     at default (file:///opt/xo/xo-builds/xen-orchestra-202509150942/packages/xen-api/_getTaskResult.mjs:13:29)
Sep 15 10:00:32 xo1 xo-server[5582]:     at Xapi._addRecordToCache (file:///opt/xo/xo-builds/xen-orchestra-202509150942/packages/xen-api/index.mjs:1073:24)
Sep 15 10:00:32 xo1 xo-server[5582]:     at file:///opt/xo/xo-builds/xen-orchestra-202509150942/packages/xen-api/index.mjs:1107:14
Sep 15 10:00:32 xo1 xo-server[5582]:     at Array.forEach (<anonymous>)
Sep 15 10:00:32 xo1 xo-server[5582]:     at Xapi._processEvents (file:///opt/xo/xo-builds/xen-orchestra-202509150942/packages/xen-api/index.mjs:1097:12)
Sep 15 10:00:32 xo1 xo-server[5582]:     at Xapi._watchEvents (file:///opt/xo/xo-builds/xen-orchestra-202509150942/packages/xen-api/index.mjs:1270:14)
Sep 15 10:00:32 xo1 xo-server[5582]:     at process.processTicksAndRejections (node:internal/process/task_queues:105:5) {
Sep 15 10:00:32 xo1 xo-server[5582]:   code: 'SR_BACKEND_FAILURE_460',
Sep 15 10:00:32 xo1 xo-server[5582]:   params: [
Sep 15 10:00:32 xo1 xo-server[5582]:     '',
Sep 15 10:00:32 xo1 xo-server[5582]:     'Failed to calculate changed blocks for given VDIs. [opterr=Source and target VDI are unrelated]',
Sep 15 10:00:32 xo1 xo-server[5582]:     ''
Sep 15 10:00:32 xo1 xo-server[5582]:   ],
Sep 15 10:00:32 xo1 xo-server[5582]:   call: undefined,
Sep 15 10:00:32 xo1 xo-server[5582]:   url: undefined,
Sep 15 10:00:32 xo1 xo-server[5582]:   task: task {
Sep 15 10:00:32 xo1 xo-server[5582]:     uuid: '6265a41c-29c3-f4d9-5f0c-e52db6e0fcc9',
Sep 15 10:00:32 xo1 xo-server[5582]:     name_label: 'Async.VDI.list_changed_blocks',
Sep 15 10:00:32 xo1 xo-server[5582]:     name_description: '',
Sep 15 10:00:32 xo1 xo-server[5582]:     allowed_operations: [],
Sep 15 10:00:32 xo1 xo-server[5582]:     current_operations: {},
Sep 15 10:00:32 xo1 xo-server[5582]:     created: '20250915T14:00:32Z',
Sep 15 10:00:32 xo1 xo-server[5582]:     finished: '20250915T14:00:32Z',
Sep 15 10:00:32 xo1 xo-server[5582]:     status: 'failure',
Sep 15 10:00:32 xo1 xo-server[5582]:     resident_on: 'OpaqueRef:65b7a047-094b-4c7a-a503-2823e92b9fe4',
Sep 15 10:00:32 xo1 xo-server[5582]:     progress: 1,
Sep 15 10:00:32 xo1 xo-server[5582]:     type: '<none/>',
Sep 15 10:00:32 xo1 xo-server[5582]:     result: '',
Sep 15 10:00:32 xo1 xo-server[5582]:     error_info: [
Sep 15 10:00:32 xo1 xo-server[5582]:       'SR_BACKEND_FAILURE_460',
Sep 15 10:00:32 xo1 xo-server[5582]:       '',
Sep 15 10:00:32 xo1 xo-server[5582]:       'Failed to calculate changed blocks for given VDIs. [opterr=Source and target VDI are unrelated]',
Sep 15 10:00:32 xo1 xo-server[5582]:       ''
Sep 15 10:00:32 xo1 xo-server[5582]:     ],
Sep 15 10:00:32 xo1 xo-server[5582]:     other_config: {},
Sep 15 10:00:32 xo1 xo-server[5582]:     subtask_of: 'OpaqueRef:NULL',
Sep 15 10:00:32 xo1 xo-server[5582]:     subtasks: [],
Sep 15 10:00:32 xo1 xo-server[5582]:     backtrace: '(((process xapi)(filename lib/backtrace.ml)(line 210))((process xapi)(filename ocaml/xapi/storage_utils.ml)(line 141))((process xapi)(fi
lename ocaml/xapi/message_forwarding.ml)(line 141))((process xapi)(filename ocaml/libs/xapi-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process xapi)(filename ocaml/libs/x
api-stdext/lib/xapi-stdext-pervasives/pervasiveext.ml)(line 39))((process xapi)(filename ocaml/xapi/rbac.ml)(line 188))((process xapi)(filename ocaml/xapi/rbac.ml)(line 197))((process xapi)
(filename ocaml/xapi/server_helpers.ml)(line 77)))'
Sep 15 10:00:32 xo1 xo-server[5582]:   }
Sep 15 10:00:32 xo1 xo-server[5582]: }
Sep 15 10:00:35 xo1 xo-server[5582]: 2025-09-15T14:00:35.240Z xo:xapi:vdi WARN invalid HTTP header in response body {
Sep 15 10:00:35 xo1 xo-server[5582]:   body: 'HTTP/1.1 500 Internal Error\r\n' +
Sep 15 10:00:35 xo1 xo-server[5582]:     'content-length: 318\r\n' +
Sep 15 10:00:35 xo1 xo-server[5582]:     'content-type: text/html\r\n' +
Sep 15 10:00:35 xo1 xo-server[5582]:     'connection: close\r\n' +
Sep 15 10:00:35 xo1 xo-server[5582]:     'cache-control: no-cache, no-store\r\n' +
Sep 15 10:00:35 xo1 xo-server[5582]:     '\r\n' +
Sep 15 10:00:35 xo1 xo-server[5582]:     '<html><body><h1>HTTP 500 internal server error</h1>An unexpected error occurred; please wait a while and try again. If the problem persists, please
 contact your support representative.<h1> Additional information </h1>VDI_INCOMPATIBLE_TYPE: [ OpaqueRef:ec54186c-0ab5-0390-d244-64414e9d8887; CBT metadata ]</body></html>'
Sep 15 10:00:35 xo1 xo-server[5582]: }
Sep 15 10:00:35 xo1 xo-server[5582]: 2025-09-15T14:00:35.249Z xo:xapi:xapi-disks WARN can't compute delta OpaqueRef:888ccaa8-07c6-e6f0-3bfb-3e6b5ac4da2a from OpaqueRef:ec54186c-0ab5-0390-d2
44-64414e9d8887, fallBack to a full {
Sep 15 10:00:35 xo1 xo-server[5582]:   error: Error: invalid HTTP header in response body
Sep 15 10:00:35 xo1 xo-server[5582]:       at checkVdiExport (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/xapi/vdi.mjs:36:19)
Sep 15 10:00:35 xo1 xo-server[5582]:       at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async Xapi.exportContent (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/xapi/vdi.mjs:244:5)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async #getExportStream (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/xapi/disks/XapiVhdStreamSource.mjs:123:20)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async XapiVhdStreamSource.init (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/xapi/disks/XapiVhdStreamSource.mjs:135:23)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async #openExportStream (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/xapi/disks/Xapi.mjs:128:7)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async #openNbdStream (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/xapi/disks/Xapi.mjs:81:22)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async XapiDiskSource.openSource (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/xapi/disks/Xapi.mjs:191:18)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async XapiDiskSource.init (file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/disk-transform/dist/DiskPassthrough.mjs:28:41)
Sep 15 10:00:35 xo1 xo-server[5582]:       at async file:///opt/xo/xo-builds/xen-orchestra-202509150942/@xen-orchestra/backups/_incrementalVm.mjs:67:5
Sep 15 10:00:35 xo1 xo-server[5582]: }
]]>https://xcp-ng.org/forum/post/97408https://xcp-ng.org/forum/post/97408Tue, 16 Sep 2025 00:04:55 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 23:02:13 GMT]]>@JB Doyou have anything related in journalctl ? like can't connect through NBD, fall back to stream export or can't compute delta ${vdiRef} from ${baseRef}, fallBack to a full or anything starting by 'xo:xapi:xapi-disks'

]]>https://xcp-ng.org/forum/post/97407https://xcp-ng.org/forum/post/97407Mon, 15 Sep 2025 23:02:13 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 17:55:50 GMT]]>@florent Thanks, Florent! No, No!

]]>https://xcp-ng.org/forum/post/97396https://xcp-ng.org/forum/post/97396Mon, 15 Sep 2025 17:55:50 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 16:36:14 GMT]]>@JB this means that it should have done a delta ( as per the full backup interval ) , but had to fall back to a full for at least one disk
this can happens after a failed transfer, a new disk added and some edge case. This issue was not really visible before the latest release, even if the impacts can be important , saturating network and storage.

We are investigating this ( especially @Bastien-Nollet ) , and expect to have a fix and/or an explanation fast

Are you using "purge snapshot data" option ? Are there anything on the journalctl logs ?

]]>https://xcp-ng.org/forum/post/97393https://xcp-ng.org/forum/post/97393Mon, 15 Sep 2025 16:36:14 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 15:02:55 GMT]]>@Andrew backup-vms.jpeg

]]>https://xcp-ng.org/forum/post/97384https://xcp-ng.org/forum/post/97384Mon, 15 Sep 2025 15:02:55 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 14:38:39 GMT]]>@olivierlambert @florent Looks like 1471ab0c7c79fa6dca9a1598e7be2a141753ba91 (in current master) has fixed the issue.

But, during testing I found a new related issue (no error messages). Running current XO master b16d5...

During the normal CR delta backup job, two VMs shows the warning message: Backup fell back to a full but it did a delta (not full) backup.

I caused this by running a different CR backup job (for testing) that used the two same VMs but to a different SR. The new test job did a full backup and delta backup correctly. Since there is only one CBT snapshot the normal backup job did recognize that the snapshot was not for the original normal backup job and should have done a full (and started a new CBT snapshot), but it only did a short delta.

As the VMs were off, I guess it could correctly use the other CBT snapshot as no blocks had changed... Just odd that CR backup said it was going to do a full and then did a delta.

]]>https://xcp-ng.org/forum/post/97383https://xcp-ng.org/forum/post/97383Mon, 15 Sep 2025 14:38:39 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 12:43:43 GMT]]>@peo Yes, same problem!

]]>https://xcp-ng.org/forum/post/97369https://xcp-ng.org/forum/post/97369Mon, 15 Sep 2025 12:43:43 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 05:03:25 GMT]]>Feedback for you @florent 😛

]]>https://xcp-ng.org/forum/post/97360https://xcp-ng.org/forum/post/97360Mon, 15 Sep 2025 05:03:25 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 04:48:29 GMT]]>@olivierlambert fix_replication works for some... but most of my VMs now have an error:
the writer IncrementalXapiWriter has failed the step writer.checkBaseVdis() with error Cannot read properties of undefined (reading 'managed'). 

      "result": {
        "message": "Cannot read properties of undefined (reading 'managed')",
        "name": "TypeError",
        "stack": "TypeError: Cannot read properties of undefined (reading 'managed')\n    at file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/_writers/IncrementalXapiWriter.mjs:29:15\n    at Array.filter (<anonymous>)\n    at IncrementalXapiWriter.checkBaseVdis (file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/_writers/IncrementalXapiWriter.mjs:26:8)\n    at file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/_vmRunners/IncrementalXapi.mjs:159:54\n    at callWriter (file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/_vmRunners/_Abstract.mjs:33:15)\n    at IncrementalXapiVmBackupRunner._callWriters (file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/_vmRunners/_Abstract.mjs:52:14)\n    at IncrementalXapiVmBackupRunner._selectBaseVm (file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/_vmRunners/IncrementalXapi.mjs:158:16)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async IncrementalXapiVmBackupRunner.run (file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/_vmRunners/_AbstractXapi.mjs:378:5)\n    at async file:///opt/xo/xo-builds/xen-orchestra-202509150025/@xen-orchestra/backups/_runners/VmsXapi.mjs:166:38"
      }
]]>https://xcp-ng.org/forum/post/97359https://xcp-ng.org/forum/post/97359Mon, 15 Sep 2025 04:48:29 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 02:20:03 GMT]]>If you want to test, you can switch to the relevant branch, which is fix_replication

https://github.com/vatesfr/xen-orchestra/pull/8971

fbeauchamp opened this pull request in vatesfr/xen-orchestra

closed fix(backups): replication doing always a full #8971

]]>https://xcp-ng.org/forum/post/97358https://xcp-ng.org/forum/post/97358Mon, 15 Sep 2025 02:20:03 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Mon, 15 Sep 2025 00:15:59 GMT]]>@Andrew then again, with such a precise report, the fix is easier

the fix should join master soon

]]>https://xcp-ng.org/forum/post/97355https://xcp-ng.org/forum/post/97355Mon, 15 Sep 2025 00:15:59 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Sat, 13 Sep 2025 01:38:49 GMT]]>@florent so it's like https://github.com/vatesfr/xen-orchestra/commit/a459015ca91c159123bb682f16237b4371a312a6 might introduced a regression?

0 fbeauchamp committed to vatesfr/xen-orchestra 
Fix(replication): VDI_NOT_MANAGED error  (#8935)

from ticket #40151
]]>https://xcp-ng.org/forum/post/97312https://xcp-ng.org/forum/post/97312Sat, 13 Sep 2025 01:38:49 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Sat, 13 Sep 2025 01:38:01 GMT]]>@olivierlambert Correct. Running commit 4944ea902ff19f172b1b86ec96ad989e322bec2c works.

]]>https://xcp-ng.org/forum/post/97311https://xcp-ng.org/forum/post/97311Sat, 13 Sep 2025 01:38:01 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Sat, 13 Sep 2025 01:34:00 GMT]]>@Andrew And it doesn't with the commit just before?

]]>https://xcp-ng.org/forum/post/97310https://xcp-ng.org/forum/post/97310Sat, 13 Sep 2025 01:34:00 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Fri, 12 Sep 2025 19:01:08 GMT]]>@olivierlambert This happens to me too with a459015ca91c159123bb682f16237b4371a312a6.

I did open an issue https://github.com/vatesfr/xen-orchestra/issues/8969

andrew64k created this issue in vatesfr/xen-orchestra

closed a459015 causes delta replication to always be full #8969

]]>https://xcp-ng.org/forum/post/97302https://xcp-ng.org/forum/post/97302Fri, 12 Sep 2025 19:01:08 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Fri, 12 Sep 2025 17:17:38 GMT]]>Too bad it becomes that unexplainable slow when it has to fall back to a full backup:
f971760e-3157-4352-a2e8-c0060aada73a-image.png

The first (full) backup was 10x faster:
19a77237-047f-4813-b72b-9c9b3459e888-image.png

]]>https://xcp-ng.org/forum/post/97299https://xcp-ng.org/forum/post/97299Fri, 12 Sep 2025 17:17:38 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Fri, 12 Sep 2025 16:54:31 GMT]]>@olivierlambert said in Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source):

No, no confirmation so far, that's why we need more to investigate 🙂

Great (or maybe not) news.. At least on my system this is very easy to replicate.. On a tiny test machine that only have had a normal backup before, first time doing replication copy (to H2 SSD) it sends it as full as expected. Just did some simple operations on the machine (like apt update, no upgrade), then retried:
96206924-73a5-484d-b089-ad9c673b4670-image.png

]]>https://xcp-ng.org/forum/post/97295https://xcp-ng.org/forum/post/97295Fri, 12 Sep 2025 16:54:31 GMT<![CDATA[Reply to Continuous Replication jobs creates full backups every time since 2025-09-06 (xo from source) on Fri, 12 Sep 2025 16:28:08 GMT]]>No, no confirmation so far, that's why we need more to investigate 🙂

]]>https://xcp-ng.org/forum/post/97289https://xcp-ng.org/forum/post/97289Fri, 12 Sep 2025 16:28:08 GMT