Backups not working

acebmxer

@olivierlambert

Reverted back to commit c8f0a and backups are working.

manilx

@acebmxer Yeap, latest build introduced a bug in the backups.....

marcoi

same issue going to disable backup for now until either bug fixed or i figure out how to go back to an older version.

update - went to Xen Orchestra, commit fb9bd and backup working again.

Greg_E

@marcoi

Has anyone tried turning off delta, and turning off compression?

Not ideal, but its how I'm dealing with some different issues (windows with big empty disks).

marcoi

@Greg_E
I didnt try any changes to backup settings to test if any form of the backups would work on the latest commit. I just went back to an earlier version to perform backups using original settings.

olivierlambert

Might be interesting to pinpoint the exact problematic commit so we got a fix on Monday

manilx

@olivierlambert Happened between commit 19412 and commit 6b263.....

Danp

@olivierlambert Pretty sure the problem originates from this PR.

florent

It may be related to the other topic, but I see a few things :

invalid HTTP header in response body. There is an issue while trying to download the disk. The XO logs ( journalctl ) should contains lines ith the xo:xapi:vdi key regarding this.
It may be worth to tests without purge snapshot , if this error reoccur
SIGTERM is probably more an out of memory issue on the backup worker. How muck memory does your XO have ?

acebmxer

@florent said in Backups not working:

It may be related to the other topic, but I see a few things :

invalid HTTP header in response body. There is an issue while trying to download the disk. The XO logs ( journalctl ) should contains lines ith the xo:xapi:vdi key regarding this.
It may be worth to tests without purge snapshot , if this error reoccur

SIGTERM is probably more an out of memory issue on the backup worker. How muck memory does your XO have ?

I am pretty sure both this post and - https://xcp-ng.org/forum/topic/10970/xo-community-edition-backups-dont-work-as-of-build-6b263/12 are the same problem....

To answer your question my XO has 6GB ram set.

Edit - Also note my backups were failing local nfs backup storage.

marcoi

Backup done to NFS share

Xen Orchestra, commit fb9bd - backup work

Xen Orchestra, commit 6b263 - backup broken

Xen Orchestra, commit 1a7b5 - backup working

looks like the issue might been resolved with the latest build.

acebmxer

@marcoi said in Backups not working:

Backup done to NFS share

Xen Orchestra, commit fb9bd - backup work

Xen Orchestra, commit 6b263 - backup broken

Xen Orchestra, commit 1a7b5 - backup working

looks like the issue might been resolved with the latest build.

Thank you for the update. I will update as well and report back.

manilx

@marcoi Confirmed: commit 1a7b5 backing up again without issues.

acebmxer

Confirm commit 1a7b5 backups completed successfully.

olivierlambert

Excellent news, thanks for the feedback!