Xen Orchestra 6.3.2 Random Replication Failure
-
Since the XOA 6.3 release i have had a few random backup errors in an environment that has otherwise had fairly flawless backup performance for the last year. I cannot make out what exactly the error means but retrying the job allows it to succeed without issue. It is also very intermittent.
Log attached. 2026-04-07T01_00_03.075Z - backup NG.txt
If the issue persists i will submit a ticket to dive into it further but i have only had it happen 3 times since the release ofthe 6.3.x update so its hard to reproduce.
Replication target storage is a Pure C50R4 with NFS3 exports.
-
Ping @Team-XO-Backend
-
@flakpyro Hi, I am looking into it.
-
@flakpyro Hi, it seems it is a race condition between disk check and close, and disk transfer. That's why it is randomly happening. This is not an easy fix, we are trying to figure out a workaround.
-
@pierrebrunet Thanks for the update. Glad to know its not something unique to our environment and you were able to track down the cause!
-
@flakpyro we are working on a fix here : https://github.com/vatesfr/xen-orchestra/pull/9702 . Are you using NBD ?
we think pierre's diag is right , so this branch will not open the NBD server when needed, and wait for the disk to be disconnecetd before trying to write into it
-
@florent I am using NBD for all backups yes but am not purging snapshots/usnig CBT.
Its so rare in fact that i haven't had it happen since since i made this post last week. (When i had it happen twice in 2 days). This is our production XOA it has occurred on so i wont be able to test a branch and i have never seen it happen on my sources install at home.
-
@flakpyro that's a good news ( but at least another user saw this)
we are currently testing the branch ensuring that at least the fix don't create other issues
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login