XO Backup Error: VDI_IN_USE(OpaqueRef:.., destroy)

pierrebrunet

@itservices Hi,
It seems the parent of the backup chain is not found (a delta backup links to another delta and another, until you have a full backup, it seems a backup on this chain is missing).
Can you restart a backup chain to have a full backup? You can do it by reducing the retention in your backup job.

itservices

Hi @pierrebrunet.

Thanks for the tip.

Didn't help, unfortunately. Same error message regarding VDI_IN_USE.

Regards,
Marc

pierrebrunet

@itservices It may be a storage or a xo issue. You can try to restart xo-server and retry the backup. If it is solved, it was an issue with xo-server not freeing your vdi. If it still happens, it will be a storage issue

itservices

I have restarted XO as well as my NAS several times since Saturday.

Still no change.

Regards,
Marc

itservices

The problem still persists with commit e376a.

After installation of updates to XenOrchestra I reboot the VM. Still no backup on this one VM possible.

For now I have created a separate backup job which seems to be working.

Regards,
Marc

itservices

Commit 1ba82 did change something. It transferred the VDI but then fails with the VDI_IN_USE on that particular machine.

Regards,
Marc

itservices

Problem still persists with commit e9b66.

Thanks for the support!

Regards,
Marc

pierrebrunet

@itservices Hi,
We did not forget you, working on it!

itservices

I am giving a short "report", when there is new version out and I have tested it.

Nice weekend @y'all

Regards,
Marc

itservices

Problem still present in commit 04deb.

Here is the log from the XO6 interface:

"XapiError: VDI_IN_USE(OpaqueRef:ce1e2c1b-9b52-d813-88fc-18513a51306f, destroy)\n    
at XapiError.wrap (file:///opt/xo/xo-builds/xen-orchestra-202606131310/packages/xen-api/_XapiError.mjs:16:12)\n    
at default (file:///opt/xo/xo-builds/xen-orchestra-202606131310/packages/xen-api/_getTaskResult.mjs:13:29)\n    
at Xapi._addRecordToCache (file:///opt/xo/xo-builds/xen-orchestra-202606131310/packages/xen-api/index.mjs:1078:24)\n    
at file:///opt/xo/xo-builds/xen-orchestra-202606131310/packages/xen-api/index.mjs:1112:14\n   
at Array.forEach (<anonymous>)\n    
at Xapi._processEvents (file:///opt/xo/xo-builds/xen-orchestra-202606131310/packages/xen-api/index.mjs:1102:12)\n    
at Xapi._watchEvents (file:///opt/xo/xo-builds/xen-orchestra-202606131310/packages/xen-api/index.mjs:1275:14)\n   
at process.processTicksAndRejections (node:internal/process/task_queues:104:5)"

Thanks for your assistance ! ! !

Regards,
Marc

pierrebrunet

@itservices Can you check your health dashboard where you should see " Unhealthy VDIs" ? If there are too many VDI in it, they need to be coalesced before restarting a backup.

itservices

Hi @pierrebrunet.

I have deleted the "parentless" VDIs and snapshots.

So the "Unhealthy VDI" page is empty for me.

So everytime I retry with the VM in question it is creating a new (full) backup-chain.

Regards,
Marc

itservices

Quick Update:

Was looking good with commit cf26d.

After the transfer completed the VDI of that particular VM was still in use, according to XO.

So still failure on the job.

Regards,
Marc

itservices

With commit caa17 the transfer did not happen again and fails the with the known message.

Regards,
Marc

pierrebrunet

@itservices
Can you export your logs with xen-bugtool --yestoall please? If you prefer to avoid exporting everything, we especially need /var/log/xensource.log and /var/log/SMlog
@Team-Storage do you have an idea about the source of the issue?

itservices

Hi @pierrebrunet

With commit c74a8 the problem is still present but the transfer was completed again.

Unfortunately my installation does not recognize the "xen-bugtool" command. And both log files are not present.

Is this something that needs enabling after install of XCP-NG?

Unfortunately and unnoticed my syslog-server did not receive any messages from XCP-NG in the last 30 days.

Other inputs work

**Edit:

I have deleted and re-added the syslog-server with port and now logs are being send to Graylog.**

Thanks for your assistance y'all.

Regards,
Marc

pierrebrunet

@itservices Hi, xen-bugtools is in xcp-ng hosts. You can directly get the logs from the hosts if you don't have the command.

itservices

Evening @pierrebrunet

My bad.

I am now on commit b440f and the issue persist.

I have written you a message with the link to the file.

Regards,
Marc

itservices

Just to give an update.

I still am having the issue with current commit 090ce.

Regards,
Marc