Error on attempting delta backup -- how to rectify?

[kevdog]

Been using XO with delta backups for a while however one of my VMs is now receiving an error and I'm not sure how to rectify. I'll post what I have below. Looks like there might be two errors -- VHD check error and WaitObjectState Error. Not sure how to actually fix any of these errors.

Thanks for help.

     Clean VM directory
    VHD check error
        path
        "/xo-vm-backups/a8a20272-aaef-0bc9-82c8-d5ba96d1e725/vdis/fed92d10-c8a0-4587-a018-8a6b6c050453/60e7144d-ea34-4cf7-b798-c0bfd17134c2/.20240204T075759Z.vhd"
        error
        {"generatedMessage":false,"code":"ERR_ASSERTION","actual":false,"expected":true,"operator":"=="}
    Start: Mar 4, 2024, 01:00:02 AM
    End: Mar 4, 2024, 01:00:02 AM
    Snapshot
    Start: Mar 4, 2024, 01:00:02 AM
    End: Mar 4, 2024, 01:00:04 AM
    Backups for XO
        transfer
        Start: Mar 4, 2024, 01:00:06 AM
        End: Mar 4, 2024, 01:18:53 AM
        Duration: 19 minutes
        Size: 4.34 GiB
        Speed: 3.94 MiB/s
        health check
            transfer
            Start: Mar 4, 2024, 01:19:00 AM
            End: Mar 4, 2024, 05:34:33 AM
            Duration: 4 hours
            Size: 9.3 GiB
            Speed: 635.79 KiB/s
            vmstart
            Start: Mar 4, 2024, 05:34:33 AM
            End: Mar 4, 2024, 05:44:33 AM
            Error: waitObjectState: timeout reached before OpaqueRef:214f572e-ed48-4f80-a9c7-6f984129a2f7 in expected state
        Start: Mar 4, 2024, 01:19:00 AM
        End: Mar 4, 2024, 05:44:37 AM
        Error: waitObjectState: timeout reached before OpaqueRef:214f572e-ed48-4f80-a9c7-6f984129a2f7 in expected state
    Start: Mar 4, 2024, 01:00:04 AM
    End: Mar 4, 2024, 05:44:37 AM
    Duration: 5 hours
    Error: waitObjectState: timeout reached before OpaqueRef:214f572e-ed48-4f80-a9c7-6f984129a2f7 in expected state

Start: Mar 4, 2024, 01:00:02 AM
End: Mar 4, 2024, 05:44:37 AM
Duration: 5 hours
Error: waitObjectState: timeout reached before OpaqueRef:214f572e-ed48-4f80-a9c7-6f984129a2f7 in expected state
Type: delta
code_text

[Danp]

It looks like you have the health check feature enabled, and the restored VM failed to start. I would suggest manually restoring the VM from backup and attempting to start it to see what information is given in the console.

[DustinB]

@kevdog Health Check will only work if you have the Guest Drivers installed (https://xenserver.com/downloads for Windows) and running.

Otherwise it'll timeout.

Can you confirm that the drivers are installed and running?

[kevdog]

@DustinB Didn't know about the health check drivers to be honest. My VM not working is a pfSense VM. I looked at the link posted and didn't see BSD drivers. Looking my XO installation for pfSense I dont even see anything in the GUI regarding healthchecks. Weird. Not sure how this option was even turned on in the first place.

[Danp]

@kevdog Look under the backup job's schedule for the Health Check checkbox.

[kevdog]

@Danp Aww. see that box. Let me look into this problem a bit more. Learning some new things here.