VDI_IO_ERROR(Device I/O errors) Immediate HELP needed Please.

[rauly94]

I need immediate help from the community I really don't know what else to do.
I already deleted all the backups and put them on a new location inside the QNAP.
Using the QNAP via NFS. All the vm's getting the same error. we have a total of 8 vm's

{
  "data": {
    "type": "VM",
    "id": "27d24f52-65c7-6ed8-17ff-0cedf654a91e"
  },
  "id": "1782885600022:0",
  "message": "Starting backup of DC1. (6d132a52-7225-467f-a831-a6892d32ee9c)",
  "start": 1782885600022,
  "status": "failure",
  "tasks": [
    {
      "id": "1782885600023",
      "message": "snapshot",
      "start": 1782885600023,
      "status": "success",
      "end": 1782885604647,
      "result": "3c2d7d68-524d-a5e8-f1e7-a35465a74efd"
    },
    {
      "id": "1782885604651",
      "message": "add metadata to snapshot",
      "start": 1782885604651,
      "status": "success",
      "end": 1782885604707
    },
    {
      "id": "1782885604850",
      "message": "waiting for uptodate snapshot record",
      "start": 1782885604850,
      "status": "success",
      "end": 1782885605074
    },
    {
      "id": "1782885605075",
      "message": "start snapshot export",
      "start": 1782885605075,
      "status": "success",
      "end": 1782885605075
    },
    {
      "data": {
        "id": "2b08bdd0-24e9-444e-bea6-6d626eda3d79",
        "isFull": true,
        "type": "remote"
      },
      "id": "1782885605077",
      "message": "export",
      "start": 1782885605077,
      "status": "failure",
      "tasks": [
        {
          "id": "1782885605082",
          "message": "transfer",
          "start": 1782885605082,
          "status": "failure",
          "end": 1782904002302,
          "result": {
            "code": "VDI_IO_ERROR",
            "params": [
              "Device I/O errors"
            ],
            "task": {
              "uuid": "ea9b0709-6928-e0bb-8b81-1b80d1f30a12",
              "name_label": "[XO] VDI Export",
              "name_description": "DC1_ezilu",
              "allowed_operations": [],
              "current_operations": {},
              "created": "20260701T06:00:05Z",
              "finished": "20260701T10:36:41Z",
              "status": "failure",
              "resident_on": "OpaqueRef:1556a969-d040-48cc-a741-1e2a121305da",
              "progress": 1,
              "type": "<none/>",
              "result": "",
              "error_info": [
                "VDI_IO_ERROR",
                "Device I/O errors"
              ],
              "other_config": {},
              "subtask_of": "OpaqueRef:NULL",
              "subtasks": [],
              "backtrace": "(((process xapi)(filename ocaml/xapi/vhd_tool_wrapper.ml)(line 77))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 35))((process xapi)(filename ocaml/xapi/export_raw_vdi.ml)(line 50))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 35))((process xapi)(filename ocaml/xapi/export_raw_vdi.ml)(line 90)))"
            },
            "message": "VDI_IO_ERROR(Device I/O errors)",
            "name": "XapiError",
            "stack": "XapiError: VDI_IO_ERROR(Device I/O errors)\n    at Function.wrap (/opt/xen-orchestra/packages/xen-api/src/_XapiError.js:16:12)\n    at _default (/opt/xen-orchestra/packages/xen-api/src/_getTaskResult.js:11:29)\n    at Xapi._addRecordToCache (/opt/xen-orchestra/packages/xen-api/src/index.js:866:24)\n    at forEach (/opt/xen-orchestra/packages/xen-api/src/index.js:887:14)\n    at Array.forEach (<anonymous>)\n    at Xapi._processEvents (/opt/xen-orchestra/packages/xen-api/src/index.js:877:12)\n    at Xapi._watchEvents (/opt/xen-orchestra/packages/xen-api/src/index.js:1038:14)"
          }
        }
      ],
      "end": 1782904002304,
      "result": {
        "code": "VDI_IO_ERROR",
        "params": [
          "Device I/O errors"
        ],
        "task": {
          "uuid": "ea9b0709-6928-e0bb-8b81-1b80d1f30a12",
          "name_label": "[XO] VDI Export",
          "name_description": "DC1_ezilu",
          "allowed_operations": [],
          "current_operations": {},
          "created": "20260701T06:00:05Z",
          "finished": "20260701T10:36:41Z",
          "status": "failure",
          "resident_on": "OpaqueRef:1556a969-d040-48cc-a741-1e2a121305da",
          "progress": 1,
          "type": "<none/>",
          "result": "",
          "error_info": [
            "VDI_IO_ERROR",
            "Device I/O errors"
          ],
          "other_config": {},
          "subtask_of": "OpaqueRef:NULL",
          "subtasks": [],
          "backtrace": "(((process xapi)(filename ocaml/xapi/vhd_tool_wrapper.ml)(line 77))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 35))((process xapi)(filename ocaml/xapi/export_raw_vdi.ml)(line 50))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 35))((process xapi)(filename ocaml/xapi/export_raw_vdi.ml)(line 90)))"
        },
        "message": "VDI_IO_ERROR(Device I/O errors)",
        "name": "XapiError",
        "stack": "XapiError: VDI_IO_ERROR(Device I/O errors)\n    at Function.wrap (/opt/xen-orchestra/packages/xen-api/src/_XapiError.js:16:12)\n    at _default (/opt/xen-orchestra/packages/xen-api/src/_getTaskResult.js:11:29)\n    at Xapi._addRecordToCache (/opt/xen-orchestra/packages/xen-api/src/index.js:866:24)\n    at forEach (/opt/xen-orchestra/packages/xen-api/src/index.js:887:14)\n    at Array.forEach (<anonymous>)\n    at Xapi._processEvents (/opt/xen-orchestra/packages/xen-api/src/index.js:877:12)\n    at Xapi._watchEvents (/opt/xen-orchestra/packages/xen-api/src/index.js:1038:14)"
      }
    },

[rauly94]

I'm doing some testing on my RAID since it appears to be a RAID
VDR52: The consistency check found inconsistent parity data on Virtual Disk 1 on Integrated RAID Controller 1.

Buffer I/O error on dev dm-9
Buffer I/O error on dev dm-5
Buffer I/O error on dev dm-7
async page read

I will keep everyone posted

[poddingue]

You may have worked it out yourself already.
A consistency check reporting inconsistent parity on Virtual Disk 1, plus Buffer I/O error on several dm- devices, is the storage layer underneath XCP-ng telling you something is wrong down there. The VDI_IO_ERROR is mostly XCP-ng saying it could not read the disk, not the cause itself.

I would be careful about anything that writes to that array until someone who knows hardware RAID recovery better than I do has looked at it. I honestly don't know whether a rebuild helps or makes things worse from this state, and I'd rather say that than guess with your data.
Might be worth a mention to @Team-Storage.