XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    File restore error on LVMs

    Scheduled Pinned Locked Moved Backup
    25 Posts 8 Posters 2.6k Views 7 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M Offline
      michmoor0725 @Andrew
      last edited by

      @Andrew
      Thanks!
      Watching that Issue now.

      florentF 1 Reply Last reply Reply Quote 0
      • florentF Offline
        florent Vates 🪐 XO Team @michmoor0725
        last edited by

        @michmoor0725 the lvm parittion with one disk should work. Is it the case for you ?

        A 1 Reply Last reply Reply Quote 0
        • A Offline
          Andrew Top contributor @florent
          last edited by

          @florent Still not working.

          Here is the partition list for a standard Ubuntu 20.04.3 install.
          Partition 3 is the main OS root as a single LVM (19G).
          Trying to restore a file from it makes XO confused.

          xvda                      202:0    0   20G  0 disk
          ├─xvda1                   202:1    0    1M  0 part
          ├─xvda2                   202:2    0    1G  0 part /boot
          └─xvda3                   202:3    0   19G  0 part
            └─ubuntu--vg-ubuntu--lv 253:0    0   19G  0 lvm  /
          

          restore-file.jpg

          florentF 1 Reply Last reply Reply Quote 0
          • florentF Offline
            florent Vates 🪐 XO Team @Andrew
            last edited by

            my test LVM VM works 😕

            @michmoor0725 or @Andrew , do you have any open tunnel I can use to test on your VM ?

            @Andrew said in File restore error on LVMs:

            @florent Still not working.

            Here is the partition list for a standard Ubuntu 20.04.3 install.
            Partition 3 is the main OS root as a single LVM (19G).
            Trying to restore a file from it makes XO confused.

            xvda                      202:0    0   20G  0 disk
            ├─xvda1                   202:1    0    1M  0 part
            ├─xvda2                   202:2    0    1G  0 part /boot
            └─xvda3                   202:3    0   19G  0 part
              └─ubuntu--vg-ubuntu--lv 253:0    0   19G  0 lvm  /
            

            restore-file.jpg

            it see the partition but fail to m

            @Andrew said in File restore error on LVMs:

            @florent Still not working.

            Here is the partition list for a standard Ubuntu 20.04.3 install.
            Partition 3 is the main OS root as a single LVM (19G).
            Trying to restore a file from it makes XO confused.

            xvda                      202:0    0   20G  0 disk
            ├─xvda1                   202:1    0    1M  0 part
            ├─xvda2                   202:2    0    1G  0 part /boot
            └─xvda3                   202:3    0   19G  0 part
              └─ubuntu--vg-ubuntu--lv 253:0    0   19G  0 lvm  /
            

            restore-file.jpg

            M 1 Reply Last reply Reply Quote 0
            • M Offline
              michmoor0725 @florent
              last edited by olivierlambert

              @florent Yes i have a support tunnel IP.
              id: redacted but kept by our team 😉

              F 1 Reply Last reply Reply Quote 0
              • F Offline
                Fridgemagnet @michmoor0725
                last edited by Fridgemagnet

                I ran into this issue (xcp-ng 8.3.0 beta 2, XO 4cf03 ronivay docker image) and thought it had to do with my vm disk storage location (local vs NFS vs iSCSI). After not being able to restore on the file level from delta backups in all three situations I randomly decided to untick the "set up this disk as an LVM group" when installing a test vm which is enabled by default on Ubuntu 24.04 LTS.
                79d9060a-e71d-4e7c-afed-04557a4a5086-image.png
                The following screenshot is what the storage setup looks like with the default lvm group.
                5a41e741-0eb5-4d11-b69b-28608d231dd7-image.png

                1 Reply Last reply Reply Quote 0
                • P Offline
                  peo
                  last edited by

                  I'm a new ("about a week old") user of xcp-ng and Xen Orchestra and observed the same problem as described in this forum post.

                  The older (20.04.6 LTS) Linux installation I moved out of ESXi just for testing purposes is the one I'm testing on for now, but this problem seems to be easily reproduced on the newer versions as well (and I will test it within a few days).

                  From the backup I create, I can list the partitions in the backup, but am only able to select files from the boot partition (1.42GB), the two other shows the red exclamation mark.

                  The behaviour is the same with both XO from source and the just activated full trial of XOA (for testing the file-level restore).

                  Anyone solved this yet ?

                  F 1 Reply Last reply Reply Quote 0
                  • F Offline
                    flakpyro @peo
                    last edited by

                    @peo i am seeing the same issue on an Ubuntu 22.04 LTS VM setup with LVM.

                    J 1 Reply Last reply Reply Quote 0
                    • J Offline
                      john.c @flakpyro
                      last edited by john.c

                      @flakpyro What's the state of the LVM VG, its members and the LV? Has the VG been brought active along with its LV?

                      Is the VG and LV in the active system the file is being restored to the same as the one in the backup?

                      Are there any missing member disks (virtual) from the VM preventing the restore?

                      Are the relevant packages for the LVM software installed namely the following:-

                      • lvm2
                      • lvm2-dbusd
                      • lvm2-lockd
                      F 1 Reply Last reply Reply Quote 0
                      • F Offline
                        flakpyro @john.c
                        last edited by

                        @john-c

                        Here is the output of vgdisplay and lvdisplay from the VM being backed up.

                          --- Volume group ---
                          VG Name               ubuntu-vg
                          System ID             
                          Format                lvm2
                          Metadata Areas        1
                          Metadata Sequence No  6
                          VG Access             read/write
                          VG Status             resizable
                          MAX LV                0
                          Cur LV                1
                          Open LV               1
                          Max PV                0
                          Cur PV                1
                          Act PV                1
                          VG Size               <58.00 GiB
                          PE Size               4.00 MiB
                          Total PE              14847
                          Alloc PE / Size       14847 / <58.00 GiB
                          Free  PE / Size       0 / 0   
                          VG UUID               iUJyAl-7Ltq-IvF5-xla3-RA1E-bYP5-QJABwy
                        
                        
                          --- Logical volume ---
                          LV Path                /dev/ubuntu-vg/ubuntu-lv
                          LV Name                ubuntu-lv
                          VG Name                ubuntu-vg
                          LV UUID                bwEE3c-fkgc-nATq-czqZ-TkdK-xFA1-ULmRGz
                          LV Write Access        read/write
                          LV Creation host, time ubuntu-server, 2022-05-30 11:47:36 -0600
                          LV Status              available
                          # open                 1
                          LV Size                <58.00 GiB
                          Current LE             14847
                          Segments               1
                          Allocation             inherit
                          Read ahead sectors     auto
                          - currently set to     256
                          Block device           253:0
                        
                        

                        Its basically a bog standard Ubuntu install. The file system on the LV is XFS.

                        The active system and backup should have the same exact layout. And no missing virtual disks.

                        J 1 Reply Last reply Reply Quote 0
                        • J Offline
                          john.c @flakpyro
                          last edited by

                          @flakpyro said in File restore error on LVMs:

                          @john-c

                          Here is the output of vgdisplay and lvdisplay from the VM being backed up.

                            --- Volume group ---
                            VG Name               ubuntu-vg
                            System ID             
                            Format                lvm2
                            Metadata Areas        1
                            Metadata Sequence No  6
                            VG Access             read/write
                            VG Status             resizable
                            MAX LV                0
                            Cur LV                1
                            Open LV               1
                            Max PV                0
                            Cur PV                1
                            Act PV                1
                            VG Size               <58.00 GiB
                            PE Size               4.00 MiB
                            Total PE              14847
                            Alloc PE / Size       14847 / <58.00 GiB
                            Free  PE / Size       0 / 0   
                            VG UUID               iUJyAl-7Ltq-IvF5-xla3-RA1E-bYP5-QJABwy
                          
                          
                            --- Logical volume ---
                            LV Path                /dev/ubuntu-vg/ubuntu-lv
                            LV Name                ubuntu-lv
                            VG Name                ubuntu-vg
                            LV UUID                bwEE3c-fkgc-nATq-czqZ-TkdK-xFA1-ULmRGz
                            LV Write Access        read/write
                            LV Creation host, time ubuntu-server, 2022-05-30 11:47:36 -0600
                            LV Status              available
                            # open                 1
                            LV Size                <58.00 GiB
                            Current LE             14847
                            Segments               1
                            Allocation             inherit
                            Read ahead sectors     auto
                            - currently set to     256
                            Block device           253:0
                          
                          

                          Its basically a bog standard Ubuntu install. The file system on the LV is XFS.

                          The active system and backup should have the same exact layout. And no missing virtual disks.

                          Does the UUID from the backup match the one from the live machine?

                          Does the VG name matchup with backup and live machine?

                          F 1 Reply Last reply Reply Quote 0
                          • F Offline
                            flakpyro @john.c
                            last edited by

                            @john-c Yep nothing has been renamed in regards to the LV or VG name inside the VM. I have not made any recent changes to this VM or the backup job itself.

                            I assume the UUID matches up as the VM is displayed by its name in the "VMs to backup" section of the backup job and not simply displayed as a UUID.

                            J 1 Reply Last reply Reply Quote 0
                            • J Offline
                              john.c @flakpyro
                              last edited by john.c

                              @flakpyro said in File restore error on LVMs:

                              @john-c Yep nothing has been renamed in regards to the LV or VG name inside the VM. I have not made any recent changes to this VM or the backup job itself.

                              I assume the UUID matches up as the VM is displayed by its name in the "VMs to backup" section of the backup job and not simply displayed as a UUID.

                              I'm referring to the UUID of VG, PV and LV of the disks used by VM's OS (on live) and in the backup. Cause if these change then it can cause issues with bringing the LVM VG back up into operation.

                              Thus afterwards the mounting of the LVM LV's from the VG on the VM's Linux based Operating System will have trouble as a result. So wouldn't be able to get the root directory (/). Which is what several people are trying to restore into.

                              F 1 Reply Last reply Reply Quote 0
                              • F Offline
                                flakpyro @john.c
                                last edited by

                                @john-c Do you know what would cause them to change? I am testing a restore from last nights backup so i assume the UUIDs have not changed. I could do a full restore from last nights backup however and compare to be sure.

                                J 1 Reply Last reply Reply Quote 0
                                • J Offline
                                  john.c @flakpyro
                                  last edited by john.c

                                  @flakpyro said in File restore error on LVMs:

                                  @john-c Do you know what would cause them to change? I am testing a restore from last nights backup so i assume the UUIDs have not changed. I could do a full restore from last nights backup however and compare to be sure.

                                  Do the restore then compare to check, to see whether they have changed.

                                  If you have done any of the following or if XOA has done any of the following when performing the requested functions, it would cause the UUID for LVMs to change:-

                                  • Create a new LVM
                                  • Edit Metadata Directly
                                  • Delete and recreate
                                  • Change Filesystem UUID
                                  • Change the member disk's location address - virtual bus connecting virtual disk

                                  Also if the actions in XOA or XCP-ng affect the member disk's address visible inside of the VM then this would affect the metadata.

                                  @florent Your employer did that new Debian 12 based XOA since 2021 are the packages for lvm2 and any relevant NodeJS NPM ones included in the appliance?

                                  1 Reply Last reply Reply Quote 0
                                  • A Andrew referenced this topic on
                                  • First post
                                    Last post