XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    File restore error on LVMs

    Scheduled Pinned Locked Moved Backup
    25 Posts 8 Posters 3.9k Views 7 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M Offline
      michmoor0725 @olivierlambert
      last edited by

      @olivierlambert I did notice the difference initially but XOA back up jobs are not available under 'XOA' so that's why i brought up XO.

      1 Reply Last reply Reply Quote 0
      • olivierlambertO Offline
        olivierlambert Vates 🪐 Co-Founder CEO
        last edited by

        You need to enable a trial and it will be available for 15 days 🙂 If your trial is already expired, just let me know your email in a direct message so I can extend it for the test.

        M 1 Reply Last reply Reply Quote 1
        • M Offline
          michmoor0725 @olivierlambert
          last edited by

          @olivierlambert
          Thanks for the temp trial.

          The issue is still present on an updated XOA.
          I add my Remote. Go to back up > file restore. I see my deltas there. I attempted to file restore and was greeted with the same message as the self-compiled version

          5b73667a-db0c-4410-98bf-21ca3065921c-image.png

          M 1 Reply Last reply Reply Quote 0
          • M Offline
            michmoor0725 @michmoor0725
            last edited by

            @olivierlambert Ive created a support tunnel and sent you a DM of the id if you want to check out.

            1 Reply Last reply Reply Quote 0
            • olivierlambertO Offline
              olivierlambert Vates 🪐 Co-Founder CEO
              last edited by

              Okay thanks, we'll take a look 🙂 Let me ping @florent if he's available 🙂

              A 1 Reply Last reply Reply Quote 0
              • A Online
                Andrew Top contributor @olivierlambert
                last edited by

                @olivierlambert
                Still open...
                https://github.com/vatesfr/xen-orchestra/issues/7029

                andrew64k created this issue in vatesfr/xen-orchestra

                open File level restoration not working on LVM partition #7029

                M 1 Reply Last reply Reply Quote 1
                • M Offline
                  michmoor0725 @Andrew
                  last edited by

                  @Andrew
                  Thanks!
                  Watching that Issue now.

                  florentF 1 Reply Last reply Reply Quote 0
                  • florentF Offline
                    florent Vates 🪐 XO Team @michmoor0725
                    last edited by

                    @michmoor0725 the lvm parittion with one disk should work. Is it the case for you ?

                    A 1 Reply Last reply Reply Quote 0
                    • A Online
                      Andrew Top contributor @florent
                      last edited by

                      @florent Still not working.

                      Here is the partition list for a standard Ubuntu 20.04.3 install.
                      Partition 3 is the main OS root as a single LVM (19G).
                      Trying to restore a file from it makes XO confused.

                      xvda                      202:0    0   20G  0 disk
                      ├─xvda1                   202:1    0    1M  0 part
                      ├─xvda2                   202:2    0    1G  0 part /boot
                      └─xvda3                   202:3    0   19G  0 part
                        └─ubuntu--vg-ubuntu--lv 253:0    0   19G  0 lvm  /
                      

                      restore-file.jpg

                      florentF 1 Reply Last reply Reply Quote 0
                      • florentF Offline
                        florent Vates 🪐 XO Team @Andrew
                        last edited by

                        my test LVM VM works 😕

                        @michmoor0725 or @Andrew , do you have any open tunnel I can use to test on your VM ?

                        @Andrew said in File restore error on LVMs:

                        @florent Still not working.

                        Here is the partition list for a standard Ubuntu 20.04.3 install.
                        Partition 3 is the main OS root as a single LVM (19G).
                        Trying to restore a file from it makes XO confused.

                        xvda                      202:0    0   20G  0 disk
                        ├─xvda1                   202:1    0    1M  0 part
                        ├─xvda2                   202:2    0    1G  0 part /boot
                        └─xvda3                   202:3    0   19G  0 part
                          └─ubuntu--vg-ubuntu--lv 253:0    0   19G  0 lvm  /
                        

                        restore-file.jpg

                        it see the partition but fail to m

                        @Andrew said in File restore error on LVMs:

                        @florent Still not working.

                        Here is the partition list for a standard Ubuntu 20.04.3 install.
                        Partition 3 is the main OS root as a single LVM (19G).
                        Trying to restore a file from it makes XO confused.

                        xvda                      202:0    0   20G  0 disk
                        ├─xvda1                   202:1    0    1M  0 part
                        ├─xvda2                   202:2    0    1G  0 part /boot
                        └─xvda3                   202:3    0   19G  0 part
                          └─ubuntu--vg-ubuntu--lv 253:0    0   19G  0 lvm  /
                        

                        restore-file.jpg

                        M 1 Reply Last reply Reply Quote 0
                        • M Offline
                          michmoor0725 @florent
                          last edited by olivierlambert

                          @florent Yes i have a support tunnel IP.
                          id: redacted but kept by our team 😉

                          F 1 Reply Last reply Reply Quote 0
                          • F Offline
                            Fridgemagnet @michmoor0725
                            last edited by Fridgemagnet

                            I ran into this issue (xcp-ng 8.3.0 beta 2, XO 4cf03 ronivay docker image) and thought it had to do with my vm disk storage location (local vs NFS vs iSCSI). After not being able to restore on the file level from delta backups in all three situations I randomly decided to untick the "set up this disk as an LVM group" when installing a test vm which is enabled by default on Ubuntu 24.04 LTS.
                            79d9060a-e71d-4e7c-afed-04557a4a5086-image.png
                            The following screenshot is what the storage setup looks like with the default lvm group.
                            5a41e741-0eb5-4d11-b69b-28608d231dd7-image.png

                            1 Reply Last reply Reply Quote 0
                            • P Offline
                              peo
                              last edited by

                              I'm a new ("about a week old") user of xcp-ng and Xen Orchestra and observed the same problem as described in this forum post.

                              The older (20.04.6 LTS) Linux installation I moved out of ESXi just for testing purposes is the one I'm testing on for now, but this problem seems to be easily reproduced on the newer versions as well (and I will test it within a few days).

                              From the backup I create, I can list the partitions in the backup, but am only able to select files from the boot partition (1.42GB), the two other shows the red exclamation mark.

                              The behaviour is the same with both XO from source and the just activated full trial of XOA (for testing the file-level restore).

                              Anyone solved this yet ?

                              F 1 Reply Last reply Reply Quote 0
                              • F Offline
                                flakpyro @peo
                                last edited by

                                @peo i am seeing the same issue on an Ubuntu 22.04 LTS VM setup with LVM.

                                J 1 Reply Last reply Reply Quote 0
                                • J Offline
                                  john.c @flakpyro
                                  last edited by john.c

                                  @flakpyro What's the state of the LVM VG, its members and the LV? Has the VG been brought active along with its LV?

                                  Is the VG and LV in the active system the file is being restored to the same as the one in the backup?

                                  Are there any missing member disks (virtual) from the VM preventing the restore?

                                  Are the relevant packages for the LVM software installed namely the following:-

                                  • lvm2
                                  • lvm2-dbusd
                                  • lvm2-lockd
                                  F 1 Reply Last reply Reply Quote 0
                                  • F Offline
                                    flakpyro @john.c
                                    last edited by

                                    @john-c

                                    Here is the output of vgdisplay and lvdisplay from the VM being backed up.

                                      --- Volume group ---
                                      VG Name               ubuntu-vg
                                      System ID             
                                      Format                lvm2
                                      Metadata Areas        1
                                      Metadata Sequence No  6
                                      VG Access             read/write
                                      VG Status             resizable
                                      MAX LV                0
                                      Cur LV                1
                                      Open LV               1
                                      Max PV                0
                                      Cur PV                1
                                      Act PV                1
                                      VG Size               <58.00 GiB
                                      PE Size               4.00 MiB
                                      Total PE              14847
                                      Alloc PE / Size       14847 / <58.00 GiB
                                      Free  PE / Size       0 / 0   
                                      VG UUID               iUJyAl-7Ltq-IvF5-xla3-RA1E-bYP5-QJABwy
                                    
                                    
                                      --- Logical volume ---
                                      LV Path                /dev/ubuntu-vg/ubuntu-lv
                                      LV Name                ubuntu-lv
                                      VG Name                ubuntu-vg
                                      LV UUID                bwEE3c-fkgc-nATq-czqZ-TkdK-xFA1-ULmRGz
                                      LV Write Access        read/write
                                      LV Creation host, time ubuntu-server, 2022-05-30 11:47:36 -0600
                                      LV Status              available
                                      # open                 1
                                      LV Size                <58.00 GiB
                                      Current LE             14847
                                      Segments               1
                                      Allocation             inherit
                                      Read ahead sectors     auto
                                      - currently set to     256
                                      Block device           253:0
                                    
                                    

                                    Its basically a bog standard Ubuntu install. The file system on the LV is XFS.

                                    The active system and backup should have the same exact layout. And no missing virtual disks.

                                    J 1 Reply Last reply Reply Quote 0
                                    • J Offline
                                      john.c @flakpyro
                                      last edited by

                                      @flakpyro said in File restore error on LVMs:

                                      @john-c

                                      Here is the output of vgdisplay and lvdisplay from the VM being backed up.

                                        --- Volume group ---
                                        VG Name               ubuntu-vg
                                        System ID             
                                        Format                lvm2
                                        Metadata Areas        1
                                        Metadata Sequence No  6
                                        VG Access             read/write
                                        VG Status             resizable
                                        MAX LV                0
                                        Cur LV                1
                                        Open LV               1
                                        Max PV                0
                                        Cur PV                1
                                        Act PV                1
                                        VG Size               <58.00 GiB
                                        PE Size               4.00 MiB
                                        Total PE              14847
                                        Alloc PE / Size       14847 / <58.00 GiB
                                        Free  PE / Size       0 / 0   
                                        VG UUID               iUJyAl-7Ltq-IvF5-xla3-RA1E-bYP5-QJABwy
                                      
                                      
                                        --- Logical volume ---
                                        LV Path                /dev/ubuntu-vg/ubuntu-lv
                                        LV Name                ubuntu-lv
                                        VG Name                ubuntu-vg
                                        LV UUID                bwEE3c-fkgc-nATq-czqZ-TkdK-xFA1-ULmRGz
                                        LV Write Access        read/write
                                        LV Creation host, time ubuntu-server, 2022-05-30 11:47:36 -0600
                                        LV Status              available
                                        # open                 1
                                        LV Size                <58.00 GiB
                                        Current LE             14847
                                        Segments               1
                                        Allocation             inherit
                                        Read ahead sectors     auto
                                        - currently set to     256
                                        Block device           253:0
                                      
                                      

                                      Its basically a bog standard Ubuntu install. The file system on the LV is XFS.

                                      The active system and backup should have the same exact layout. And no missing virtual disks.

                                      Does the UUID from the backup match the one from the live machine?

                                      Does the VG name matchup with backup and live machine?

                                      F 1 Reply Last reply Reply Quote 0
                                      • F Offline
                                        flakpyro @john.c
                                        last edited by

                                        @john-c Yep nothing has been renamed in regards to the LV or VG name inside the VM. I have not made any recent changes to this VM or the backup job itself.

                                        I assume the UUID matches up as the VM is displayed by its name in the "VMs to backup" section of the backup job and not simply displayed as a UUID.

                                        J 1 Reply Last reply Reply Quote 0
                                        • J Offline
                                          john.c @flakpyro
                                          last edited by john.c

                                          @flakpyro said in File restore error on LVMs:

                                          @john-c Yep nothing has been renamed in regards to the LV or VG name inside the VM. I have not made any recent changes to this VM or the backup job itself.

                                          I assume the UUID matches up as the VM is displayed by its name in the "VMs to backup" section of the backup job and not simply displayed as a UUID.

                                          I'm referring to the UUID of VG, PV and LV of the disks used by VM's OS (on live) and in the backup. Cause if these change then it can cause issues with bringing the LVM VG back up into operation.

                                          Thus afterwards the mounting of the LVM LV's from the VG on the VM's Linux based Operating System will have trouble as a result. So wouldn't be able to get the root directory (/). Which is what several people are trying to restore into.

                                          F 1 Reply Last reply Reply Quote 0
                                          • F Offline
                                            flakpyro @john.c
                                            last edited by

                                            @john-c Do you know what would cause them to change? I am testing a restore from last nights backup so i assume the UUIDs have not changed. I could do a full restore from last nights backup however and compare to be sure.

                                            J 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post