XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login
    1. Home
    2. vincentp
    3. Best
    V
    Offline
    • Profile
    • Following 0
    • Followers 0
    • Topics 3
    • Posts 22
    • Groups 0

    Posts

    Recent Best Controversial
    • RE: S3 Backup "Please Match The Requested Format"

      @florent said in S3 Backup "Please Match The Requested Format":

      @vincentp If you backup multiple VMs in parallel, does the total speed stays at 80MB/s or does it scales with the number of VM ?

      Yes it does.

      NBD also use encryption by default. You can use it unencrypted by removing the NBD purpose on the network and adding insecure_nbd https://docs.citrix.com/en-us/citrix-hypervisor/developer/changed-block-tracking-guide/enabling-nbd.html#enabling-an-insecure-nbd-connection-for-a-network-notls-mode

      I ran 2 full backups together - netdata and truenas are showed 1.45Gb/s so that's definitely an improvement - although it's using a lot of cpu

        PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
      23882 root      20   0 1022156 101484  20560 S 105.0  1.3  18:08.94 xapi
      25349 root      20   0   31884   3872   2660 R  66.0  0.0   0:25.54 tapdisk
      10163 root      20   0   32696   4896   2900 R  28.7  0.1   2:25.91 tapdisk
      

      VM1
      Duration: 10 minutes
      Size: 41.51 GiB
      Speed: 67.6 MiB/s

      VM2
      Duration: 10 minutes
      Size: 23.25 GiB
      Speed: 39.13 MiB/s

      Some other backups are running at the moment, when they are done I will measure VM1 by itself to compare to the earlier one I posted.

      posted in Xen Orchestra
      V
      vincentp
    • RE: S3 Backup "Please Match The Requested Format"

      @planedrop said in S3 Backup "Please Match The Requested Format":

      I am also curious if multiple backups at the same time results in faster overall speeds? Not quite sure how parallel a single VM backup is, but maybe each can run at that 15 or so MiB/s so multiple backups can use more bandwidth, I'll have to test this to find out.

      So I did get to test this scenario out last night - finally got my production vms migrated over - that's another story - and did run 2 full backups at the same time.

      Duration: 9 hours
      Size: 512.03 GiB
      Speed: 16.98 MiB/s

      Duration: 7 hours
      Size: 511.97 GiB
      Speed: 20.25 MiB/s

      I did monitor for a short while (it was 2am) with netdata and observed the outbound connection running between 600Mbs and 900Mbs - so I guess that's about as good as it's going to get (1Gbs connection). In the long term I really need to get a truenas server at this site and run the backups to backblaze from there.

      posted in Xen Orchestra
      V
      vincentp