@florent said in S3 Backup "Please Match The Requested Format":
@vincentp If you backup multiple VMs in parallel, does the total speed stays at 80MB/s or does it scales with the number of VM ?
Yes it does.
NBD also use encryption by default. You can use it unencrypted by removing the NBD purpose on the network and adding insecure_nbd https://docs.citrix.com/en-us/citrix-hypervisor/developer/changed-block-tracking-guide/enabling-nbd.html#enabling-an-insecure-nbd-connection-for-a-network-notls-mode
I ran 2 full backups together - netdata and truenas are showed 1.45Gb/s so that's definitely an improvement - although it's using a lot of cpu
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
23882 root 20 0 1022156 101484 20560 S 105.0 1.3 18:08.94 xapi
25349 root 20 0 31884 3872 2660 R 66.0 0.0 0:25.54 tapdisk
10163 root 20 0 32696 4896 2900 R 28.7 0.1 2:25.91 tapdisk
VM1
Duration: 10 minutes
Size: 41.51 GiB
Speed: 67.6 MiB/s
VM2
Duration: 10 minutes
Size: 23.25 GiB
Speed: 39.13 MiB/s
Some other backups are running at the moment, when they are done I will measure VM1 by itself to compare to the earlier one I posted.