S3 Chunk Size

florent

@rizaemet-0 the cleanVM is the most demanding part of the backup job (mostly listing, moving and deleting blocks )

olivierlambert

Yeah, it's not surprising. Ceph S3 implementation is known to be "average" and failure-prone in those cases.

rizaemet 0

Could you please share which version of aws-sdk Xen-Orchestra is currently using? I will share this with our S3 service provider.

florent

@rizaemet-0
sure : "@aws-sdk/client-s3": "^3.54.0",

john.c

@olivierlambert said in S3 Chunk Size:

Yeah, it's not surprising. Ceph S3 implementation is known to be "average" and failure-prone in those cases.

@olivierlambert @florent Well you’re likely to see more use of Ceph by providers, following MinIO entering maintenance mode. Also Canonical are going to be doing more development and selling what it calls Micro Ceph. It’s blog post gives more details.

https://ubuntu.com/blog/microceph-why-its-the-superior-minio-alternative

florent

@john.c yes for sure, and maybe we will be able to set the chunk size on a future date ( especially since we did some of the ground work for vhd / qcow2)

olivierlambert

I heard better feedback from Garage or RustFS than Ceph for a successor after Minio.

Pilow

@olivierlambert planning to give RustFS a try, i'll report back (currently full minio)

olivierlambert

Keep us posted, happy to hear from it!

bmunier

@olivierlambert Hi all. We've deployed one client on the last version of XCP and XOA and we need to backup on S3 remote (installed on Ceph and working with all of our backup solution : Veeam, cinder...)

Backup failed with 502 error on clean-vm step :

{
             "id": "1772809915090",
             "message": "clean-vm",
             "start": 1772809915090,
             "status": "failure",
             "end": 1772811181179,
             "result": {
               "name": "502",
               "$fault": "client",
               "$metadata": {
                 "httpStatusCode": 502,
                 "attempts": 3,
                 "totalRetryDelay": 70
               },

I only have this destination (my customer needs to use 50To), how can i correcting this pb (a ticket opened in vates)