XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    S3 Backup - maximum number of parts

    Scheduled Pinned Locked Moved Xen Orchestra
    1 Posts 1 Posters 25 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D Offline
      deligatedgeek
      last edited by

      We use S3 swift proxy for swift storage and have built some infrastructure around it.

      When we tried S3 for backup we got this error
      xo-server[144792]: error: InvalidArgument: Part number must be an integer between 1 and 1000, inclusive

      Swift defaults to max number of parts of 1000, as do several commercial S3 implementations, and we have tried increasing but it caused instability in one of applications built around swift SLO.

      The solution I've implemented is to reduce the MAX_PART_NUMBER in
      @xen-orchestra/fs/dist/s3.js to 1000, but this be overwritten on each upgrade.

      Could an option be added into the AWS S3 parameters to set this? or even just being able to override the value in a configuration file somewhere.

      1 Reply Last reply Reply Quote 0
      • First post
        Last post