XCP-ng
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Sample fields for Amazon S3 remote setup?

    Scheduled Pinned Locked Moved Solved Backup
    16 Posts 3 Posters 792 Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A Offline
      archw @olivierlambert
      last edited by olivierlambert

      @olivierlambert

      Oops..forgot to post that: "Xen Orchestra, commit 990c2"

      Lets say this is the info for the account:
      Bucket name : mybucket123456-789-0123-4567-890123
      Region is US West (Oregon) us-west-2
      s3 info = s3://mybucket123456-789-0123-4567-890123/mystuff/my-backups/

      When setting up the remote, I set the fields as follows:

      Type = "Amazon Webservices S3"
      Name="Amazon Stuff"
      Use HTTPS=yes
      Allow unauthorized="no"
      AW s3 endpoint= "s3express-control.us-west-2.amazonaws.com"
      Region=<blank>
      AWS3 bucket name="mybucket123456-789-0123-4567-890123"
      Directory="s3://mybucket123456-789-0123-4567-890123/mystuff/my-backups/"
      Set access key ID and secret key.

      Since I posted the error last night, I noticed that I had the AW s3 endpoint field was incorrectly set to "US West (Oregon) us-west-2" and corrected it to "s3express-control.us-west-2.amazonaws.com"

      When I finished it, I clicked ok and got a new error message that says "AccessDenied":

      remote.test
{
  "id": "c7b8699a-447e-4fbf-850c-04546ce9a5eb"
}
{
  "name": "AccessDenied",
  "$fault": "client",
  "$metadata": {
    "httpStatusCode": 403,
    "requestId": "0299B4704E01018FBA850D1B040020ECDCE58C02",
    "extendedRequestId": "JM7bWZAg",
    "attempts": 1,
    "totalRetryDelay": 0
  },
  "Code": "AccessDenied",
  "RequestId": "0299B4704E01018FBA850D1B040020ECDCE58C02",
  "HostId": "JM7bWZAg",
  "message": "Access Denied",
  "stack": "AccessDenied: Access Denied
    at throwDefaultError (/opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@smithy/smithy-client/dist-cjs/index.js:838:20)
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@smithy/smithy-client/dist-cjs/index.js:847:5
    at de_CommandError (/opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@aws-sdk/client-s3/dist-cjs/index.js:4748:14)
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@smithy/middleware-serde/dist-cjs/index.js:35:20
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@aws-sdk/middleware-signing/dist-cjs/index.js:226:18
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@smithy/middleware-retry/dist-cjs/index.js:320:38
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@aws-sdk/middleware-flexible-checksums/dist-cjs/index.js:174:18
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:98:20
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:121:14
    at /opt/xo/xo-builds/xen-orchestra-202405231838/node_modules/@aws-sdk/middleware-logger/dist-cjs/index.js:34:22
    at S3Handler._createReadStream (/opt/xo/xo-builds/xen-orchestra-202405231838/@xen-orchestra/fs/src/s3.js:289:15)"
}

      I also tried changing the Directory to:

      Directory="//mybucket123456-789-0123-4567-890123/mystuff/my-backups/"
Directory="/mystuff/my-backups/"

      But neither worked

      1 Reply Last reply Reply Quote 0
      • R Offline
        rtjdamen @archw
        last edited by

        @archw i was testing this today, i have had the same error and it was related to the fact i had the bucket name incorrect, changed it to the correct name and it worked correctly, pretty straightforward. what have u used for the field so far?

        A 1 Reply Last reply Reply Quote 0
        • A Offline
          archw @rtjdamen
          last edited by

          @rtjdamen

          I called it the same bucket name that shows up on the S3 log in page (this is the fake name but "mybucket123456-789-0123-4567-890123" but I used the actual name of the bucket).

          R 1 Reply Last reply Reply Quote 0
          • R Offline
            rtjdamen @archw
            last edited by

            @archw ok, i just used a simple name like bucket123 for it, and that worked, did u set the AIM correct?

            A 1 Reply Last reply Reply Quote 0
            • A Offline
              archw @rtjdamen
              last edited by

              @rtjdamen
              Whats an "AIM"?

              R 1 Reply Last reply Reply Quote 0
              • R Offline
                rtjdamen @archw
                last edited by

                @archw inside amazon console u navigate to AIM, u can create a new user, give the user access to s3 storage.

                Then u need to go into this user and create an access key

                A 1 Reply Last reply Reply Quote 0
                • A Offline
                  archw @rtjdamen
                  last edited by

                  @rtjdamen
                  Oh...that...yeah...I've got another piece of software that pushes the info to S3 however it doesn't use a "user name". Instead it uses the S3 access key ID and secret key. Is that what you meant?

                  R 1 Reply Last reply Reply Quote 0
                  • R Offline
                    rtjdamen @archw
                    last edited by

                    @archw yes, u need to create a new user and then create the access key id and secret key to connect, if u need to check your credentials use winscp to check if everything is set up correctly

                    A 1 Reply Last reply Reply Quote 0
                    • A Offline
                      archw @rtjdamen
                      last edited by

                      @rtjdamen
                      Boom - that worked!

                      I opened up an SCP session and let it take the defaults and it immediately connected. I noticed that WINSCP calls it "s3.amazonaws.com" so I changed :

                      AW s3 endpoint= "s3express-control.us-west-2.amazonaws.com"
                      -to-
                      AW s3 endpoint= "s3.amazonaws.com"

                      I also changed:
                      Directory="s3://mybucket123456-789-0123-4567-890123/mystuff/my-backups/"
                      -to-
                      Directory="mystuff/my-backups/"

                      Thanks!!

                      R 1 Reply Last reply Reply Quote 0
                      • R Offline
                        rtjdamen @archw
                        last edited by

                        @archw glad i could help!

                        A 1 Reply Last reply Reply Quote 0
                        • A Offline
                          archw @rtjdamen
                          last edited by

                          @rtjdamen
                          You rock!

                          1 Reply Last reply Reply Quote 0
                          • olivierlambertO olivierlambert marked this topic as a question on
                          • olivierlambertO olivierlambert has marked this topic as solved on
                          • olivierlambertO Offline
                            olivierlambert Vates 🪐 Co-Founder CEO
                            last edited by

                            Is there anything we could add to our doc to make it better for new users?

                            A 1 Reply Last reply Reply Quote 0
                            • A Offline
                              archw @olivierlambert
                              last edited by

                              @olivierlambert

                              Example of what a successful screen look like (even though it has fake work in it). Sort of like the shadow y'all put in the fields.

                              761ee791-6280-4749-9421-5ecf53a5648a-image.png

                              1 Reply Last reply Reply Quote 0
                              • olivierlambertO Offline
                                olivierlambert Vates 🪐 Co-Founder CEO
                                last edited by

                                Can you write exactly what you would expect to be written as a "pre written" text?

                                1 Reply Last reply Reply Quote 0
                                • First post
                                  Last post