https://discord.cloudflare.com logo
Join Discord
Powered by
# r2
  • v

    Vitali

    04/29/2022, 2:44 PM
    (my search in the console had garbage I didn't notice)
  • e

    Erisa | Support Engineer

    04/29/2022, 2:44 PM
    makes me wonder why every other S3 provider accepts that fine
  • v

    Vitali

    04/29/2022, 2:44 PM
    > The x-amz-content-sha256 header is required for all AWS Signature Version 4 requests. It provides a hash of the request payload. If there is no payload, you must provide the hash of an empty string.
  • v

    Vitali

    04/29/2022, 2:44 PM
    https://docs.aws.amazon.com/AmazonS3/latest/API/sig-v4-header-based-auth.html
  • v

    Vitali

    04/29/2022, 2:45 PM
    Even in streaming chunked mode it's required (
    STREAMING-AWS4-HMAC-SHA256-PAYLOAD
    )
  • v

    Vitali

    04/29/2022, 2:45 PM
    https://forum.rclone.org/t/send-x-amz-content-sha256-header-with-put-for-ceph-s3/24913
  • e

    Erisa | Support Engineer

    04/29/2022, 2:46 PM
    Yeah it's strange it doesn't send it
  • e

    Erisa | Support Engineer

    04/29/2022, 2:46 PM
    managed to find https://github.com/rclone/rclone/issues/5422
  • e

    Erisa | Support Engineer

    04/29/2022, 2:47 PM
    they note that it sends
    content-md5
    instead, among other things
  • v

    Vitali

    04/29/2022, 2:48 PM
    That's not sufficient though. They should be sending
    x-amz-content-sha256: UNSIGNED-PAYLOAD
    instead
  • e

    Erisa | Support Engineer

    04/29/2022, 2:49 PM
    I see, thanks for the assistance
  • v

    Vitali

    04/29/2022, 2:50 PM
    np
  • v

    Vitali

    04/29/2022, 2:52 PM
    Footnote 1 is correct. The object size limit is
    5TB - around 5GB
    . The max upload size if
    5GB - around 5 MB
  • i

    Isaac McFadyen | YYZ01

    04/29/2022, 2:53 PM
    Out of curiosity, why is that?
  • i

    Isaac McFadyen | YYZ01

    04/29/2022, 2:53 PM
    (Just wondering)
  • v

    Vitali

    04/29/2022, 2:53 PM
    Encryption overhead
  • v

    Vitali

    04/29/2022, 2:54 PM
    Our storage nodes have a 5TB and 5GB limit and we have encryption overhead that steals a little bit away from that.
  • i

    Isaac McFadyen | YYZ01

    04/29/2022, 2:55 PM
    Cool.
  • j

    john.spurlock

    04/29/2022, 3:02 PM
    ah that's true - good point
  • e

    Erisa | Support Engineer

    04/29/2022, 3:14 PM
    I decided to clone the rclone source and add that header to see what happens, now its getting
    Copy code
    xml
    <Error>
      <Code>InvalidArgument</Code>
      <Message>Invalid Argument: Date</Message>
    </Error>
    With
    Copy code
    Headers:
    x-amz-acl:             private
    x-amz-content-sha256:  UNSIGNED-PAYLOAD
    user-agent:            rclone/v1.59.0-DEV
    content-md5:           sFQDISxmvcjMxZf+32zV/g==
    content-type:          text/plain; charset=utf-8
    x-amz-meta-mtime:      1651242675.438993951
    content-length:        10
    accept-encoding:       gzip
    
    Query:
    X-Amz-Algorithm:     AWS4-HMAC-SHA256
    X-Amz-Credential:    credentialhere/20220429/us-east-1/s3/aws4_request
    X-Amz-Date:          20220429T150928Z
    X-Amz-Expires:       900
    X-Amz-SignedHeaders: content-md5;content-type;host;x-amz-acl;x-amz-meta-mtime
    X-Amz-Signature:     signaturehere
    I'm not overly familiar with S3 API but I'm not 100% sure what it wants because
    X-Amz-Date
    and the date in the credential seem to follow whats here
  • v

    Vitali

    04/29/2022, 3:18 PM
    Uggh. I have a fix up that'll help clarify those kinds of errors
  • v

    Vitali

    04/29/2022, 3:22 PM
    I think it means the signed date in the credential isn't matching... which it clearly is
  • v

    Vitali

    04/29/2022, 3:22 PM
    wtf
  • v

    Vitali

    04/29/2022, 3:22 PM
    I'll make sure the next release has more helpful info
  • v

    Vitali

    04/29/2022, 3:23 PM
    I guess a 0-length list query could be used to check if there's any objects in the bucket without actually retrieving it? It really is a weird edge case.
  • i

    itsmatteomanf

    04/29/2022, 4:52 PM
    Dropshare still isn’t happy… 😦
  • v

    Vitali

    04/29/2022, 4:55 PM
    DM me the account tag
  • t

    trbodev

    04/29/2022, 5:00 PM
    not to be pushy or impatient but is there an estimated ETA/completion percentage (Q3/Q4 2022, 85% done, etc?) for the open beta? (or whatever its gonna be called)
  • l

    lmtr0

    04/29/2022, 5:02 PM
    Ok i'm playing with the s3 api
  • l

    lmtr0

    04/29/2022, 5:02 PM
    and....
1...747576...1050Latest