I punted on the team putting in effort into listUploads because the upload ID & part Etag are encrypted values that maintain state. However, synthesizing the upload ID/part ETag generates a random number every time so you'll get unique (validly accepted) values every single time you do the listing (I figured better for us to stabilize that piece before implementing those features)

i'm going to try and stitch together a larger object since

PutObject

craps out at around 500mb (see my exact numbers from yesterday)

Yeah I got that 🙂

I think the production zone is probably misconfigured in the networking layer somewhere

That doesn't explain the multipart problem though

send back stack traces for all 500 internal errors!

That's a non-starter

The stack traces are minified so they're useless

I don't think we have any tooling to unminify them outside of sentry

i see, well hopefully you have logging or something when those happen - i'll try to get a reproducible multipart 500 scenario, but they seem to be flaky - work some times but not others

we should but I'm not seeing it

At a minimum it should be in our logging system but I don't know how to query that. Let me double-check with someone who does

Oh - what are the sizes of the individual parts you're uploading?

We have an undocumented difference from S3 here - every part except the last must be equal size

Need to update the docs on that piece

oohhh

definately not always the case

that might have been the thing

You're uploading variable size parts?

do you support reuploading the same part with a different size?

yes for testing i did

currently no but I've been meaning to lift that

Right now the validation happens in UploadPart but I need to fix that to happen in the publish step

it seems to succeed btw, at least reuploading part 1

The last part is fine to change the size of

but i think maybe that was one of the times it seemed wedged afterwards

ok def good to know!

The implications are weird and unintuitive

same limitation on uploadpartcopy? i'm looking at that now

ie same size parts