i can't test, i don't have access to r2

can't confirm exact size as I didn't go that detailed, but I have the same issue 🙂

FML - yeah. For some reason we have a config bug that hasn't been solved

Forgot about that one

It should die closer to ~3GB (& does on the staging environment)

Sweet - should be resolved. Try now

If you try to upload > 6GB you'll get the HTML page again instead of a nice XML response "EntityTooLarge" error. Hopefully that'll be OK.

my 1GB upload that failed before just went through perfectly! thanks beelzabub!

mines still uploading o7

might be time to change my isp

That would take at least an hour to upload here

Takes me around like 5 minutes per test lol

an hour sounds... excruciating

lol my worker throws an exemption when i try to download said 1GB file from R2 😆

Workers are limited to 128mb or something around there

Oh yeah, Andrew.

yeah :/

That's if you're not streaming.

Try streaming it?

(as in, return the await get() directly, don't process it)

so like

return await env.BINDING.get("filename")

Not sure if you even need to await.

when i get home i will have to try 👀

That's correct. You really want to avoid calling `.text`/`.json`/`.array` etc on the resultant body unless you 100% know the size is small enough to be contained in ram. Depending on how many requests you're getting concurrently into the same metal, that could be anywhere from a few hundred kb to ~128MB. Otherwise make sure you're processing the file piecemeal in a streaming fashion. You can do passthrough. You can also construct a custom ReadableStream/WritableStream to pipe the data through and use

readAtLeast

to help you read a fixed amount of data at a time (that's how R2 works).

All files are encrypted/decrypted at the edge for R2 with a Worker which means we have all the same design challenges. How do you encrypt and upload 5GB? How do you download a large file? In other words, as soon as you enter the front door of Cloudflare's network, your data is swaddled in encryption right away before being sent anywhere (in addition to being swaddled in encryption when being sent between you and Cloudflare).

how are you able to do streaming digest calculating with bog-standard webcrypto?

oh sweet i missed that

wish that was standard