Hey team, I tried to use R2 with Spark. It failed due to multi-part upload issue. However, I now have a problem: my bucket has 0 file in it but reports a size of 55GB and I can't delete it because both the UI/rclone/wrangler claim it's not empty. How can I solve the situation? I don't want to pay for this ghost space.

And also if you tried to use R2 with spark S3A connector and have some advice on it, I'll be happy about it! Thanks!

Try running a ListMultipartUploads and making sure all pending uploads have been aborted before trying to delete your bucket

Awesome thanks - regarding the Spark question, is Spark a use-case tested on Cloudflare side? Is it something you want to support at some point?

I personally haven't used it, but as long as it issues S3 requests that R2 supports, it should work! If you notice inconsistencies, please let someone here know!

It seems that it uses S3 features unsupported by R2 - I'll continue to investigate. Thanks anyway!

Ok so conditional put can be used for compare and swap like atomic updates; prevent two workers overwriting each other. Thanks!

Mind sharing what they are? Just out of curiosity?

The problem is that I don't manage to have the logs of the REST calls, but I've seen consistent failure with multi-part uploads. Also it seems that listing and deleting have issues. However, without the exact request, it's not useful information

Ah sure, each (conditional) put is atomic, but two workers can still overwrite each other if you’re not careful 😄 The last write wins, if both workers’ put conditions evaluate to true

Right. Multipart uploads should work, although ListParts comes to mind as something that isn’t supported yet, but should be pretty soon.

Not if they condition on the etag? Since one of them updating the file would change the etag

Ah I see, yep that should work just fine then

Is operation B (get request) count including 404 request count? (not found file request)

Yes, 404s are billable operations.

My R2 public bucket assets (.png, .gltf, .json) load on all browsers and connections (anything desktop or laptop, Safari iOS) except occasionally they don't load on Chrome iOS. If I go to the Chrome settings and turn "Allow Cross-Website Tracking" on, or off, it appears to reset something which allows R2 assets to load again. Does anyone have any theories on what could be happening? I'm really close to switching to S3 just to return to sanity.

You're loading them on a custom domain, I hope, and not r2.dev? If you're using r2.dev it's rate limited / not meant for production

Yes, custom domain.

Do you get an error page / error code or anything more then they just don't load?

I can share whatever you need if you are curious about the settings

The request just never returns and doesn’t time out.

Once I flip "Allow Cross-Website Tracking" on or off, it continues to work on the same connection for a while.

Might have something to do with caching. I can try turning Cache Development Mode on next time it happens to see if it has any effect.

That's strange, I don't have an ios device to test with, but I would assume that's just blocking cookies or JS trackers and shouldn't have anything to do with normal asset requests. And it's just Chrome iOS? On IPhone both Safari and Chrome use the same underlying web framework/webkit, that sounds really strange to me if only one is doing it. Not sure if there's much I'll be find from poking around with it, but can you share the custom domain of your bucket?

storage.iliad.ai

It feels about as strange as it sounds. It has always worked on Safari and somewhat frequently stops loading on Chrome.

There are definitely other differences between Chrome and Safari on iOS that cause frustrations like this, for instance inconsistencies in how they handle CORS and session data

It seems likely to me that something is wrong with my settings though, because I'm just using a public bucket with the S3 API which must be one of the most common use cases of R2 and it's intermittently not working on a very popular method of browsing, so you'd think the problem is on my end somehow

but I have no idea what I'm doing wrong if I am doing something wrong

hmm yea not sure about that one. I tried reproducing it via browserstack (supposed real IOS devices running Chrome) and couldn't get it to not load. R2 Custom Domain forces its TLS/HTTP Settings over your zone's. There was an issue earlier #895794943182909470 with the BOM/Mumbai India cloudflare pop, if that's the pop you are closest to. Difficult to debug something off just "never loads", just weird