Cloudflare

i did have 3 minio object storage servers

and have now moved the whole thing over to cloudflare and it's like the whole thing is on fire

ah Sid, sometimes it works, sometimes it doesn't

Wait so you’re not trying to write via the custom domain, are you?

[objectstore]
type = s3
provider = Cloudflare
access_key_id =
secret_access_key = 
endpoint = https://cloudflarestorage.com/
acl = private

rclone mount objectstore:wtgrid /mnt/wtgrid/ --daemon --allow-other --vfs-read-chunk-size off --transfers=80 --fast-list --allow-non-empty  --no-modtime 
rclone mount objectstore:backups /mnt/backups/ --daemon --allow-other --vfs-read-chunk-size off --transfers=80 --allow-non-empty  --no-modtime

and the error i get is that it doesn't have permissions to overwrite the file

but i read it doesn't really have permissions?

20<:10:1074014168631496835>00 - [MAP IMAGE CONNECTOR]: AddMapTile failed: Access to the path "/mnt/wtgrid/maptiles/00000000-0000-0000-0000-000000000000/map-1-4996-5000-objects.jpg" is denied.

Your endpoint should be https://<accountId>.r2.cloudflarestorage.com

I’m not sure how your reads are working

i didn't know if there was some kind of something i need to do with rclone

Can you give me your account ID? I’ll check logs. Account IDs aren’t secret, so you can just send it over here

endpoint = https://6794a103443a62195d52fbca19f56e05.r2.cloudflarestorage.com/

this particular bit of code writes out the map tiles

Hm, I don't see any 403s or anything, just 404s, Is the request even reaching R2?
I don't see any requests for `/mnt/wtgrid/maptiles/00000000-0000-0000-0000-000000000000/map-1-4996-5000-objects.jpg` either

okay cool let me do some more digging - it might be something with the code itself

does the cdn work with the rclone mounts as well

I'm not familiar with rclone mounts, what are they?

The CDN only comes into play when using your custom domain, which can only read objects

Yeah I presume then it should work just the same

but i did notice that during the day stuff got faster

There are no cold starts or anything with Workers, how fast do you mean? Sub 100ms?

well - more like the expeirence on the grid

64 bytes from 104.18.9.90 (104.18.9.90): icmp_seq=1 ttl=60 time=1.73 ms
64 bytes from 104.18.9.90 (104.18.9.90): icmp_seq=2 ttl=60 time=1.31 ms

401s on writes

>  it seems to be steadily getting faster to access
The power of the CDN with Cache <:MeowHeartCloudflare:897193652089155645>

even if its not going through a custom domain for those functions?

i mean the whole thing is completely flying

Ha I'm not sure what you consider fast, but if it's _too_ fast, I'd double-check if it's doing the right thing 😛

hi, are there any instructions how to use Filezilla Pro to connect to R2?

Have you tried using the S3 mode, but with the endpoint, access key id / secret substituted with ones generated by R2? https://developers.cloudflare.com/r2/api/s3/tokens/

> **These features are now available!!**
> - **Object Lifecycles**: <https://developers.cloudflare.com/r2/buckets/object-lifecycles/>
> - Public buckets, with custom domains: <https://developers.cloudflare.com/r2/data-access/public-buckets/#enable-public-access-for-your-bucket>
> - Presigned URLs in the S3-compatible API
> 
> **Future roadmap**
> Read more: <https://blog.cloudflare.com/r2-ga/>
> - Jurisdictional Restrictions (e.g. 'EU')
> - Live Migration without Downtime (S3->R2)

we did try this (with Filezilla Pro) but it is not working, hence wanted to see if anything specific documentation is present. I will review our settings again

Do you see an error? Can you show me what that is? Unless FileZilla uses something super S3 specific or if it depends on a method that R2 doesn’t support, things _should_ just work

FileZilla

Access keys limited to a bucket. when? 😦

Is there a simple way to complete file uploads to a R2 Bucket without the need of rclone or something or the sort?

Will take a look at the docs for workers then, trying to avoid it as got most functionality already built in go

If it is in Go, then you can look for an S3-compatible Go library

I was using rclone mount and then my IP got null routed because apparently cloudflare was sending 19 gbps of traffic to my 10 gbps server

any way to avoid this? I am not sure how to control how fast the download? I thought I would be limited by my nic already

I think you'd have to contact your server provider for that - it's not really something that can be controlled on cloudflare's end

but what would they do either? I'm confused

They're the ones who null routed it, they'll likely be the only ones that can control it

Cloudflare will just send it as fast as the connection can transport it - there's not really any way of imposing a cap, and I don't know of any rclone options for it

I already have the server unlocked I'm trying to avoid this happening again

Are you guys by any chance aware of an easier method to auto sync files from a github repo to R2 other than using Github actions (that's such a pain)?