https://discord.cloudflare.com logo
Join Discord
Powered by
# r2
  • e
    From what i can tell there isn't much of a concept of directories, but a prefix would work just as well, something like 
    r2.list('folder/')
  • j
    You can call 
    R2.list({prefix: 'abc'})
    I believe
  • e
    oo
  • e
    Didn't know that
  • e
    Any idea what the limit of files it can list is?
  • j
  • j
    max (and default) is 1000 I believe
  • e
    Fair enough, thats okay
  • j
    it supports a cursor and iterating through if you need to read more, like KV
  • e
    Makes me wonder how many you could grab until you start hitting hard limits on R2 calls
  • v
    If you want "folder"-like iteration, setting 
    delimiter
    to 
    /
    is what will give you that (it's how AWS and the others work too)
  • v
    I'm curious what the download limit you hit is. I think the current limit is going to be ~3GB but would love to know what it is in reality
  • e
    I uploaded a 5.5 GB file, going to set it to download from a gigabit server and see what happens
  • e
    download speed seems to be capping around 25-30 MB/s which is odd but it could also be unrelated to R2
  • e
    So something like 
    R2.list({prefix: 'foldername', delimiter: '/'})
    to list everything in the 
    foldername/
    directory? Or would prefix need / on the end as well?
  • e
    It seemed to give up around 4 GB
    Copy code
    2022-05-01 16:33:45 (28.5 MB/s) - Connection closed at byte 4318273536. Retrying.
  • v
    Sounds reasonable
  • e
    the next retry ended at the same byte
  • e
    so i suppose 4318273536 bytes is the limit
  • v
    28.5 MB/s is slow
  • v
    Wonder which part is bottlenecking there
  • e
    I'm gonna try from another cloud provider
  • v
    which provider were you usiung?
  • e
    OVH France
  • e
    server has gigabit down
  • v
    Gotcha. What if you try somewhere in the US?
  • e
    i can do Hetzner's Ashburn region
  • e
    Copy code
    2022-05-01 18:40:45 (44.7 MB/s) - Read error at byte 2984001536/5883697152 (The TLS connection was non-properly terminated.). Retrying.
  • e
    the next attempt seems a lot faster, its up in the 60s
  • e
    then it started varying a lot, average was 56.1
    Copy code
    2022-05-01 18:41:59 (56.1 MB/s) - Read error at byte 4211154944/5883697152 (The TLS connection was non-properly terminated.). Retrying.
1...99100101...1050Latest