??

I believe that's called S3 Select (and only works with CSV nvm, also works with JSON), and if that's what you're thinking of then then team has previously said it's not available yet (and have no timeline). https://docs.aws.amazon.com/AmazonS3/latest/userguide/selecting-content-from-objects.html

Reference for Beelzabub's comment: https://canary.discord.com/channels/595317990191398933/940663374377783388/965731883465982037

Oh

makes sense

Select Get

simple

similar

yet different

If it's important to you, hit up Greg. I will note that S3 limits the size of the document under analysis to 1MB (unless I misremembered). So as a filtering mechanism it's not particularly powerful. The answer today is "use a worker". There's basically no performance overhead from fetching that object via a Worker and processing it that way

Oh I guess it's 1MB record meaning you could have a very very large array of 1MB JSON objects.

But yeah, using a Worker is the easiest path right now

Is the S3-compatible endpoint listed anywhere? Would like to setup Logpush to R2, but I am unable to find the endpoint in the docs :/

Hey everyone! 👋 where can I look into HTTP API docs for R2? Got private beta access but could only find via worker with https://developers.cloudflare.com/r2/get-started/

Not sure if there is any documentation for the API - at least publicly.

It's not that important, but it would increase the performance of my app

makes sense

Is that workable for you?

ye

sure

Excellent. Let me know if you have any questions about that

I looked yesterday and there seem to be some good streaming CVS and SAX JSON parsers out there

I mean, I will only know for sure when I get the access to r2

but in my head it looks functional

So you could theoretically process much larger documents than what S3 limits you to

ye

thats the idea

because my idea is to store everything in a single document

How do signatures work here?